00000001:02000400:2.0F:1789996073.982098:0:2971:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg437-server.virtnet: executing set_hostid 00000001:02000400:2.0:1789996088.995145:0:3191:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg437-server.virtnet: executing load_modules_local 00000001:01000000:2.0:1789996090.420072:0:3250:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 747 MB/s 00000001:01000000:2.0:1789996090.669970:0:3250:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 871 MB/s 00000001:01000000:2.0:1789996090.920041:0:3250:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 7023 MB/s 00000020:02000000:2.0:1789996091.646758:0:3282:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.58_63_g3df9749 00000400:02000000:1.0F:1789996092.482187:0:3297:0:(api-ni.c:2828:lnet_startup_lndni()) Added LNI 192.168.204.137@tcp [8/256/0/180] 00008000:02000000:3.0F:1789996095.757088:0:3447:0:(echo_client.c:2575:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:2.0:1789996137.693206:0:5251:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg437-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1789996145.924039:0:5827:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789996145.924044:0:5827:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:3.0:1789996145.924204:0:5827:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000fb42ff11 00000080:02000400:3.0:1789996145.924216:0:5827:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:3.0:1789996145.929520:0:5827:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:3.0:1789996145.929534:0:5827:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1789996145.929691:0:5827:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000a0b1c7b2) 00000020:00000080:3.0:1789996145.929711:0:5827:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1789996145.958479:0:5827:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:1.0:1789996145.958854:0:5827:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1789996145.991662:0:5827:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1789996145.991751:0:5827:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1789996145.991777:0:5827:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1789996145.991965:0:5827:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1789996145.991999:0:5827:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1789996145.993108:0:5827:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1789996145.993116:0:5827:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789996145.993125:0:5827:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4173739f0fc803c7 00000020:01000004:3.0:1789996145.993133:0:5827:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1789996145.993138:0:5827:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1789996145.993142:0:5827:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000fb42ff11 from MGS 00000020:01000004:3.0:1789996145.993146:0:5827:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1789996145.993155:0:5827:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000ea29f9af) 00000020:00000080:3.0:1789996145.993165:0:5827:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1789996145.993245:0:5827:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000fb42ff11 from MGS, refs=2 00080000:01000000:3.0:1789996145.993251:0:5827:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789996145.993255:0:5827:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4173739f0fc803d5 00000100:00100000:3.0:1789996145.993366:0:5827:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1789996145.994244:0:5827:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1789996145.994253:0:5827:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0F:1789996145.995693:0:5827:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1789996145.995710:0:5827:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1789996146.006337:0:5827:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789996146.006840:0:5827:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1789996146.006851:0:5827:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1789996146.010111:0:5827:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1789996146.010123:0:5827:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1789996146.010657:0:5827:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1789996146.010663:0:5827:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1789996146.011234:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789996146.011238:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789996146.011239:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789996146.011675:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789996146.011678:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789996146.011679:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789996146.012258:0:5827:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1789996146.017971:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:3.0:1789996146.262228:0:5827:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 3931 MB/s 00000001:01000000:3.0:1789996146.511690:0:5827:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 3267 MB/s 00000001:01000000:2.0:1789996146.761942:0:5827:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 675 MB/s 00000001:01000000:2.0:1789996147.013226:0:5827:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 713 MB/s 00080000:10000000:2.0:1789996147.031989:0:5827:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00010000:00010000:1.0:1789996147.048996:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1789996147.051710:0:5827:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:2.0:1789996147.051725:0:5827:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1789996147.051727:0:5827:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:1.0:1789996147.061819:0:5837:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1789996147.062524:0:5827:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1789996147.062605:0:5827:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:0.0:1789996147.062902:0:5827:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1789996147.062931:0:5827:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1789996147.063274:0:5827:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789996147.063428:0:5827:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1789996147.063435:0:5827:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1789996147.065953:0:5827:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1789996147.065972:0:5827:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1789996147.066310:0:5827:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1789996147.066316:0:5827:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1789996147.067010:0:5827:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1789996147.067030:0:5827:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.204.137@tcp' 00000020:01000004:3.0:1789996147.067032:0:5827:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000100:00080000:1.0:1789996147.067265:0:5842:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:01000004:3.0:1789996147.067322:0:5827:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.204.137@tcp (typ=mgc) 00000020:00000080:3.0:1789996147.067333:0:5827:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.137@tcp (000000004d4dffee) 00000020:00000080:3.0:1789996147.067349:0:5827:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1789996147.067434:0:5827:0:(ldlm_lib.c:102:import_set_conn()) imp 000000002828a801@MGC192.168.204.137@tcp: add connection 192.168.204.137@tcp at head 00010000:00010000:3.0:1789996147.067626:0:5827:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.137@tcp-0 is initialized 00000040:01000000:3.0:1789996147.067632:0:5827:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.137@tcp ctxt 1 is initialized 10000000:01000000:0.0:1789996147.069819:0:5843:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1789996147.071737:0:5827:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.137@tcp (uuid e0c28cd8-555e-481f-bd03-c3b02aee51c5) 00000020:00000080:1.0:1789996147.071762:0:5827:0:(genops.c:1384:class_connect()) connect: client e0c28cd8-555e-481f-bd03-c3b02aee51c5, cookie 0x4173739f0fc803e3 00000100:00080000:1.0:1789996147.071775:0:5827:0:(import.c:545:import_select_connection()) MGC192.168.204.137@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789996147.071786:0:5827:0:(import.c:666:import_select_connection()) MGC192.168.204.137@tcp: import 000000002828a801 using connection 192.168.204.137@tcp/0@lo 00000100:00100000:1.0:1789996147.071838:0:5827:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000010912187 x1876946942165120/t0(0) o250->MGC192.168.204.137@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789996147.071860:0:5827:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import e0c28cd8-555e-481f-bd03-c3b02aee51c5->MGS 00000020:01000004:1.0:1789996147.071886:0:5827:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1789996147.071892:0:5827:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1789996147.071912:0:5827:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000d3fadf2f) 00000020:00000080:1.0:1789996147.071924:0:5827:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1789996147.073876:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000010912187 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e0c28cd8-555e-481f-bd03-c3b02aee51c5:3312:1876946942165120:0@lo:250: 00000100:00100000:3.0:1789996147.073974:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789996147.074057:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942165120 00000100:00100000:3.0:1789996147.074066:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942165120 00000100:00100000:3.0:1789996147.074104:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789996147.074110:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000003b222fdb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:3312:x1876946942165120:12345-0@lo:250: 00010000:00080000:3.0:1789996147.074133:0:5840:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from e0c28cd8-555e-481f-bd03-c3b02aee51c5@0@lo t0 exp 0000000000000000 cur 188 last 0 00000020:00000080:3.0:1789996147.074179:0:5840:0:(genops.c:1384:class_connect()) connect: client e0c28cd8-555e-481f-bd03-c3b02aee51c5, cookie 0x4173739f0fc803f1 00000100:00080000:3.0:1789996147.074313:0:5840:0:(import.c:65:import_set_state_nolock()) 00000000b3ca5498 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789996147.074358:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000003b222fdb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0c28cd8-555e-481f-bd03-c3b02aee51c5+5:3312:x1876946942165120:12345-0@lo:250: Request processed in 248us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996147.074372:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789996147.074421:0:3312:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.204.137@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1789996147.074430:0:3312:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.204.137@tcp: connect to target with instance 0 00000100:00080000:3.0:1789996147.074437:0:3312:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.204.137@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1789996147.074441:0:3312:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1789996147.074444:0:3312:0:(import.c:65:import_set_state_nolock()) 000000002828a801 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1789996147.074446:0:3312:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1789996147.074454:0:3312:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1789996147.074459:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000010912187 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e0c28cd8-555e-481f-bd03-c3b02aee51c5:3312:1876946942165120:0@lo:250: 00000100:00100000:1.0:1789996147.092184:0:5827:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789996147.092378:0:5827:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1789996147.092385:0:5827:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1789996147.094065:0:5827:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1789996147.094076:0:5827:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1789996147.099895:0:5827:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1789996147.099911:0:5827:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1789996147.100793:0:5827:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789996147.100985:0:5827:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1789996147.100990:0:5827:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1789996147.107593:0:5827:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1789996147.107613:0:5827:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1789996147.134814:0:5827:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789996147.135075:0:5827:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1789996147.135083:0:5827:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1789996147.136401:0:5827:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1789996147.136410:0:5827:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1789996147.137097:0:5827:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789996147.137258:0:5827:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1789996147.137263:0:5827:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1789996147.137788:0:5827:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1789996147.137795:0:5827:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1789996147.138299:0:5827:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789996147.138432:0:5827:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789996147.138436:0:5827:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1789996147.138927:0:5827:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1789996147.138934:0:5827:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1789996147.140076:0:5827:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789996147.140278:0:5827:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1789996147.140284:0:5827:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1789996147.140836:0:5827:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1789996147.140850:0:5827:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1789996147.155930:0:5827:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789996147.156124:0:5827:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1789996147.156131:0:5827:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1789996147.157186:0:5827:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1789996147.157194:0:5827:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1789996147.158324:0:5827:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1789996147.158333:0:5827:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1789996147.159124:0:5827:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1789996147.159145:0:5827:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:1.0:1789996147.159162:0:5827:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.137@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1789996147.159279:0:5827:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.137@tcp ctxt 0 is initialized 00000020:01000004:1.0:1789996147.159320:0:5827:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.137@tcp, index=0000, flags=0x20065 00000020:01000004:1.0:1789996147.159325:0:5827:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1789996147.159326:0:5827:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789996147.159328:0:5827:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789996147.159329:0:5827:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789996147.159330:0:5827:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789996147.159331:0:5827:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789996147.159332:0:5827:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789996147.159333:0:5827:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789996147.159335:0:5827:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789996147.159336:0:5827:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789996147.159337:0:5827:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789996147.159339:0:5827:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789996147.159341:0:5827:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:1.0:1789996147.159343:0:5827:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789996147.159344:0:5827:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789996147.159345:0:5827:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789996147.159346:0:5827:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789996147.159347:0:5827:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789996147.159348:0:5827:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789996147.159348:0:5827:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789996147.159349:0:5827:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789996147.159355:0:5827:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789996147.159356:0:5827:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789996147.159357:0:5827:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789996147.159357:0:5827:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789996147.159382:0:5827:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1789996147.159397:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ddde0def pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5827:1876946942165248:0@lo:253: 00000100:00100000:1.0:1789996147.159473:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996147.159689:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set 00000000121a1d74 going to sleep for 11 seconds 00000100:00100000:0.0:1789996147.159787:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942165248 00000100:00100000:0.0:1789996147.159795:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942165248 00000100:00100000:0.0:1789996147.159874:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789996147.159882:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000003e47b519 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0c28cd8-555e-481f-bd03-c3b02aee51c5+5:5827:x1876946942165248:12345-0@lo:253: 20000000:01000000:0.0:1789996147.159920:0:5841:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1789996147.159923:0:5841:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:2.0:1789996147.160194:0:5862:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1789996147.160236:0:5841:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:0.0:1789996147.160466:0:5841:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789996147.161612:0:5863:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:0.0:1789996147.161788:0:5841:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1789996147.161792:0:5841:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:0.0:1789996147.161798:0:5841:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:0.0:1789996147.161801:0:5841:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:0.0:1789996147.161814:0:5841:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:0.0:1789996147.162041:0:5841:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789996147.163294:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:0.0:1789996147.163311:0:5841:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1789996147.163371:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:0.0:1789996147.163438:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:0.0:1789996147.163492:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:0.0:1789996147.163666:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:0.0:1789996147.163676:0:5841:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:0.0:1789996147.163769:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:0.0:1789996147.163781:0:5841:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:0.0:1789996147.163822:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:0.0:1789996147.163838:0:5841:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:0.0:1789996147.163884:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:0.0:1789996147.163962:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:0.0:1789996147.163998:0:5841:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1789996147.164003:0:5841:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:0.0:1789996147.164016:0:5841:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789996147.164216:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:0.0:1789996147.164228:0:5841:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1789996147.164264:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:0.0:1789996147.164302:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:0.0:1789996147.164353:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:0.0:1789996147.164365:0:5841:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:0.0:1789996147.164460:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:0.0:1789996147.164470:0:5841:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1789996147.164530:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:0.0:1789996147.164619:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:0.0:1789996147.164664:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:0.0:1789996147.164680:0:5841:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:0.0:1789996147.164768:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:0.0:1789996147.164783:0:5841:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:0.0:1789996147.164821:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:0.0:1789996147.164855:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:0.0:1789996147.165026:0:5841:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:0.0:1789996147.165077:0:5841:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:0.0:1789996147.165085:0:5841:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:2.0:1789996147.166285:0:5864:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:0.0:1789996147.166623:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:0.0:1789996147.166648:0:5841:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.204.137@tcp for mdt 20000000:01000000:0.0:1789996147.166650:0:5841:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.137@tcp (null) (null) (null) 00000040:00080000:0.0:1789996147.166721:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:0.0:1789996147.166731:0:5841:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1789996147.166778:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:0.0:1789996147.166786:0:5841:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.204.137@tcp (null) (null) 00000040:00080000:0.0:1789996147.166854:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:0.0:1789996147.166866:0:5841:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:0.0:1789996147.166896:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:0.0:1789996147.166928:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:0.0:1789996147.166989:0:5841:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1789996147.166993:0:5841:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1789996147.166999:0:5841:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:0.0:1789996147.167005:0:5841:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:2.0:1789996147.167529:0:5865:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 20000000:02000000:0.0:1789996147.167653:0:5841:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:0.0:1789996147.173931:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:0.0:1789996147.173982:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 160 off10176 00000040:00080000:0.0:1789996147.174055:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10400 20000000:01000000:0.0:1789996147.174073:0:5841:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1789996147.174076:0:5841:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1789996147.174080:0:5841:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1789996147.174118:0:5841:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1789996147.174121:0:5841:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1789996147.174167:0:5841:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1789996147.174169:0:5841:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:2.0:1789996147.175461:0:5866:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:0.0:1789996147.175836:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:0.0:1789996147.175881:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:0.0:1789996147.175914:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:0.0:1789996147.175925:0:5841:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1789996147.175927:0:5841:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1789996147.176849:0:5867:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 00000040:00080000:3.0:1789996147.177068:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10624 00000040:00080000:3.0:1789996147.177122:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 80 off10704 00000040:00080000:3.0:1789996147.177282:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 00000020:00000080:3.0:1789996147.177313:0:5841:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789996147.177315:0:5841:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 10000000:01000000:3.0:1789996147.177324:0:5841:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1789996147.177344:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000d3f2e53c/0x4173739f0fc803f8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996147.177359:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d3f2e53c/0x4173739f0fc803f8 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996147.177370:0:5841:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000d3f2e53c/0x4173739f0fc803f8 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996147.177377:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000d3f2e53c/0x4173739f0fc803f8 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996147.177383:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000d3f2e53c/0x4173739f0fc803f8 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996147.177389:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000d3f2e53c/0x4173739f0fc803f8 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996147.177395:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000d3f2e53c already unused, calling callback (000000000624dc3f) 00010000:00010000:3.0:1789996147.177398:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000d3f2e53c/0x4173739f0fc803f8 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996147.177405:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000d3f2e53c/0x4173739f0fc803f8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996147.177417:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000d3f2e53c/0x4173739f0fc803f8 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996147.177433:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000d3f2e53c/0x4173739f0fc803f8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996147.177439:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000d3f2e53c/0x4173739f0fc803f8 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789996147.177454:0:5841:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1789996147.324334:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000003e47b519 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0c28cd8-555e-481f-bd03-c3b02aee51c5+5:5827:x1876946942165248:12345-0@lo:253: Request processed in 164444us (164853us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996147.324350:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789996147.324452:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ddde0def pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5827:1876946942165248:0@lo:253: 10000000:01000000:1.0:1789996147.324469:0:5827:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1789996147.324472:0:5827:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789996147.324474:0:5827:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789996147.324475:0:5827:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789996147.324476:0:5827:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:1.0:1789996147.324478:0:5827:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789996147.324479:0:5827:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789996147.324480:0:5827:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789996147.324481:0:5827:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789996147.324483:0:5827:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1789996147.324485:0:5827:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789996147.324486:0:5827:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1789996147.324503:0:5827:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000fb42ff11 from lustre-MDT0000 10000000:01000000:1.0:1789996147.324533:0:5827:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1789996147.324535:0:5827:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1789996147.324539:0:5827:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8e08545d19c0 10000000:01000000:1.0:1789996147.324574:0:5827:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789996147.324582:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8e08545d19c0 from 1 10000000:01000000:1.0:1789996147.324585:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1789996147.324620:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.137@tcp lock: 00000000657793dc/0x4173739f0fc803ff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996147.324631:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.137@tcp lock: 00000000657793dc/0x4173739f0fc803ff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996147.324659:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.137@tcp lock: 00000000657793dc/0x4173739f0fc803ff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789996147.324676:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ddde0def pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5827:1876946942165376:0@lo:101: 00000100:00100000:1.0:1789996147.324710:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996147.324755:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set 00000000104e1c5f going to sleep for 11 seconds 00000100:00100000:3.0:1789996147.324841:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942165376 00000100:00100000:3.0:1789996147.324847:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942165376 00000100:00100000:3.0:1789996147.324892:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789996147.324900:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f459e8dd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+5:5827:x1876946942165376:12345-0@lo:101: 00010000:00010000:3.0:1789996147.324912:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789996147.324925:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d3f2e53c/0x4173739f0fc80406 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4173739f0fc803ff expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996147.324947:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d3f2e53c/0x4173739f0fc80406 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4173739f0fc803ff expref: 6 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996147.324956:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d3f2e53c/0x4173739f0fc80406 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4173739f0fc803ff expref: 6 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996147.324964:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d3f2e53c, rc 0) 00000100:00100000:3.0:1789996147.325083:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f459e8dd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+6:5827:x1876946942165376:12345-0@lo:101: Request processed in 183us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996147.325089:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789996147.325276:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ddde0def pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5827:1876946942165376:0@lo:101: 00010000:00010000:0.0:1789996147.325290:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.137@tcp lock: 00000000657793dc/0x4173739f0fc803ff lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc80406 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996147.325298:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.137@tcp lock: 00000000657793dc/0x4173739f0fc803ff lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4173739f0fc80406 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789996147.325363:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008befb580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5827:1876946942165504:0@lo:501: 00000100:00100000:0.0:1789996147.325389:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996147.325447:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e7eafbdf going to sleep for 11 seconds 00000100:00100000:3.0:1789996147.325485:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942165504 00000100:00100000:3.0:1789996147.325490:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942165504 00000100:00100000:3.0:1789996147.325867:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789996147.325875:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ff938b3b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0c28cd8-555e-481f-bd03-c3b02aee51c5+6:5827:x1876946942165504:12345-0@lo:501: 00000100:00100000:3.0:1789996147.326092:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ff938b3b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0c28cd8-555e-481f-bd03-c3b02aee51c5+6:5827:x1876946942165504:12345-0@lo:501: Request processed in 218us (703us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789996147.326099:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789996147.326174:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008befb580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5827:1876946942165504:0@lo:501: 10000000:01000000:0.0:1789996147.326209:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.137@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1789996147.326225:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.137@tcp lock: 00000000657793dc/0x4173739f0fc803ff lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc80406 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996147.326233:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.137@tcp lock: 00000000657793dc/0x4173739f0fc803ff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc80406 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789996147.326241:0:5827:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8e08709bf800 10000000:01000000:0.0:1789996147.326245:0:5827:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1789996147.326249:0:5827:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8e08709bf800 10000000:01000000:0.0:1789996147.326251:0:5827:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1789996147.326253:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8e08709bf800 from 1 10000000:01000000:0.0:1789996147.326256:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1789996147.326275:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.137@tcp lock: 000000009fb19e5b/0x4173739f0fc8040d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996147.326280:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.137@tcp lock: 000000009fb19e5b/0x4173739f0fc8040d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996147.326287:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.137@tcp lock: 000000009fb19e5b/0x4173739f0fc8040d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789996147.326297:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008befb580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5827:1876946942165632:0@lo:101: 00000100:00100000:0.0:1789996147.326330:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996147.326532:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e7eafbdf going to sleep for 11 seconds 00000100:00100000:1.0:1789996147.326679:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942165632 00000100:00100000:1.0:1789996147.326684:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942165632 00000100:00100000:1.0:1789996147.326707:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789996147.326712:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000dbfbbe63 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0c28cd8-555e-481f-bd03-c3b02aee51c5+6:5827:x1876946942165632:12345-0@lo:101: 00010000:00010000:1.0:1789996147.326720:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789996147.326730:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ba0ae9de/0x4173739f0fc80414 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4173739f0fc8040d expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996147.326749:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ba0ae9de/0x4173739f0fc80414 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4173739f0fc8040d expref: 7 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996147.326758:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ba0ae9de/0x4173739f0fc80414 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4173739f0fc8040d expref: 7 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996147.326765:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ba0ae9de, rc 0) 00000100:00100000:1.0:1789996147.326800:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000dbfbbe63 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0c28cd8-555e-481f-bd03-c3b02aee51c5+7:5827:x1876946942165632:12345-0@lo:101: Request processed in 88us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996147.326806:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789996147.326878:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008befb580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5827:1876946942165632:0@lo:101: 00010000:00010000:0.0:1789996147.326887:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.137@tcp lock: 000000009fb19e5b/0x4173739f0fc8040d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc80414 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996147.326894:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.137@tcp lock: 000000009fb19e5b/0x4173739f0fc8040d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4173739f0fc80414 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789996147.326904:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.137@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1789996147.326913:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.137@tcp lock: 000000009fb19e5b/0x4173739f0fc8040d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc80414 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996147.326919:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.137@tcp lock: 000000009fb19e5b/0x4173739f0fc8040d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc80414 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789996147.326924:0:5827:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1789996147.326927:0:5827:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789996147.326931:0:5827:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8e08709bf800 10000000:01000000:0.0:1789996147.326934:0:5827:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1789996147.326936:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1789996147.326938:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1789996147.326949:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.137@tcp lock: 00000000f5263168/0x4173739f0fc8041b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996147.326955:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.137@tcp lock: 00000000f5263168/0x4173739f0fc8041b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996147.326961:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.137@tcp lock: 00000000f5263168/0x4173739f0fc8041b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789996147.326978:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008befb580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5827:1876946942165760:0@lo:101: 00000100:00100000:0.0:1789996147.327000:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996147.327023:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e7eafbdf going to sleep for 11 seconds 00000100:00100000:1.0:1789996147.327073:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942165760 00000100:00100000:1.0:1789996147.327077:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942165760 00000100:00100000:1.0:1789996147.327093:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789996147.327098:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b955a9ba pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0c28cd8-555e-481f-bd03-c3b02aee51c5+7:5827:x1876946942165760:12345-0@lo:101: 00010000:00010000:1.0:1789996147.327110:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789996147.327117:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000000e02c59/0x4173739f0fc80422 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4173739f0fc8041b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996147.327129:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000000e02c59/0x4173739f0fc80422 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4173739f0fc8041b expref: 8 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996147.327136:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000000e02c59/0x4173739f0fc80422 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4173739f0fc8041b expref: 8 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996147.327143:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000000e02c59, rc 0) 00000100:00100000:1.0:1789996147.327185:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b955a9ba pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0c28cd8-555e-481f-bd03-c3b02aee51c5+8:5827:x1876946942165760:12345-0@lo:101: Request processed in 88us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996147.327251:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789996147.327317:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008befb580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5827:1876946942165760:0@lo:101: 00010000:00010000:0.0:1789996147.327326:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.137@tcp lock: 00000000f5263168/0x4173739f0fc8041b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc80422 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996147.327332:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.137@tcp lock: 00000000f5263168/0x4173739f0fc8041b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4173739f0fc80422 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789996147.327366:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008befb580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5827:1876946942165888:0@lo:501: 00000100:00100000:0.0:1789996147.327388:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996147.327405:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e7eafbdf going to sleep for 11 seconds 00000100:00100000:1.0:1789996147.327453:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942165888 00000100:00100000:1.0:1789996147.327457:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942165888 00000100:00100000:1.0:1789996147.327472:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789996147.327476:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a56ed511 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0c28cd8-555e-481f-bd03-c3b02aee51c5+8:5827:x1876946942165888:12345-0@lo:501: 00000100:00100000:1.0:1789996147.327662:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a56ed511 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0c28cd8-555e-481f-bd03-c3b02aee51c5+9:5827:x1876946942165888:12345-0@lo:501: Request processed in 186us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996147.327669:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789996147.327734:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008befb580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5827:1876946942165888:0@lo:501: 00000100:00100000:0.0:1789996147.327756:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008befb580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5827:1876946942166016:0@lo:503: 00000100:00100000:0.0:1789996147.327787:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996147.327812:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e7eafbdf going to sleep for 11 seconds 00000100:00100000:1.0:1789996147.327862:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942166016 00000100:00100000:1.0:1789996147.327866:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942166016 00000100:00100000:1.0:1789996147.327882:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789996147.327887:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000cf330717 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0c28cd8-555e-481f-bd03-c3b02aee51c5+9:5827:x1876946942166016:12345-0@lo:503: 00000100:00100000:1.0:1789996147.328035:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000cf330717 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0c28cd8-555e-481f-bd03-c3b02aee51c5+9:5827:x1876946942166016:12345-0@lo:503: Request processed in 147us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996147.328041:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789996147.328119:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008befb580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5827:1876946942166016:0@lo:503: 00000100:00100000:0.0:1789996147.328694:0:5869:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008befb580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5869:1876946942166144:0@lo:502: 00000100:00100000:0.0:1789996147.328735:0:5869:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996147.328762:0:5869:0:(client.c:2716:ptlrpc_set_wait()) set 00000000cc7677b5 going to sleep for 11 seconds 00000100:00100000:1.0:1789996147.328809:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942166144 00000100:00100000:1.0:1789996147.328814:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942166144 00000100:00100000:1.0:1789996147.328843:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789996147.328849:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000073154ce pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0c28cd8-555e-481f-bd03-c3b02aee51c5+9:5869:x1876946942166144:12345-0@lo:502: 00000100:00100000:1.0:1789996147.329005:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000073154ce pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0c28cd8-555e-481f-bd03-c3b02aee51c5+9:5869:x1876946942166144:12345-0@lo:502: Request processed in 156us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996147.329012:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789996147.329082:0:5869:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008befb580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5869:1876946942166144:0@lo:502: 00000020:01000000:0.0:1789996147.329105:0:5869:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789996147.329115:0:5869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789996147.329121:0:5869:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1789996147.329126:0:5869:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1789996147.329129:0:5869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789996147.329159:0:5869:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (000000003fab2040) 00000020:00000080:0.0:1789996147.329177:0:5869:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1789996147.329184:0:5869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1789996147.329344:0:5869:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:0.0:1789996147.329359:0:5869:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4173739f0fc80430 00000020:00000080:0.0:1789996147.329596:0:5869:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1789996147.329601:0:5869:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789996147.329604:0:5869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789996147.329605:0:5869:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1789996147.329608:0:5869:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789996147.329612:0:5869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789996147.329613:0:5869:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1789996147.329617:0:5869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789996147.329622:0:5869:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000c223d51f) 00000020:00000080:0.0:1789996147.329633:0:5869:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1789996147.329636:0:5869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1789996147.329638:0:5869:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1789996147.329641:0:5869:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1789996147.329646:0:5869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1789996147.329688:0:5869:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000fb42ff11 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1789996147.329700:0:5869:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000a5df29bd) 00000020:00000080:0.0:1789996147.329708:0:5869:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1789996147.329755:0:5869:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1789996147.329759:0:5869:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4173739f0fc80445 00000020:00000080:0.0:1789996147.329839:0:5869:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1789996147.329844:0:5869:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1789996147.329848:0:5869:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x4173739f0fc8044c 00080000:01000000:0.0:1789996147.329852:0:5869:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:0.0:1789996147.329855:0:5869:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4173739f0fc80453 00080000:10000000:0.0:1789996147.330363:0:5869:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:0.0:1789996147.330732:0:5869:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:0.0:1789996147.334400:0:5869:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:1.0:1789996147.389357:0:5869:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:1.0:1789996147.390389:0:5869:0:(tgt_lastrcvd.c:1879:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:1.0:1789996147.392795:0:5869:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:1.0:1789996147.393051:0:5869:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1789996147.426074:0:5869:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (0000000027993d3d) 00000020:00000080:1.0:1789996147.426098:0:5869:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:1.0:1789996147.426206:0:5869:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:1.0:1789996147.426214:0:5869:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4173739f0fc80461 00000020:00000080:1.0:1789996147.427154:0:5869:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:1.0:1789996147.429863:0:5869:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:2.0:1789996147.469537:0:5869:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:3.0:1789996147.499877:0:5869:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:1.0:1789996147.554653:0:5869:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:3.0:1789996147.627315:0:5869:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:0.0:1789996147.677631:0:5869:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:3.0:1789996147.711984:0:5869:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x4173739f0fc80468 00000020:00000080:3.0:1789996147.712665:0:5869:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1789996147.712677:0:5869:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789996147.712683:0:5869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789996147.712685:0:5869:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1789996147.712688:0:5869:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789996147.712694:0:5869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789996147.712695:0:5869:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1789996147.712699:0:5869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1789996147.712730:0:5869:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1789996147.712741:0:5869:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789996147.712744:0:5869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789996147.712745:0:5869:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1789996147.712747:0:5869:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789996147.712750:0:5869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789996147.712751:0:5869:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789996147.712754:0:5869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789996147.712755:0:5869:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1789996147.712906:0:5869:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fe130521 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5869:1876946942166272:0@lo:502: 00000100:00100000:3.0:1789996147.713050:0:5869:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789996147.713155:0:5869:0:(client.c:2716:ptlrpc_set_wait()) set 0000000024e3bb90 going to sleep for 11 seconds 00000100:00100000:1.0:1789996147.713284:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942166272 00000100:00100000:1.0:1789996147.713299:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942166272 00000100:00100000:1.0:1789996147.713343:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789996147.713353:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000018320905 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0c28cd8-555e-481f-bd03-c3b02aee51c5+9:5869:x1876946942166272:12345-0@lo:502: 00000100:00100000:1.0:1789996147.713758:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000018320905 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0c28cd8-555e-481f-bd03-c3b02aee51c5+9:5869:x1876946942166272:12345-0@lo:502: Request processed in 407us (709us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996147.713767:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789996147.714402:0:5869:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fe130521 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5869:1876946942166272:0@lo:502: 00000020:01000000:0.0:1789996147.714437:0:5869:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789996147.714444:0:5869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789996147.714446:0:5869:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre sys.timeout 00000040:00080000:0.0:1789996147.714450:0:5869:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:1.0:1789996147.714703:0:5827:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:1.0:1789996147.714720:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.137@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1789996147.714781:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.137@tcp lock: 00000000f5263168/0x4173739f0fc8041b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc80422 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996147.714871:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.137@tcp lock: 00000000f5263168/0x4173739f0fc8041b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc80422 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789996147.714880:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8e08709bf800 from 1 10000000:01000000:1.0:1789996147.714883:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789996147.714914:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.137@tcp lock: 0000000010d91fd2/0x4173739f0fc8046f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996147.714921:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.137@tcp lock: 0000000010d91fd2/0x4173739f0fc8046f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996147.714929:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.137@tcp lock: 0000000010d91fd2/0x4173739f0fc8046f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789996147.714944:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000e1069fa pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5827:1876946942166400:0@lo:101: 00000100:00100000:1.0:1789996147.715060:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996147.715151:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e63e7f3e going to sleep for 11 seconds 00000100:00100000:2.0:1789996147.715401:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942166400 00000100:00100000:2.0:1789996147.715408:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942166400 00000100:00100000:2.0:1789996147.715507:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789996147.715517:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000059054c22 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+9:5827:x1876946942166400:12345-0@lo:101: 00010000:00010000:2.0:1789996147.715532:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789996147.715576:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000003c202ce6/0x4173739f0fc80476 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4173739f0fc8046f expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996147.715601:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003c202ce6/0x4173739f0fc80476 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4173739f0fc8046f expref: 10 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996147.715611:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000003c202ce6/0x4173739f0fc80476 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4173739f0fc8046f expref: 10 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996147.715626:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000003c202ce6, rc 0) 00000100:00100000:2.0:1789996147.715673:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000059054c22 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+10:5827:x1876946942166400:12345-0@lo:101: Request processed in 159us (614us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996147.715680:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789996147.715786:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000e1069fa pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5827:1876946942166400:0@lo:101: 00010000:00010000:0.0:1789996147.715808:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.137@tcp lock: 0000000010d91fd2/0x4173739f0fc8046f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc80476 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996147.715816:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.137@tcp lock: 0000000010d91fd2/0x4173739f0fc8046f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4173739f0fc80476 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789996147.716414:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008befb580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5827:1876946942166528:0@lo:256: 00000100:00100000:0.0:1789996147.716454:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996147.717379:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942166528 00000100:00100000:1.0:1789996147.717390:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942166528 00000100:00100000:1.0:1789996147.717430:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789996147.717436:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000009b205d21 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0c28cd8-555e-481f-bd03-c3b02aee51c5+10:5827:x1876946942166528:12345-0@lo:256: 20000000:01000000:1.0:1789996147.717458:0:5840:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1789996147.717464:0:5840:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1789996147.717528:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000009b205d21 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0c28cd8-555e-481f-bd03-c3b02aee51c5+10:5827:x1876946942166528:12345-0@lo:256: Request processed in 92us (1073us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996147.717535:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789996147.717692:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ca4da0b5 going to sleep for 11 seconds 00000100:00100000:0.0:1789996147.717714:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008befb580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5827:1876946942166528:0@lo:256: 10000000:01000000:0.0:1789996147.718632:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.137@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789996147.718651:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.137@tcp lock: 0000000010d91fd2/0x4173739f0fc8046f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc80476 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996147.718663:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.137@tcp lock: 0000000010d91fd2/0x4173739f0fc8046f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc80476 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789996147.718671:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e08709bf800 from 1 10000000:01000000:0.0:1789996147.718674:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789996147.718704:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.137@tcp lock: 0000000092ef4a07/0x4173739f0fc8047d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996147.718719:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.137@tcp lock: 0000000092ef4a07/0x4173739f0fc8047d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996147.718728:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.137@tcp lock: 0000000092ef4a07/0x4173739f0fc8047d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789996147.718743:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008befb580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5827:1876946942166656:0@lo:101: 00000100:00100000:0.0:1789996147.718781:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996147.718947:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ca4da0b5 going to sleep for 11 seconds 00000100:00100000:1.0:1789996147.719069:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942166656 00000100:00100000:1.0:1789996147.719075:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942166656 00000100:00100000:1.0:1789996147.719154:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789996147.719162:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e9c704f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0c28cd8-555e-481f-bd03-c3b02aee51c5+10:5827:x1876946942166656:12345-0@lo:101: 00010000:00010000:1.0:1789996147.719174:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789996147.719247:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000067f10cfd/0x4173739f0fc80484 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4173739f0fc8047d expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996147.719275:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000067f10cfd/0x4173739f0fc80484 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4173739f0fc8047d expref: 11 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996147.719388:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000067f10cfd/0x4173739f0fc80484 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4173739f0fc8047d expref: 11 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996147.719398:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000067f10cfd, rc 0) 00000100:00100000:1.0:1789996147.719438:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e9c704f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0c28cd8-555e-481f-bd03-c3b02aee51c5+11:5827:x1876946942166656:12345-0@lo:101: Request processed in 277us (657us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996147.719444:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789996147.719502:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008befb580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5827:1876946942166656:0@lo:101: 00010000:00010000:0.0:1789996147.719513:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.137@tcp lock: 0000000092ef4a07/0x4173739f0fc8047d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc80484 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996147.719521:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.137@tcp lock: 0000000092ef4a07/0x4173739f0fc8047d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4173739f0fc80484 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789996147.719583:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008befb580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5827:1876946942166784:0@lo:501: 00000100:00100000:0.0:1789996147.719605:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996147.719724:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ca4da0b5 going to sleep for 11 seconds 00000100:00100000:3.0:1789996147.719762:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942166784 00000100:00100000:3.0:1789996147.719767:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942166784 00000100:00100000:3.0:1789996147.719787:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789996147.719802:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000029da0374 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0c28cd8-555e-481f-bd03-c3b02aee51c5+11:5827:x1876946942166784:12345-0@lo:501: 00000100:00100000:3.0:1789996147.720759:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000029da0374 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0c28cd8-555e-481f-bd03-c3b02aee51c5+11:5827:x1876946942166784:12345-0@lo:501: Request processed in 966us (1152us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996147.720769:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789996147.721007:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008befb580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5827:1876946942166784:0@lo:501: 00000100:00100000:0.0:1789996147.721046:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008befb580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5827:1876946942166912:0@lo:503: 00000100:00100000:0.0:1789996147.721086:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996147.721116:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ca4da0b5 going to sleep for 11 seconds 00000100:00100000:3.0:1789996147.721375:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942166912 00000100:00100000:3.0:1789996147.721380:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942166912 00000100:00100000:3.0:1789996147.721406:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789996147.721412:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000005e4649e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0c28cd8-555e-481f-bd03-c3b02aee51c5+11:5827:x1876946942166912:12345-0@lo:503: 00000040:00080000:3.0:1789996147.721448:0:5841:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789996147.721490:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000005e4649e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0c28cd8-555e-481f-bd03-c3b02aee51c5+11:5827:x1876946942166912:12345-0@lo:503: Request processed in 78us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996147.721497:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789996147.721588:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008befb580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5827:1876946942166912:0@lo:503: 00000040:00080000:0.0:1789996147.722685:0:5873:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:3.0:1789996147.722889:0:5827:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:3.0:1789996147.722906:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.137@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789996147.722921:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.137@tcp lock: 0000000092ef4a07/0x4173739f0fc8047d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc80484 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996147.722932:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.137@tcp lock: 0000000092ef4a07/0x4173739f0fc8047d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc80484 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789996147.722993:0:5827:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1789996147.722997:0:5827:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8e08709bf800 10000000:01000000:3.0:1789996147.722999:0:5827:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8e08709bf800 10000000:01000000:3.0:1789996147.723003:0:5827:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789996147.723008:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8e08709bf800 from 1 10000000:01000000:3.0:1789996147.723011:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789996147.723051:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.137@tcp lock: 000000005f608171/0x4173739f0fc8048b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996147.723057:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.137@tcp lock: 000000005f608171/0x4173739f0fc8048b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996147.723066:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.137@tcp lock: 000000005f608171/0x4173739f0fc8048b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789996147.723085:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009fdbf3e8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5827:1876946942167040:0@lo:101: 00000100:00100000:3.0:1789996147.723132:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789996147.723172:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set 00000000475d4a2d going to sleep for 11 seconds 00000100:00100000:3.0:1789996147.723209:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942167040 00000100:00100000:3.0:1789996147.723214:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942167040 00000100:00100000:3.0:1789996147.723243:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789996147.723249:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b198a786 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0c28cd8-555e-481f-bd03-c3b02aee51c5+11:5827:x1876946942167040:12345-0@lo:101: 00010000:00010000:3.0:1789996147.723270:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789996147.723282:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000000740d96f/0x4173739f0fc80492 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4173739f0fc8048b expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996147.723466:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000740d96f/0x4173739f0fc80492 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4173739f0fc8048b expref: 12 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996147.723478:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000000740d96f/0x4173739f0fc80492 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4173739f0fc8048b expref: 12 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996147.723486:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000000740d96f, rc 0) 00000100:00100000:3.0:1789996147.723521:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b198a786 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0c28cd8-555e-481f-bd03-c3b02aee51c5+12:5827:x1876946942167040:12345-0@lo:101: Request processed in 272us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996147.723527:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789996147.723592:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009fdbf3e8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5827:1876946942167040:0@lo:101: 00010000:00010000:3.0:1789996147.723604:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.137@tcp lock: 000000005f608171/0x4173739f0fc8048b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc80492 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996147.723611:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.137@tcp lock: 000000005f608171/0x4173739f0fc8048b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4173739f0fc80492 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789996147.723654:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009fdbf3e8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5827:1876946942167168:0@lo:501: 00000100:00100000:3.0:1789996147.723678:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789996147.723690:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set 00000000475d4a2d going to sleep for 11 seconds 00000100:00100000:3.0:1789996147.723703:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942167168 00000100:00100000:3.0:1789996147.723707:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942167168 00000100:00100000:3.0:1789996147.723723:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789996147.723728:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c66f8462 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0c28cd8-555e-481f-bd03-c3b02aee51c5+12:5827:x1876946942167168:12345-0@lo:501: 00000100:00100000:3.0:1789996147.724031:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c66f8462 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0c28cd8-555e-481f-bd03-c3b02aee51c5+12:5827:x1876946942167168:12345-0@lo:501: Request processed in 302us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996147.724038:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789996147.724068:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009fdbf3e8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5827:1876946942167168:0@lo:501: 00000100:00100000:3.0:1789996147.724093:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009fdbf3e8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5827:1876946942167296:0@lo:503: 00000100:00100000:3.0:1789996147.724129:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789996147.724153:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set 00000000475d4a2d going to sleep for 11 seconds 00000100:00100000:3.0:1789996147.724166:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942167296 00000100:00100000:3.0:1789996147.724169:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942167296 00000100:00100000:3.0:1789996147.724761:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789996147.724770:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000628971d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0c28cd8-555e-481f-bd03-c3b02aee51c5+12:5827:x1876946942167296:12345-0@lo:503: 00000100:00100000:3.0:1789996147.725608:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000628971d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0c28cd8-555e-481f-bd03-c3b02aee51c5+12:5827:x1876946942167296:12345-0@lo:503: Request processed in 838us (1476us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996147.725628:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789996147.726050:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009fdbf3e8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5827:1876946942167296:0@lo:503: 00000100:00100000:2.0:1789996147.727420:0:5874:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000057f89aaf pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5874:1876946942167424:0@lo:502: 00000100:00100000:2.0:1789996147.727488:0:5874:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996147.727624:0:5874:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f5c1cc1b going to sleep for 11 seconds 00000100:00100000:1.0:1789996147.727707:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942167424 00000100:00100000:1.0:1789996147.727714:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942167424 00000100:00100000:1.0:1789996147.727800:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789996147.727809:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000141bd2e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0c28cd8-555e-481f-bd03-c3b02aee51c5+12:5874:x1876946942167424:12345-0@lo:502: 00000100:00100000:1.0:1789996147.728097:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000141bd2e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0c28cd8-555e-481f-bd03-c3b02aee51c5+12:5874:x1876946942167424:12345-0@lo:502: Request processed in 289us (609us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996147.728105:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789996147.728203:0:5874:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000057f89aaf pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5874:1876946942167424:0@lo:502: 00000020:01000004:2.0:1789996147.728276:0:5874:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1789996147.728664:0:5874:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000d5816d13) 00000020:00000080:2.0:1789996147.728685:0:5874:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:2.0:1789996147.728770:0:5874:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000fb42ff11 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1789996147.728774:0:5874:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000fb42ff11 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1789996147.728776:0:5874:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000fb42ff11 4 00010000:00080000:2.0:1789996147.728814:0:5874:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000a7febdfb@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.137@tcp at head 00010000:00010000:2.0:1789996147.731126:0:5874:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:2.0:1789996147.731836:0:5874:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1789996147.731874:0:5874:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789996147.731888:0:5874:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x4173739f0fc804a0 00000100:00080000:2.0:1789996147.731898:0:5874:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789996147.731909:0:5874:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000a7febdfb using connection 192.168.204.137@tcp/0@lo 00000100:00100000:2.0:1789996147.731943:0:5874:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000057f89aaf x1876946942167552/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789996147.731975:0:5874:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1789996147.732173:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000057f89aaf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876946942167552:0@lo:38: 00000100:00100000:3.0:1789996147.732416:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789996147.732680:0:5874:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004536c184 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5874:1876946942167680:0@lo:502: 00000100:00100000:3.0:1789996147.732720:0:5874:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789996147.732744:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942167680 00000100:00100000:3.0:1789996147.732751:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942167680 00000100:00100000:3.0:1789996147.732786:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789996147.732863:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000406f82af pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+12:5874:x1876946942167680:12345-0@lo:502: 00000100:00100000:3.0:1789996147.733163:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000406f82af pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+12:5874:x1876946942167680:12345-0@lo:502: Request processed in 303us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996147.733172:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789996147.733505:0:5874:0:(client.c:2716:ptlrpc_set_wait()) set 00000000187d3ee5 going to sleep for 11 seconds 00000100:00100000:3.0:1789996147.733527:0:5874:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004536c184 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5874:1876946942167680:0@lo:502: 00000040:00080000:3.0:1789996147.733571:0:5874:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000100:00100000:2.0:1789996147.733697:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942167552 00000100:00100000:2.0:1789996147.733702:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942167552 00000100:00100000:2.0:1789996147.733733:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789996147.733737:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000003ee27550 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3312:x1876946942167552:12345-0@lo:38: 00000100:00100000:2.0:1789996147.733786:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000003ee27550 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3312:x1876946942167552:12345-0@lo:38: Request processed in 48us (1537us total) trans 0 rc -11/-11 00000100:00100000:2.0:1789996147.733803:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789996147.733864:0:3312:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789996147.733870:0:3312:0:(import.c:65:import_set_state_nolock()) 00000000a7febdfb lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789996147.733874:0:3312:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1789996147.733877:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000057f89aaf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876946942167552:0@lo:38: 00000020:01000000:1.0:1789996147.739068:0:5827:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:1.0:1789996147.739105:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.137@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789996147.740383:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.137@tcp lock: 000000005f608171/0x4173739f0fc8048b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc80492 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996147.740413:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.137@tcp lock: 000000005f608171/0x4173739f0fc8048b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc80492 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1789996147.740499:0:5827:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1789996147.740502:0:5827:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789996147.740503:0:5827:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789996147.740504:0:5827:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789996147.740506:0:5827:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789996147.740507:0:5827:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789996147.740508:0:5827:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789996147.740510:0:5827:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789996147.740511:0:5827:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789996147.740512:0:5827:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789996147.740514:0:5827:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789996147.740515:0:5827:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789996147.740519:0:5827:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:1.0:1789996147.740522:0:5827:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789996147.740523:0:5827:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789996147.740524:0:5827:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789996147.740525:0:5827:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789996147.740526:0:5827:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789996147.740527:0:5827:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789996147.740528:0:5827:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789996147.740529:0:5827:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789996147.740530:0:5827:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789996147.740531:0:5827:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789996147.740531:0:5827:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789996147.740532:0:5827:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789996147.740576:0:5827:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1789996147.740596:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f1387029 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5827:1876946942167808:0@lo:253: 00000100:00100000:1.0:1789996147.740671:0:5827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996147.740715:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d32ed115 going to sleep for 11 seconds 00000100:00100000:1.0:1789996147.740740:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942167808 00000100:00100000:1.0:1789996147.740747:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942167808 00000100:00100000:1.0:1789996147.740811:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789996147.740827:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000006ac686e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0c28cd8-555e-481f-bd03-c3b02aee51c5+12:5827:x1876946942167808:12345-0@lo:253: 20000000:01000000:1.0:1789996147.740868:0:5840:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1789996147.740884:0:5840:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1789996147.799575:0:5840:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1789996147.799678:0:5840:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1789996147.800123:0:5862:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789996147.800129:0:5862:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1789996147.800267:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000005d6f0066/0x4173739f0fc804a7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996147.800353:0:5862:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000003c202ce6/0x4173739f0fc80476 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4173739f0fc8046f expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996147.800363:0:5862:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000005d6f0066/0x4173739f0fc804a7 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996147.800420:0:5862:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000003c202ce6/0x4173739f0fc80476 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4173739f0fc8046f expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996147.800436:0:5862:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000003c202ce6/0x4173739f0fc80476 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4173739f0fc8046f expref: 12 pid: 5839 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789996147.800450:0:5862:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004536c184 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5862:1876946942167936:0@lo:104: 00000100:00100000:3.0:1789996147.800518:0:5862:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789996147.800609:0:5862:0:(client.c:2716:ptlrpc_set_wait()) set 0000000024e3bb90 going to sleep for 11 seconds 00000100:00100000:0.0:1789996147.800686:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942167936 00000100:00100000:0.0:1789996147.800695:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942167936 00000100:00100000:0.0:1789996147.800745:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789996147.800755:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000120e2bf6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+3:5862:x1876946942167936:12345-0@lo:104: 00010000:00010000:0.0:1789996147.800768:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.137@tcp lock: 0000000010d91fd2/0x4173739f0fc8046f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4173739f0fc80476 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996147.800840:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789996147.800846:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000120e2bf6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+3:5862:x1876946942167936:12345-0@lo:104: Request processed in 93us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996147.800853:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1789996147.800872:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789996147.800876:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.137@tcp lock: 0000000010d91fd2/0x4173739f0fc8046f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4173739f0fc80476 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996147.800883:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000010d91fd2 already unused, calling callback (00000000a84157b1) 10000000:00010000:0.0:1789996147.800886:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.137@tcp lock: 0000000010d91fd2/0x4173739f0fc8046f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4173739f0fc80476 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996147.800893:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.137@tcp lock: 0000000010d91fd2/0x4173739f0fc8046f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4173739f0fc80476 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789996147.800899:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.137@tcp lock: 0000000010d91fd2/0x4173739f0fc8046f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4173739f0fc80476 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789996147.800904:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789996147.800943:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.137@tcp lock: 0000000010d91fd2/0x4173739f0fc8046f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4173739f0fc80476 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996147.801154:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789996147.801174:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.137@tcp lock: 0000000010d91fd2/0x4173739f0fc8046f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4173739f0fc80476 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996147.801180:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.137@tcp lock: 0000000010d91fd2/0x4173739f0fc8046f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4173739f0fc80476 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996147.801210:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789996147.801211:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789996147.801213:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789996147.801439:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008befb580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e0c28cd8-555e-481f-bd03-c3b02aee51c5:3314:1876946942168064:0@lo:103: 00000100:00100000:0.0:1789996147.801473:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996147.801581:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942168064 00000100:00100000:0.0:1789996147.801587:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942168064 00010000:00010000:0.0:1789996147.801606:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000003c202ce6/0x4173739f0fc80476 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4173739f0fc8046f expref: 13 pid: 5839 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789996147.801629:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789996147.801635:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000da929b98 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+13:3314:x1876946942168064:12345-0@lo:103: 00010000:00010000:0.0:1789996147.801644:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789996147.801648:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000003c202ce6/0x4173739f0fc80476 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4173739f0fc8046f expref: 13 pid: 5839 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996147.801658:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000003c202ce6/0x4173739f0fc80476 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4173739f0fc8046f expref: 13 pid: 5839 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996147.801673:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000005d6f0066/0x4173739f0fc804a7 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996147.801690:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005d6f0066/0x4173739f0fc804a7 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789996147.801703:0:5831:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001575965s 00010000:00010000:0.0:1789996147.801708:0:5831:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000005d6f0066/0x4173739f0fc804a7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996147.801714:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000005d6f0066/0x4173739f0fc804a7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996147.801720:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000005d6f0066/0x4173739f0fc804a7 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996147.801725:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000005d6f0066/0x4173739f0fc804a7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996147.801730:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000005d6f0066 already unused, calling callback (000000000624dc3f) 00010000:00010000:0.0:1789996147.801733:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000005d6f0066/0x4173739f0fc804a7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996147.801740:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000005d6f0066/0x4173739f0fc804a7 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996147.801748:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000005d6f0066/0x4173739f0fc804a7 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996147.801758:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789996147.801786:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000da929b98 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+13:3314:x1876946942168064:12345-0@lo:103: Request processed in 152us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996147.801862:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789996147.802126:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008befb580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e0c28cd8-555e-481f-bd03-c3b02aee51c5:3314:1876946942168064:0@lo:103: 00010000:00010000:2.0:1789996147.802456:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000003c202ce6/0x4173739f0fc80476 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4173739f0fc8046f expref: 12 pid: 5839 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789996147.802468:0:5862:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004536c184 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5862:1876946942167936:0@lo:104: 00010000:00010000:2.0:1789996147.802482:0:5862:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000005d6f0066/0x4173739f0fc804a7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996147.802490:0:5862:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000005d6f0066/0x4173739f0fc804a7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996147.802495:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000005d6f0066/0x4173739f0fc804a7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996147.802501:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000005d6f0066/0x4173739f0fc804a7 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789996147.816898:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000006ac686e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0c28cd8-555e-481f-bd03-c3b02aee51c5+11:5827:x1876946942167808:12345-0@lo:253: Request processed in 76065us (76219us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996147.816915:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789996147.817133:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f1387029 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5827:1876946942167808:0@lo:253: 10000000:01000000:1.0:1789996147.817161:0:5827:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1789996147.817164:0:5827:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789996147.817166:0:5827:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789996147.817168:0:5827:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789996147.817169:0:5827:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789996147.817170:0:5827:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789996147.817171:0:5827:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789996147.817173:0:5827:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789996147.817174:0:5827:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789996147.817176:0:5827:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789996147.817177:0:5827:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789996147.817179:0:5827:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789996147.817180:0:5827:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1789996147.817387:0:5827:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1789996147.828242:0:5827:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:0.0:1789996147.829370:0:5827:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1789996147.829642:0:5827:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:0.0:1789996147.829816:0:5827:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1789996147.830261:0:5827:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:0.0:1789996147.830430:0:5827:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:0.0:1789996147.833656:0:5827:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:0.0:1789996147.833871:0:5827:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:0.0:1789996147.835085:0:5827:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:0.0:1789996147.835344:0:5827:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:0.0:1789996147.835649:0:5827:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:0.0:1789996147.835826:0:5827:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:3.0:1789996147.877634:0:5827:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:3.0:1789996147.906615:0:5827:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1789996147.906615:0:5879:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:1.0:1789996147.906622:0:5879:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:3.0:1789996147.907580:0:5880:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1789996147.913624:0:5827:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1789996147.914434:0:5827:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1789996147.914885:0:5827:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1789996147.914894:0:5827:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1789996147.915051:0:5827:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789996147.916015:0:5827:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1789996147.916590:0:5827:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1789996147.916637:0:5827:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:1.0:1789996147.916902:0:5827:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:1.0:1789996147.917224:0:5827:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:1.0:1789996147.918663:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:1.0:1789996147.918889:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:1.0:1789996147.919086:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:1.0:1789996147.919318:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:1.0:1789996147.919487:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:1.0:1789996147.919681:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:1.0:1789996147.919849:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:1.0:1789996147.920047:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:1.0:1789996147.920283:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:1.0:1789996147.920431:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:1.0:1789996147.920677:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:1.0:1789996147.920857:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:1.0:1789996147.921061:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:1.0:1789996147.921265:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:1.0:1789996147.921485:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:1.0:1789996147.921710:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:1.0:1789996147.922088:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:1.0:1789996147.922362:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:1.0:1789996147.922694:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:1.0:1789996147.922996:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:1.0:1789996147.923186:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:1.0:1789996147.923404:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:1.0:1789996147.923670:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:1.0:1789996147.923904:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:1.0:1789996147.924183:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:1.0:1789996147.924447:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:1.0:1789996147.924727:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:1.0:1789996147.924964:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:1.0:1789996147.925153:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:1.0:1789996147.925427:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:1.0:1789996147.925734:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:1.0:1789996147.926045:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:1.0:1789996147.926356:0:5827:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:2.0:1789996147.933233:0:5880:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:2.0:1789996147.977263:0:5827:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1789996147.977310:0:5827:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa9e8c1c83988 00100000:10000000:2.0:1789996147.977318:0:5827:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1789996147.978880:0:5827:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789996147.978892:0:5827:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.137@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789996147.978902:0:5827:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1789996147.978924:0:5827:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:2.0:1789996148.009350:0:5880:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1789996148.009430:0:5880:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 1, retries 0 00000004:00080000:2.0:1789996148.009435:0:5880:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:1.0:1789996148.073835:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789996149.096847:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789996150.125120:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789996151.146967:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789996151.747387:0:6123:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg437-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1789996152.168775:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789996152.814733:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1789996152.814741:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1789996152.814744:0:37:0:(import.c:65:import_set_state_nolock()) 00000000a7febdfb lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789996152.814761:0:37:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000a7febdfb using connection 192.168.204.137@tcp/0@lo 00000100:00100000:1.0:1789996152.814791:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000afade824 x1876946942168320/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789996152.814825:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000afade824 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876946942168320:0@lo:38: 00000100:00100000:1.0:1789996152.815071:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996152.815314:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942168320 00000100:00100000:2.0:1789996152.815324:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942168320 00000100:00100000:2.0:1789996152.815364:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789996152.815370:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000007373cd4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3312:x1876946942168320:12345-0@lo:38: 00010000:00080000:2.0:1789996152.815521:0:5848:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 194 last 0 00000020:00000080:2.0:1789996152.815592:0:5848:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x4173739f0fc804ae 00000004:00100000:2.0:1789996152.815650:0:5848:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789996152.815764:0:5848:0:(import.c:65:import_set_state_nolock()) 0000000092413deb : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789996152.816201:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000007373cd4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876946942168320:12345-0@lo:38: Request processed in 828us (1130us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996152.816210:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789996152.816303:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000afade824 x1876946942168320/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789996162 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789996152.816318:0:3312:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1789996152.816325:0:3312:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1789996152.816329:0:3312:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789996152.816331:0:3312:0:(import.c:65:import_set_state_nolock()) 00000000a7febdfb lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789996152.816335:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000afade824 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876946942168320:0@lo:38: 00000100:00100000:3.0:1789996152.816522:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f1387029 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e0c28cd8-555e-481f-bd03-c3b02aee51c5:3315:1876946942168192:0@lo:400: 00000100:00100000:3.0:1789996152.816582:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996152.816749:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942168192 00000100:00100000:2.0:1789996152.816755:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942168192 00000100:00100000:2.0:1789996152.816815:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789996152.816822:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000057e12389 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0c28cd8-555e-481f-bd03-c3b02aee51c5+11:3315:x1876946942168192:12345-0@lo:400: 00000100:00100000:2.0:1789996152.816875:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000057e12389 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0c28cd8-555e-481f-bd03-c3b02aee51c5+11:3315:x1876946942168192:12345-0@lo:400: Request processed in 54us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996152.816881:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789996152.816937:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f1387029 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e0c28cd8-555e-481f-bd03-c3b02aee51c5:3315:1876946942168192:0@lo:400: 00010000:00010000:0.0:1789996153.194399:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789996154.216719:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789996154.349815:0:5843:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789996154.349825:0:5843:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8e08709bf800 from 3 10000000:01000000:0.0:1789996154.349830:0:5843:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789996154.349882:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.137@tcp lock: 00000000d785f2bd/0x4173739f0fc804b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996154.349894:0:5843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.137@tcp lock: 00000000d785f2bd/0x4173739f0fc804b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996154.349907:0:5843:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.137@tcp lock: 00000000d785f2bd/0x4173739f0fc804b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789996154.349931:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008befb580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5843:1876946942168448:0@lo:101: 00000100:00100000:0.0:1789996154.350047:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996154.350121:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set 000000000e7e71e4 going to sleep for 11 seconds 00000100:00100000:3.0:1789996154.351404:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942168448 00000100:00100000:3.0:1789996154.351418:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942168448 00000100:00100000:3.0:1789996154.351484:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789996154.351493:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b9fe713a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0c28cd8-555e-481f-bd03-c3b02aee51c5+11:5843:x1876946942168448:12345-0@lo:101: 00010000:00010000:3.0:1789996154.351507:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789996154.351524:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000004df7f958/0x4173739f0fc804bc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4173739f0fc804b5 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996154.351591:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004df7f958/0x4173739f0fc804bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4173739f0fc804b5 expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996154.351621:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000004df7f958/0x4173739f0fc804bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4173739f0fc804b5 expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996154.351630:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000004df7f958, rc 0) 00000100:00100000:3.0:1789996154.351698:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b9fe713a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0c28cd8-555e-481f-bd03-c3b02aee51c5+12:5843:x1876946942168448:12345-0@lo:101: Request processed in 207us (1652us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996154.351705:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789996154.352631:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008befb580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5843:1876946942168448:0@lo:101: 00010000:00010000:2.0:1789996154.352652:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.137@tcp lock: 00000000d785f2bd/0x4173739f0fc804b5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc804bc expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996154.352661:0:5843:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.137@tcp lock: 00000000d785f2bd/0x4173739f0fc804b5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4173739f0fc804bc expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789996154.352732:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001220d094 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5843:1876946942168576:0@lo:256: 00000100:00100000:2.0:1789996154.352774:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996154.352814:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set 000000001f5ddf4f going to sleep for 11 seconds 00000100:00100000:0.0:1789996154.352946:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942168576 00000100:00100000:0.0:1789996154.352952:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942168576 00000100:00100000:0.0:1789996154.353006:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789996154.353024:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000007f32b1cd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+12:5843:x1876946942168576:12345-0@lo:256: 20000000:01000000:0.0:1789996154.353040:0:5839:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789996154.353067:0:5839:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789996154.353070:0:5839:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:0.0:1789996154.353153:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000007f32b1cd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+12:5843:x1876946942168576:12345-0@lo:256: Request processed in 131us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996154.353160:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789996154.353632:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001220d094 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5843:1876946942168576:0@lo:256: 10000000:01000000:2.0:1789996154.353672:0:5843:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.137@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789996154.353678:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.137@tcp lock: 00000000d785f2bd/0x4173739f0fc804b5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc804bc expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996154.353687:0:5843:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.137@tcp lock: 00000000d785f2bd/0x4173739f0fc804b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc804bc expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996155.241745:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789996156.275356:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789996157.068347:0:6324:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe10a90760 20000000:00000080:2.0:1789996157.068371:0:6324:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8e0880aad400 uarg=0000000000000000 20000000:01000000:2.0:1789996157.068409:0:6324:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1789996157.068415:0:6324:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1789996157.068774:0:6324:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1789996157.069390:0:6324:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:2.0:1789996157.069404:0:6324:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:2.0:1789996157.077254:0:6324:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789996157.077505:0:6324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1789996157.077610:0:6324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:2.0:1789996157.077662:0:6324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:2.0:1789996157.077681:0:6324:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1789996157.077698:0:6324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000d6af5220/0x4173739f0fc804c3 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996157.077717:0:6324:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000067f10cfd/0x4173739f0fc80484 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4173739f0fc8047d expref: 11 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996157.077734:0:6324:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000d6af5220/0x4173739f0fc804c3 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996157.077771:0:6324:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000067f10cfd/0x4173739f0fc80484 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4173739f0fc8047d expref: 11 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996157.077784:0:6324:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000067f10cfd/0x4173739f0fc80484 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4173739f0fc8047d expref: 11 pid: 5840 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789996157.077797:0:6324:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001220d094 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6324:1876946942168704:0@lo:104: 00000100:00100000:2.0:1789996157.077858:0:6324:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996157.077906:0:6324:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c1911697 going to sleep for 11 seconds 00000100:00100000:3.0:1789996157.079149:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942168704 00000100:00100000:3.0:1789996157.079159:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942168704 00000100:00100000:3.0:1789996157.079223:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789996157.079233:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000003a38184c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e0c28cd8-555e-481f-bd03-c3b02aee51c5+3:6324:x1876946942168704:12345-0@lo:104: 00010000:00010000:3.0:1789996157.079247:0:5830:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.137@tcp lock: 0000000092ef4a07/0x4173739f0fc8047d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4173739f0fc80484 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996157.079335:0:5830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789996157.079340:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000003a38184c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e0c28cd8-555e-481f-bd03-c3b02aee51c5+3:6324:x1876946942168704:12345-0@lo:104: Request processed in 109us (1483us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996157.079348:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:3.0:1789996157.079371:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789996157.079376:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.137@tcp lock: 0000000092ef4a07/0x4173739f0fc8047d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4173739f0fc80484 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996157.079384:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000092ef4a07 already unused, calling callback (00000000a84157b1) 10000000:00010000:3.0:1789996157.079388:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.137@tcp lock: 0000000092ef4a07/0x4173739f0fc8047d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4173739f0fc80484 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996157.079396:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.137@tcp lock: 0000000092ef4a07/0x4173739f0fc8047d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4173739f0fc80484 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789996157.079417:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.137@tcp lock: 0000000092ef4a07/0x4173739f0fc8047d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4173739f0fc80484 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789996157.079423:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789996157.079459:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.137@tcp lock: 0000000092ef4a07/0x4173739f0fc8047d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4173739f0fc80484 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996157.079467:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789996157.079483:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.137@tcp lock: 0000000092ef4a07/0x4173739f0fc8047d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4173739f0fc80484 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996157.079489:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.137@tcp lock: 0000000092ef4a07/0x4173739f0fc8047d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4173739f0fc80484 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996157.079507:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789996157.079508:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789996157.079510:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789996157.079534:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003bbd59bd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e0c28cd8-555e-481f-bd03-c3b02aee51c5:3316:1876946942168832:0@lo:103: 00000100:00100000:1.0:1789996157.079953:0:6324:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001220d094 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6324:1876946942168704:0@lo:104: 00010000:00010000:1.0:1789996157.079982:0:6324:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000d6af5220/0x4173739f0fc804c3 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789996157.080132:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996157.080272:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942168832 00000100:00100000:0.0:1789996157.080278:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942168832 00010000:00010000:0.0:1789996157.080302:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000067f10cfd/0x4173739f0fc80484 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4173739f0fc8047d expref: 12 pid: 5840 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789996157.080333:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789996157.080340:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000005357a14a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+12:3316:x1876946942168832:12345-0@lo:103: 00010000:00010000:0.0:1789996157.080351:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789996157.080355:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000067f10cfd/0x4173739f0fc80484 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4173739f0fc8047d expref: 12 pid: 5840 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996157.080364:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000067f10cfd/0x4173739f0fc80484 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4173739f0fc8047d expref: 12 pid: 5840 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996157.080377:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000067f10cfd/0x4173739f0fc80484 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4173739f0fc8047d expref: 12 pid: 5840 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996157.080392:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000d6af5220/0x4173739f0fc804c3 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996157.080407:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d6af5220/0x4173739f0fc804c3 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996157.080423:0:5831:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000d6af5220/0x4173739f0fc804c3 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996157.080430:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000d6af5220/0x4173739f0fc804c3 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996157.080436:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000d6af5220/0x4173739f0fc804c3 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996157.080441:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000d6af5220/0x4173739f0fc804c3 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996157.080446:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000d6af5220 already unused, calling callback (000000000624dc3f) 00010000:00010000:0.0:1789996157.080449:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000d6af5220/0x4173739f0fc804c3 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996157.080456:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000d6af5220/0x4173739f0fc804c3 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996157.080480:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000d6af5220/0x4173739f0fc804c3 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996157.080489:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789996157.080525:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000005357a14a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+11:3316:x1876946942168832:12345-0@lo:103: Request processed in 186us (941us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996157.080531:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789996157.080582:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003bbd59bd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e0c28cd8-555e-481f-bd03-c3b02aee51c5:3316:1876946942168832:0@lo:103: 00010000:00010000:3.0:1789996157.086196:0:6324:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000d6af5220/0x4173739f0fc804c3 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996157.086219:0:6324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000d6af5220/0x4173739f0fc804c3 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996157.086226:0:6324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000d6af5220/0x4173739f0fc804c3 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996157.288649:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789996157.928784:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789996157.930125:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000afade824 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876946942169088:0@lo:400: 00000100:00100000:2.0:1789996157.930209:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996157.930286:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f1387029 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e0c28cd8-555e-481f-bd03-c3b02aee51c5:3314:1876946942168960:0@lo:400: 00000100:00100000:2.0:1789996157.930317:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996157.930349:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942169088 00000100:00100000:0.0:1789996157.930358:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942169088 00000100:00100000:0.0:1789996157.930414:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789996157.930424:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000001abb8e12 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876946942169088:12345-0@lo:400: 00000100:00100000:0.0:1789996157.930476:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000001abb8e12 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876946942169088:12345-0@lo:400: Request processed in 53us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996157.930482:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1789996157.930582:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000afade824 x1876946942169088/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789996173 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789996157.930596:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000afade824 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876946942169088:0@lo:400: 00000100:00100000:3.0:1789996157.932086:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942168960 00000100:00100000:3.0:1789996157.932121:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942168960 00000100:00100000:3.0:1789996157.932180:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789996157.932188:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000af69e3ef pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+11:3314:x1876946942168960:12345-0@lo:400: 00000100:00100000:3.0:1789996157.932263:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000af69e3ef pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+11:3314:x1876946942168960:12345-0@lo:400: Request processed in 76us (1945us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996157.932270:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789996157.932375:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f1387029 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e0c28cd8-555e-481f-bd03-c3b02aee51c5:3314:1876946942168960:0@lo:400: 00010000:00010000:3.0:1789996158.312978:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789996159.336933:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789996160.368694:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789996161.388291:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789996162.415949:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789996163.052467:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000031767f3f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3316:1876946942169344:0@lo:400: 00000100:00100000:2.0:1789996163.052536:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996163.052606:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789996163.052612:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f500c60d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e0c28cd8-555e-481f-bd03-c3b02aee51c5:3316:1876946942169216:0@lo:400: 00000100:00100000:2.0:1789996163.052651:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996163.052692:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942169344 00000100:00100000:2.0:1789996163.052701:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942169344 00000100:00100000:2.0:1789996163.052746:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789996163.052753:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000eb7ee952 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1876946942169344:12345-0@lo:400: 00000100:00100000:2.0:1789996163.052802:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000eb7ee952 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1876946942169344:12345-0@lo:400: Request processed in 49us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996163.052809:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1789996163.052864:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000031767f3f x1876946942169344/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789996179 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789996163.052879:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000031767f3f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3316:1876946942169344:0@lo:400: 00000100:00100000:3.0:1789996163.053020:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942169216 00000100:00100000:3.0:1789996163.053026:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942169216 00000100:00100000:3.0:1789996163.053265:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789996163.053273:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000edb8d009 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0c28cd8-555e-481f-bd03-c3b02aee51c5+11:3316:x1876946942169216:12345-0@lo:400: 00000100:00100000:3.0:1789996163.053323:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000edb8d009 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0c28cd8-555e-481f-bd03-c3b02aee51c5+11:3316:x1876946942169216:12345-0@lo:400: Request processed in 52us (672us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996163.053330:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789996163.054909:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f500c60d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e0c28cd8-555e-481f-bd03-c3b02aee51c5:3316:1876946942169216:0@lo:400: 00010000:00010000:1.0:1789996163.435920:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789996164.457016:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789996164.587202:0:5843:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789996164.587210:0:5843:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e08709bf800 from 1 10000000:01000000:2.0:1789996164.587215:0:5843:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789996164.587254:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.137@tcp lock: 000000003c202ce6/0x4173739f0fc804ca lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996164.587267:0:5843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.137@tcp lock: 000000003c202ce6/0x4173739f0fc804ca lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996164.587278:0:5843:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.137@tcp lock: 000000003c202ce6/0x4173739f0fc804ca lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789996164.587299:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f500c60d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5843:1876946942169472:0@lo:101: 00000100:00100000:2.0:1789996164.587363:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996164.587429:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b37bce1f going to sleep for 11 seconds 00000100:00100000:3.0:1789996164.587456:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942169472 00000100:00100000:3.0:1789996164.587466:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942169472 00000100:00100000:3.0:1789996164.587523:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789996164.587532:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000004aed1566 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0c28cd8-555e-481f-bd03-c3b02aee51c5+11:5843:x1876946942169472:12345-0@lo:101: 00010000:00010000:3.0:1789996164.587567:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789996164.587580:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000048efa3e4/0x4173739f0fc804d1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4173739f0fc804ca expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996164.587603:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000048efa3e4/0x4173739f0fc804d1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4173739f0fc804ca expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996164.587613:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000048efa3e4/0x4173739f0fc804d1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4173739f0fc804ca expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996164.587621:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000048efa3e4, rc 0) 00000100:00100000:3.0:1789996164.587691:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000004aed1566 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0c28cd8-555e-481f-bd03-c3b02aee51c5+12:5843:x1876946942169472:12345-0@lo:101: Request processed in 161us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996164.587698:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789996164.587894:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f500c60d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5843:1876946942169472:0@lo:101: 00010000:00010000:2.0:1789996164.587909:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.137@tcp lock: 000000003c202ce6/0x4173739f0fc804ca lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc804d1 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996164.587917:0:5843:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.137@tcp lock: 000000003c202ce6/0x4173739f0fc804ca lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4173739f0fc804d1 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789996164.587971:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f500c60d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5843:1876946942169600:0@lo:501: 00000100:00100000:2.0:1789996164.587998:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996164.588019:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b37bce1f going to sleep for 11 seconds 00000100:00100000:3.0:1789996164.588230:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942169600 00000100:00100000:3.0:1789996164.588235:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942169600 00000100:00100000:3.0:1789996164.588269:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789996164.588277:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b22a1811 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0c28cd8-555e-481f-bd03-c3b02aee51c5+12:5843:x1876946942169600:12345-0@lo:501: 00000100:00100000:3.0:1789996164.588621:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b22a1811 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0c28cd8-555e-481f-bd03-c3b02aee51c5+12:5843:x1876946942169600:12345-0@lo:501: Request processed in 344us (622us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996164.588628:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789996164.588661:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f500c60d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5843:1876946942169600:0@lo:501: 00000100:00100000:3.0:1789996164.588690:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ee8d8a89 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5843:1876946942169728:0@lo:503: 00000100:00100000:3.0:1789996164.588727:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789996164.588748:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f4a85a57 going to sleep for 11 seconds 00000100:00100000:3.0:1789996164.588760:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942169728 00000100:00100000:3.0:1789996164.588764:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942169728 00000100:00100000:3.0:1789996164.588786:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789996164.588792:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000290f4132 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0c28cd8-555e-481f-bd03-c3b02aee51c5+12:5843:x1876946942169728:12345-0@lo:503: 00000100:00100000:3.0:1789996164.589462:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000290f4132 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0c28cd8-555e-481f-bd03-c3b02aee51c5+12:5843:x1876946942169728:12345-0@lo:503: Request processed in 668us (732us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996164.589470:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789996164.590156:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ee8d8a89 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5843:1876946942169728:0@lo:503: 00000100:00100000:1.0:1789996164.597304:0:6685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004bbaef70 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0c28cd8-555e-481f-bd03-c3b02aee51c5:6685:1876946942169856:0@lo:502: 00000100:00100000:1.0:1789996164.597395:0:6685:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996164.597436:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942169856 00000100:00100000:1.0:1789996164.597443:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942169856 00000100:00100000:1.0:1789996164.597483:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789996164.597490:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000018f9064e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+12:6685:x1876946942169856:12345-0@lo:502: 00000100:00100000:1.0:1789996164.598933:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000018f9064e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+12:6685:x1876946942169856:12345-0@lo:502: Request processed in 1439us (1534us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996164.598944:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789996164.599028:0:6685:0:(client.c:2716:ptlrpc_set_wait()) set 0000000087c19f07 going to sleep for 11 seconds 00000100:00100000:1.0:1789996164.599052:0:6685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004bbaef70 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0c28cd8-555e-481f-bd03-c3b02aee51c5:6685:1876946942169856:0@lo:502: 00000020:01000000:1.0:1789996164.599084:0:6685:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789996164.599094:0:6685:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789996164.599096:0:6685:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789996164.599102:0:6685:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e08709bf800 00000020:00000080:1.0:1789996164.599104:0:6685:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789996164.599170:0:6685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0849c74e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0c28cd8-555e-481f-bd03-c3b02aee51c5:6685:1876946942169984:0@lo:502: 00000100:00100000:1.0:1789996164.599210:0:6685:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996164.599245:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942169984 00000100:00100000:1.0:1789996164.599252:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942169984 00000100:00100000:1.0:1789996164.599281:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789996164.599287:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852ba1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0c28cd8-555e-481f-bd03-c3b02aee51c5+12:6685:x1876946942169984:12345-0@lo:502: 00000100:00100000:1.0:1789996164.599434:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852ba1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0c28cd8-555e-481f-bd03-c3b02aee51c5+12:6685:x1876946942169984:12345-0@lo:502: Request processed in 146us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996164.599441:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789996164.599470:0:6685:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e087056c480 going to sleep for 11 seconds 00000100:00100000:1.0:1789996164.599482:0:6685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0849c74e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0c28cd8-555e-481f-bd03-c3b02aee51c5:6685:1876946942169984:0@lo:502: 00000020:01000000:1.0:1789996164.599499:0:6685:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789996164.599503:0:6685:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789996164.599505:0:6685:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1789996164.599508:0:6685:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:1.0:1789996164.599594:0:5843:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1789996164.599615:0:5843:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.137@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789996164.599624:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.137@tcp lock: ffff8e0841524400/0x4173739f0fc804ca lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc804d1 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996164.599637:0:5843:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.137@tcp lock: ffff8e0841524400/0x4173739f0fc804ca lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc804d1 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1789996165.167622:0:6683:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1789996165.167626:0:6683:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:1.0:1789996165.167778:0:6683:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8e0849c2f000 00000020:01000004:1.0:1789996165.167793:0:6683:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1789996165.168822:0:6683:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1789996165.168837:0:6683:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8e0849c78000) 00000020:00000080:1.0:1789996165.168946:0:6683:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1789996165.216448:0:6683:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:0.0:1789996165.217448:0:6683:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1789996165.269189:0:6683:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1789996165.284861:0:6683:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1789996165.284892:0:6683:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1789996165.284943:0:6683:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1789996165.284966:0:6683:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1789996165.285263:0:6683:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1789996165.285272:0:6683:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789996165.285282:0:6683:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x4173739f0fc804df 00000020:01000004:2.0:1789996165.285289:0:6683:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1789996165.285306:0:6683:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.137@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1789996165.285310:0:6683:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.137@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1789996165.285314:0:6683:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1789996165.285318:0:6683:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1789996165.285329:0:6683:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8e0876658000) 00000020:00000080:2.0:1789996165.290148:0:6683:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:2.0:1789996165.297232:0:6683:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789996165.297419:0:6683:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1789996165.297426:0:6683:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1789996165.305442:0:6683:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1789996165.305453:0:6683:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1789996165.307355:0:6683:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1789996165.307376:0:6683:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1789996165.309289:0:6683:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789996165.309469:0:6683:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1789996165.309475:0:6683:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1789996165.319217:0:6683:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1789996165.319329:0:6683:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1789996165.367984:0:6683:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789996165.375240:0:6683:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1789996165.375248:0:6683:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1789996165.389837:0:6683:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1789996165.389860:0:6683:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1789996165.396900:0:6683:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1789996165.396917:0:6683:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1789996165.414123:0:6683:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789996165.414335:0:6683:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1789996165.414341:0:6683:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1789996165.415468:0:6683:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1789996165.415478:0:6683:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00010000:00010000:1.0:1789996165.482822:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789996165.520092:0:6683:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789996165.521362:0:6683:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1789996165.521370:0:6683:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1789996165.527339:0:6683:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1789996165.527358:0:6683:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1789996165.533472:0:6683:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1789996165.533502:0:6683:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:3.0:1789996165.533510:0:6683:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.137@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1789996165.603110:0:6683:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.137@tcp ctxt 0 is initialized 00000020:01000004:3.0:1789996165.603177:0:6683:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.137@tcp, index=0000, flags=0x20062 00000020:01000004:3.0:1789996165.603186:0:6683:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1789996165.603188:0:6683:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789996165.603189:0:6683:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789996165.603190:0:6683:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789996165.603192:0:6683:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789996165.603193:0:6683:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789996165.603194:0:6683:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789996165.603196:0:6683:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789996165.603197:0:6683:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789996165.603198:0:6683:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789996165.603200:0:6683:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789996165.604418:0:6683:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:3.0:1789996165.604423:0:6683:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789996165.604425:0:6683:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789996165.604426:0:6683:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789996165.604427:0:6683:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789996165.604428:0:6683:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789996165.604430:0:6683:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789996165.604431:0:6683:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789996165.604432:0:6683:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789996165.604433:0:6683:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789996165.604435:0:6683:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789996165.604436:0:6683:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789996165.604732:0:6683:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1789996165.604752:0:6683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fa71500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0c28cd8-555e-481f-bd03-c3b02aee51c5:6683:1876946942170112:0@lo:253: 00000100:00100000:3.0:1789996165.605028:0:6683:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789996165.605083:0:6683:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e08454d0b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789996165.605246:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942170112 00000100:00100000:1.0:1789996165.605256:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942170112 00000100:00100000:1.0:1789996165.605317:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789996165.605326:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852ba0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0c28cd8-555e-481f-bd03-c3b02aee51c5+12:6683:x1876946942170112:12345-0@lo:253: 20000000:01000000:1.0:1789996165.605373:0:5841:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1789996165.605378:0:5841:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:1.0:1789996165.605383:0:5841:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:1.0:1789996165.605385:0:5841:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:1.0:1789996165.606493:0:5841:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789996165.614679:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:1.0:1789996165.614711:0:5841:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:1.0:1789996165.614781:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:1.0:1789996165.614803:0:5841:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:1.0:1789996165.614932:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:1.0:1789996165.614989:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:1.0:1789996165.615641:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:1.0:1789996165.615663:0:5841:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.137@tcp 20000000:01000000:1.0:1789996165.615665:0:5841:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.137@tcp (null) (null) (null) 00000040:00080000:1.0:1789996165.615701:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:1.0:1789996165.615709:0:5841:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1789996165.615755:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:1.0:1789996165.615764:0:5841:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.204.137@tcp (null) (null) 00000040:00080000:1.0:1789996165.615809:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:1.0:1789996165.615820:0:5841:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1789996165.615965:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:1.0:1789996165.616022:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:1.0:1789996165.618898:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:1.0:1789996165.618948:0:5841:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.137@tcp 20000000:01000000:1.0:1789996165.618951:0:5841:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.137@tcp (null) (null) (null) 00000040:00080000:1.0:1789996165.619009:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:1.0:1789996165.619018:0:5841:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1789996165.619070:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:1.0:1789996165.619079:0:5841:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.204.137@tcp (null) (null) 00000040:00080000:1.0:1789996165.619158:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:1.0:1789996165.619169:0:5841:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1789996165.619222:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:1.0:1789996165.619282:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:1.0:1789996165.619310:0:5841:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:1.0:1789996165.619336:0:5841:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:1.0:1789996165.619343:0:5841:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:1.0:1789996165.619345:0:5841:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1789996165.619347:0:5841:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1789996165.619712:0:5841:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1789996165.619715:0:5841:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1789996165.620264:0:5841:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1789996165.620268:0:5841:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1789996165.620894:0:6700:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:2.0:1789996165.621402:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:2.0:1789996165.621445:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:2.0:1789996165.621515:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:2.0:1789996165.621529:0:5841:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1789996165.621530:0:5841:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1789996165.624014:0:6701:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:2.0:1789996165.624101:0:6701:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:2.0:1789996165.624151:0:6701:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:0.0:1789996165.624643:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:0.0:1789996165.624689:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:0.0:1789996165.624744:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:0.0:1789996165.624760:0:5841:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1789996165.624763:0:5841:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1789996165.626663:0:6702:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 13 marker 10 1->4: lustre sys.timeout 20000000:01000000:0.0:1789996165.626746:0:6702:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 15 marker 10 2->4: lustre sys.timeout 00000040:00080000:0.0:1789996165.626816:0:6702:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:2.0:1789996165.634083:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:2.0:1789996165.634151:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:2.0:1789996165.634266:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 10000000:01000000:2.0:1789996165.634290:0:5841:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1789996165.634310:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e0841524800/0x4173739f0fc804ed lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996165.634330:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e08429c7c00/0x4173739f0fc80406 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4173739f0fc803ff expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996165.634338:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e08413f1600/0x4173739f0fc80422 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4173739f0fc8041b expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996165.634352:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e08429c7600/0x4173739f0fc80492 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4173739f0fc8048b expref: 12 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996165.634359:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8e0841524800/0x4173739f0fc804ed lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996165.634398:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e08429c7600/0x4173739f0fc80492 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4173739f0fc8048b expref: 12 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996165.634416:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e08429c7600/0x4173739f0fc80492 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4173739f0fc8048b expref: 12 pid: 5841 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789996165.634429:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fa93b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5841:1876946942170240:0@lo:104: 00000100:00100000:2.0:1789996165.634490:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789996165.634932:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e08413f1600/0x4173739f0fc80422 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4173739f0fc8041b expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996165.634941:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e08413f1600/0x4173739f0fc80422 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4173739f0fc8041b expref: 12 pid: 5840 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789996165.634950:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fa91180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5841:1876946942170368:0@lo:104: 00000100:00100000:2.0:1789996165.634976:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996165.635051:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942170240 00000100:00100000:0.0:1789996165.635066:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942170240 00000100:00100000:3.0:1789996165.635281:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942170368 00000100:00100000:3.0:1789996165.635286:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942170368 00010000:00010000:2.0:1789996165.635335:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e08429c7c00/0x4173739f0fc80406 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4173739f0fc803ff expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996165.635344:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e08429c7c00/0x4173739f0fc80406 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4173739f0fc803ff expref: 12 pid: 5839 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789996165.635354:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fa91500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5841:1876946942170496:0@lo:104: 00000100:00100000:2.0:1789996165.635383:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996165.635394:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0852b61e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789996165.635478:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942170496 00000100:00100000:0.0:1789996165.635482:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942170496 00000100:00100000:3.0:1789996165.635537:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789996165.635875:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fa92a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e0c28cd8-555e-481f-bd03-c3b02aee51c5+5:5841:x1876946942170240:12345-0@lo:104: 00010000:00010000:3.0:1789996165.635888:0:5830:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.137@tcp lock: ffff8e08429c6200/0x4173739f0fc8048b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4173739f0fc80492 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996165.635990:0:5830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789996165.635997:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fa92a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e0c28cd8-555e-481f-bd03-c3b02aee51c5+5:5841:x1876946942170240:12345-0@lo:104: Request processed in 126us (1507us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996165.636011:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789996165.636031:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789996165.636036:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fa93480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e0c28cd8-555e-481f-bd03-c3b02aee51c5+4:5841:x1876946942170368:12345-0@lo:104: 00010000:00010000:3.0:1789996165.636044:0:5830:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.137@tcp lock: ffff8e0840031200/0x4173739f0fc8041b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4173739f0fc80422 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996165.636073:0:5830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789996165.636078:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fa93480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e0c28cd8-555e-481f-bd03-c3b02aee51c5+4:5841:x1876946942170368:12345-0@lo:104: Request processed in 42us (1102us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996165.636083:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:1.0:1789996165.636212:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789996165.636219:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.137@tcp lock: ffff8e08429c6200/0x4173739f0fc8048b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4173739f0fc80492 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996165.636227:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e08429c6200 already unused, calling callback (ffffffffc1be0c20) 10000000:00010000:1.0:1789996165.636232:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.137@tcp lock: ffff8e08429c6200/0x4173739f0fc8048b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x4173739f0fc80492 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996165.636239:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.137@tcp lock: ffff8e08429c6200/0x4173739f0fc8048b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x4173739f0fc80492 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789996165.636246:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.137@tcp lock: ffff8e08429c6200/0x4173739f0fc8048b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x4173739f0fc80492 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789996165.636252:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789996165.636295:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.137@tcp lock: ffff8e08429c6200/0x4173739f0fc8048b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4173739f0fc80492 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996165.636301:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789996165.636321:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.137@tcp lock: ffff8e08429c6200/0x4173739f0fc8048b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4173739f0fc80492 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996165.636327:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.137@tcp lock: ffff8e08429c6200/0x4173739f0fc8048b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4173739f0fc80492 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996165.636340:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789996165.636343:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.137@tcp lock: ffff8e0840031200/0x4173739f0fc8041b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4173739f0fc80422 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996165.636359:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0840031200 already unused, calling callback (ffffffffc1be0c20) 10000000:00010000:1.0:1789996165.636362:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.137@tcp lock: ffff8e0840031200/0x4173739f0fc8041b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x4173739f0fc80422 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996165.636369:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.137@tcp lock: ffff8e0840031200/0x4173739f0fc8041b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x4173739f0fc80422 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789996165.636375:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.137@tcp lock: ffff8e0840031200/0x4173739f0fc8041b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x4173739f0fc80422 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789996165.636379:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789996165.636406:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.137@tcp lock: ffff8e0840031200/0x4173739f0fc8041b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4173739f0fc80422 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996165.636412:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789996165.636420:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.137@tcp lock: ffff8e0840031200/0x4173739f0fc8041b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4173739f0fc80422 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996165.636436:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.137@tcp lock: ffff8e0840031200/0x4173739f0fc8041b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4173739f0fc80422 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996165.636446:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789996165.636448:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789996165.636450:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789996165.636463:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0849c74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e0c28cd8-555e-481f-bd03-c3b02aee51c5:3313:1876946942170624:0@lo:103: 00000100:00100000:1.0:1789996165.636504:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996165.636694:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789996165.636702:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0849c74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e0c28cd8-555e-481f-bd03-c3b02aee51c5:3313:1876946942170752:0@lo:103: 00000100:00100000:1.0:1789996165.636734:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996165.636772:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942170624 00000100:00100000:1.0:1789996165.636777:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942170624 00010000:00010000:1.0:1789996165.636809:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e08429c7600/0x4173739f0fc80492 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4173739f0fc8048b expref: 13 pid: 5841 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789996165.636829:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942170752 00000100:00100000:1.0:1789996165.636831:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942170752 00010000:00010000:1.0:1789996165.636992:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e08413f1600/0x4173739f0fc80422 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4173739f0fc8041b expref: 14 pid: 5840 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789996165.637008:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789996165.637015:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0849c76680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+14:3313:x1876946942170624:12345-0@lo:103: 00010000:00010000:1.0:1789996165.637025:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789996165.637030:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e08429c7600/0x4173739f0fc80492 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4173739f0fc8048b expref: 14 pid: 5841 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996165.637040:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e08429c7600/0x4173739f0fc80492 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4173739f0fc8048b expref: 14 pid: 5841 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996165.637065:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789996165.637105:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0849c76680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+14:3313:x1876946942170624:12345-0@lo:103: Request processed in 91us (608us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996165.637111:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789996165.637125:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789996165.637131:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0849c75880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+13:3313:x1876946942170752:12345-0@lo:103: 00010000:00010000:1.0:1789996165.637138:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789996165.637143:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e08413f1600/0x4173739f0fc80422 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4173739f0fc8041b expref: 13 pid: 5840 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996165.637150:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e08413f1600/0x4173739f0fc80422 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4173739f0fc8041b expref: 13 pid: 5840 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996165.637159:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789996165.637178:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0849c75880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+13:3313:x1876946942170752:12345-0@lo:103: Request processed in 48us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996165.637184:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:1.0:1789996165.637204:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789996165.637290:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789996165.637298:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fa92d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e0c28cd8-555e-481f-bd03-c3b02aee51c5+3:5841:x1876946942170496:12345-0@lo:104: 00010000:00010000:3.0:1789996165.637309:0:5830:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.137@tcp lock: ffff8e08413f1800/0x4173739f0fc803ff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4173739f0fc80406 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996165.637350:0:5830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789996165.637355:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fa92d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e0c28cd8-555e-481f-bd03-c3b02aee51c5+3:5841:x1876946942170496:12345-0@lo:104: Request processed in 60us (1973us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996165.637360:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789996165.637437:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0849c74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e0c28cd8-555e-481f-bd03-c3b02aee51c5:3313:1876946942170752:0@lo:103: 00000100:00100000:0.0:1789996165.637447:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0849c74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e0c28cd8-555e-481f-bd03-c3b02aee51c5:3313:1876946942170624:0@lo:103: 00010000:00010000:1.0:1789996165.637495:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789996165.637500:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.137@tcp lock: ffff8e08413f1800/0x4173739f0fc803ff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4173739f0fc80406 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996165.637507:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e08413f1800 already unused, calling callback (ffffffffc1be0c20) 10000000:00010000:1.0:1789996165.637510:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.137@tcp lock: ffff8e08413f1800/0x4173739f0fc803ff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4173739f0fc80406 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996165.637517:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.137@tcp lock: ffff8e08413f1800/0x4173739f0fc803ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4173739f0fc80406 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789996165.637536:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.137@tcp lock: ffff8e08413f1800/0x4173739f0fc803ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4173739f0fc80406 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789996165.637862:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789996165.637887:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.137@tcp lock: ffff8e08413f1800/0x4173739f0fc803ff lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4173739f0fc80406 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996165.637893:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789996165.637918:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.137@tcp lock: ffff8e08413f1800/0x4173739f0fc803ff lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4173739f0fc80406 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996165.637925:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.137@tcp lock: ffff8e08413f1800/0x4173739f0fc803ff lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4173739f0fc80406 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996165.637937:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789996165.637939:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789996165.637941:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789996165.637947:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789996165.637958:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0849c74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e0c28cd8-555e-481f-bd03-c3b02aee51c5:3316:1876946942170880:0@lo:103: 00000100:00100000:1.0:1789996165.637992:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996165.638029:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942170880 00000100:00100000:1.0:1789996165.638034:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942170880 00010000:00010000:1.0:1789996165.638050:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e08429c7c00/0x4173739f0fc80406 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4173739f0fc803ff expref: 13 pid: 5839 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789996165.638068:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789996165.638075:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0849c76300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+13:3316:x1876946942170880:12345-0@lo:103: 00010000:00010000:1.0:1789996165.638082:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789996165.638086:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e08429c7c00/0x4173739f0fc80406 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4173739f0fc803ff expref: 13 pid: 5839 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996165.638101:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e08429c7c00/0x4173739f0fc80406 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4173739f0fc803ff expref: 13 pid: 5839 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996165.638114:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8e0841524800/0x4173739f0fc804ed lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996165.638122:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e0841524800/0x4173739f0fc804ed lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996165.638137:0:5831:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e0841524800/0x4173739f0fc804ed lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996165.638144:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e0841524800/0x4173739f0fc804ed lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996165.638151:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e0841524800/0x4173739f0fc804ed lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996165.638158:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e0841524800/0x4173739f0fc804ed lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996165.638163:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0841524800 already unused, calling callback (ffffffffc1595910) 00010000:00010000:1.0:1789996165.638167:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e0841524800/0x4173739f0fc804ed lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996165.638175:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e0841524800/0x4173739f0fc804ed lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996165.638183:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e0841524800/0x4173739f0fc804ed lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996165.638201:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789996165.638229:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0849c76300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+13:3316:x1876946942170880:12345-0@lo:103: Request processed in 155us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996165.638235:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789996165.638266:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0849c74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e0c28cd8-555e-481f-bd03-c3b02aee51c5:3316:1876946942170880:0@lo:103: 00010000:00010000:2.0:1789996165.638484:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e08429c7600/0x4173739f0fc80492 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4173739f0fc8048b expref: 12 pid: 5841 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789996165.638497:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fa93b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5841:1876946942170240:0@lo:104: 00010000:00010000:2.0:1789996165.638508:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e08413f1600/0x4173739f0fc80422 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4173739f0fc8041b expref: 11 pid: 5840 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789996165.638516:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fa91180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5841:1876946942170368:0@lo:104: 00010000:00010000:2.0:1789996165.638525:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e08429c7c00/0x4173739f0fc80406 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4173739f0fc803ff expref: 10 pid: 5839 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789996165.638533:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fa91500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5841:1876946942170496:0@lo:104: 00010000:00010000:2.0:1789996165.638591:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8e0841524800/0x4173739f0fc804ed lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996165.638600:0:5841:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8e0841524800/0x4173739f0fc804ed lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996165.638607:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e0841524800/0x4173739f0fc804ed lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996165.638613:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e0841524800/0x4173739f0fc804ed lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789996165.638625:0:5841:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1789996165.716132:0:6683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fa71500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0c28cd8-555e-481f-bd03-c3b02aee51c5:6683:1876946942170112:0@lo:253: 10000000:01000000:3.0:1789996165.716156:0:6683:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1789996165.716160:0:6683:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789996165.716161:0:6683:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789996165.716163:0:6683:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789996165.716164:0:6683:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:3.0:1789996165.716165:0:6683:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789996165.716166:0:6683:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789996165.716167:0:6683:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789996165.716184:0:6683:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1789996165.716186:0:6683:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789996165.716187:0:6683:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1789996165.716207:0:6683:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8e0849c2f000 from lustre-OST0000 10000000:01000000:3.0:1789996165.716238:0:6683:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1789996165.716241:0:6683:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1789996165.716248:0:6683:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8e08545d19c0 local copy 10000000:01000000:3.0:1789996165.716253:0:6683:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1789996165.716292:0:6683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.137@tcp lock: ffff8e08429c6600/0x4173739f0fc804f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996165.716304:0:6683:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.137@tcp lock: ffff8e08429c6600/0x4173739f0fc804f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996165.716313:0:6683:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.137@tcp lock: ffff8e08429c6600/0x4173739f0fc804f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789996165.716332:0:6683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fa71500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0c28cd8-555e-481f-bd03-c3b02aee51c5:6683:1876946942171008:0@lo:101: 00000100:00100000:1.0:1789996165.722933:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852ba0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0c28cd8-555e-481f-bd03-c3b02aee51c5+9:6683:x1876946942170112:12345-0@lo:253: Request processed in 117598us (118087us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996165.722949:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789996165.725411:0:6683:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996165.725535:0:6683:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0847514300 going to sleep for 11 seconds 00000100:00100000:1.0:1789996165.730366:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942171008 00000100:00100000:1.0:1789996165.730381:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942171008 00000100:00100000:1.0:1789996165.730664:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789996165.730676:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852ba3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+9:6683:x1876946942171008:12345-0@lo:101: 00010000:00010000:1.0:1789996165.730694:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789996165.730716:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e08413f1800/0x4173739f0fc804fb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4173739f0fc804f4 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996165.730743:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e08413f1800/0x4173739f0fc804fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4173739f0fc804f4 expref: 10 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996165.730755:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e08413f1800/0x4173739f0fc804fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4173739f0fc804f4 expref: 10 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996165.730764:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e08413f1800, rc 0) 00000100:00100000:1.0:1789996165.731410:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852ba3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+10:6683:x1876946942171008:12345-0@lo:101: Request processed in 734us (6003us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996165.731419:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789996165.734434:0:6683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fa71500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0c28cd8-555e-481f-bd03-c3b02aee51c5:6683:1876946942171008:0@lo:101: 00010000:00010000:2.0:1789996165.734479:0:6683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.137@tcp lock: ffff8e08429c6600/0x4173739f0fc804f4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x4173739f0fc804fb expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996165.734493:0:6683:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.137@tcp lock: ffff8e08429c6600/0x4173739f0fc804f4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x4173739f0fc804fb expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789996165.734798:0:6683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fa91500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0c28cd8-555e-481f-bd03-c3b02aee51c5:6683:1876946942171136:0@lo:501: 00000100:00100000:2.0:1789996165.734857:0:6683:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996165.734950:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942171136 00000100:00100000:2.0:1789996165.734956:0:6683:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0852b61f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789996165.734962:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942171136 00000100:00100000:1.0:1789996165.735003:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789996165.735012:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852ba3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0c28cd8-555e-481f-bd03-c3b02aee51c5+10:6683:x1876946942171136:12345-0@lo:501: 00000100:00100000:1.0:1789996165.735776:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852ba3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0c28cd8-555e-481f-bd03-c3b02aee51c5+10:6683:x1876946942171136:12345-0@lo:501: Request processed in 763us (917us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789996165.735798:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789996165.735929:0:6683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fa91500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0c28cd8-555e-481f-bd03-c3b02aee51c5:6683:1876946942171136:0@lo:501: 10000000:01000000:2.0:1789996165.735949:0:6683:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.137@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1789996165.735984:0:6683:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.137@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1789996165.735991:0:6683:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.137@tcp lock: ffff8e08429c6600/0x4173739f0fc804f4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x4173739f0fc804fb expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996165.736001:0:6683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.137@tcp lock: ffff8e08429c6600/0x4173739f0fc804f4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x4173739f0fc804fb expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996165.736009:0:6683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.137@tcp lock: ffff8e08429c6600/0x4173739f0fc804f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x4173739f0fc804fb expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996165.736076:0:6683:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789996165.736104:0:6683:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8e0849c2f000 10000000:01000000:2.0:1789996165.736110:0:6683:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1789996165.736115:0:6683:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8e08545d19c0 10000000:01000000:2.0:1789996165.736118:0:6683:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1789996165.736121:0:6683:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8e08545d19c0 from 1 10000000:01000000:2.0:1789996165.736124:0:6683:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1789996165.736160:0:6683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.137@tcp lock: ffff8e0841524800/0x4173739f0fc80502 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996165.736176:0:6683:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.137@tcp lock: ffff8e0841524800/0x4173739f0fc80502 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996165.736187:0:6683:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.137@tcp lock: ffff8e0841524800/0x4173739f0fc80502 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789996165.736213:0:6683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fa91500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0c28cd8-555e-481f-bd03-c3b02aee51c5:6683:1876946942171264:0@lo:101: 00000100:00100000:2.0:1789996165.736253:0:6683:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996165.736292:0:6683:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0852b61b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789996165.736609:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942171264 00000100:00100000:3.0:1789996165.736615:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942171264 00000100:00100000:3.0:1789996165.736648:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789996165.736656:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852ba2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+10:6683:x1876946942171264:12345-0@lo:101: 00010000:00010000:3.0:1789996165.736667:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789996165.736680:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e08429c6c00/0x4173739f0fc80509 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4173739f0fc80502 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996165.736836:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e08429c6c00/0x4173739f0fc80509 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4173739f0fc80502 expref: 11 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996165.736846:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e08429c6c00/0x4173739f0fc80509 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4173739f0fc80502 expref: 11 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996165.736867:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e08429c6c00, rc 0) 00000100:00100000:3.0:1789996165.736922:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852ba2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+11:6683:x1876946942171264:12345-0@lo:101: Request processed in 267us (668us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996165.736929:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789996165.736977:0:6683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fa91500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0c28cd8-555e-481f-bd03-c3b02aee51c5:6683:1876946942171264:0@lo:101: 00010000:00010000:2.0:1789996165.736990:0:6683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.137@tcp lock: ffff8e0841524800/0x4173739f0fc80502 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc80509 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996165.736999:0:6683:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.137@tcp lock: ffff8e0841524800/0x4173739f0fc80502 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4173739f0fc80509 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789996165.737016:0:6683:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.137@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1789996165.737032:0:6683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.137@tcp lock: ffff8e0841524800/0x4173739f0fc80502 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc80509 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996165.737040:0:6683:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.137@tcp lock: ffff8e0841524800/0x4173739f0fc80502 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc80509 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789996165.737047:0:6683:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1789996165.737051:0:6683:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789996165.737056:0:6683:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1789996165.737059:0:6683:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1789996165.737084:0:6683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.137@tcp lock: ffff8e0841524a00/0x4173739f0fc80510 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996165.737097:0:6683:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.137@tcp lock: ffff8e0841524a00/0x4173739f0fc80510 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996165.737105:0:6683:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.137@tcp lock: ffff8e0841524a00/0x4173739f0fc80510 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789996165.737117:0:6683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fa91500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0c28cd8-555e-481f-bd03-c3b02aee51c5:6683:1876946942171392:0@lo:101: 00000100:00100000:2.0:1789996165.737154:0:6683:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996165.737180:0:6683:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0852b61b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789996165.737204:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942171392 00000100:00100000:3.0:1789996165.737209:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942171392 00000100:00100000:3.0:1789996165.737238:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789996165.737244:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852ba3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0c28cd8-555e-481f-bd03-c3b02aee51c5+11:6683:x1876946942171392:12345-0@lo:101: 00010000:00010000:3.0:1789996165.737251:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789996165.737258:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e08429c6000/0x4173739f0fc80517 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4173739f0fc80510 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996165.737273:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e08429c6000/0x4173739f0fc80517 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4173739f0fc80510 expref: 12 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996165.737281:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e08429c6000/0x4173739f0fc80517 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4173739f0fc80510 expref: 12 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996165.737287:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e08429c6000, rc 0) 00000100:00100000:3.0:1789996165.737314:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852ba3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0c28cd8-555e-481f-bd03-c3b02aee51c5+12:6683:x1876946942171392:12345-0@lo:101: Request processed in 71us (159us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996165.737320:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789996165.737482:0:6683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fa91500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0c28cd8-555e-481f-bd03-c3b02aee51c5:6683:1876946942171392:0@lo:101: 00010000:00010000:0.0:1789996165.737492:0:6683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.137@tcp lock: ffff8e0841524a00/0x4173739f0fc80510 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc80517 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996165.737500:0:6683:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.137@tcp lock: ffff8e0841524a00/0x4173739f0fc80510 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4173739f0fc80517 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789996165.737622:0:6683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0879939880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0c28cd8-555e-481f-bd03-c3b02aee51c5:6683:1876946942171520:0@lo:501: 00000100:00100000:0.0:1789996165.737664:0:6683:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996165.737692:0:6683:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0842b84d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789996165.737773:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942171520 00000100:00100000:3.0:1789996165.737777:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942171520 00000100:00100000:3.0:1789996165.737816:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789996165.738135:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852ba1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+12:6683:x1876946942171520:12345-0@lo:501: 00000100:00100000:0.0:1789996165.738878:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852ba1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+12:6683:x1876946942171520:12345-0@lo:501: Request processed in 1052us (1210us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996165.738887:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00010000:1.0:1789996165.739106:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789996165.739114:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.137@tcp lock: ffff8e08429c6600/0x4173739f0fc804f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x4173739f0fc804fb expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996165.739123:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e08429c6600 already unused, calling callback (ffffffffc1be0c20) 10000000:00010000:1.0:1789996165.739127:0:5835:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.137@tcp lock: ffff8e08429c6600/0x4173739f0fc804f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x4173739f0fc804fb expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996165.739137:0:5835:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.137@tcp lock: ffff8e08429c6600/0x4173739f0fc804f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x4173739f0fc804fb expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789996165.739153:0:5835:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.137@tcp lock: ffff8e08429c6600/0x4173739f0fc804f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x4173739f0fc804fb expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789996165.739159:0:5835:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1789996165.739259:0:6683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0879939880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0c28cd8-555e-481f-bd03-c3b02aee51c5:6683:1876946942171520:0@lo:501: 00000100:00100000:2.0:1789996165.739301:0:6683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fa91180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0c28cd8-555e-481f-bd03-c3b02aee51c5:6683:1876946942171648:0@lo:503: 00000100:00100000:2.0:1789996165.739342:0:6683:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996165.739422:0:6683:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0852b616c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789996165.739464:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942171648 00000100:00100000:3.0:1789996165.739470:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942171648 00000100:00100000:3.0:1789996165.739507:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789996165.739521:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852ba2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0c28cd8-555e-481f-bd03-c3b02aee51c5+12:6683:x1876946942171648:12345-0@lo:503: 00010000:00010000:0.0:1789996165.740168:0:5835:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.137@tcp lock: ffff8e08429c6600/0x4173739f0fc804f4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x4173739f0fc804fb expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996165.740176:0:5835:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1789996165.740240:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0879938000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e0c28cd8-555e-481f-bd03-c3b02aee51c5:3316:1876946942171776:0@lo:103: 00000100:00100000:1.0:1789996165.740283:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789996165.740340:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.137@tcp lock: ffff8e08429c6600/0x4173739f0fc804f4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x4173739f0fc804fb expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996165.740349:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.137@tcp lock: ffff8e08429c6600/0x4173739f0fc804f4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x4173739f0fc804fb expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996165.740375:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789996165.740376:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789996165.740379:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789996165.740403:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942171776 00000100:00100000:3.0:1789996165.740409:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942171776 00000100:00100000:3.0:1789996165.740452:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789996165.740460:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0849c74000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e0c28cd8-555e-481f-bd03-c3b02aee51c5+13:3316:x1876946942171776:12345-0@lo:103: 00010000:00010000:3.0:1789996165.740470:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789996165.740485:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e08413f1800/0x4173739f0fc804fb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4173739f0fc804f4 expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996165.740498:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789996165.740624:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852ba2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0c28cd8-555e-481f-bd03-c3b02aee51c5+12:6683:x1876946942171648:12345-0@lo:503: Request processed in 1103us (1281us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996165.740634:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789996165.740919:0:6683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fa91180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0c28cd8-555e-481f-bd03-c3b02aee51c5:6683:1876946942171648:0@lo:503: 00000100:00100000:3.0:1789996165.741912:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0849c74000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e0c28cd8-555e-481f-bd03-c3b02aee51c5+11:3316:x1876946942171776:12345-0@lo:103: Request processed in 1449us (1624us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996165.741922:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000040:00080000:0.0:1789996165.742062:0:6683:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789996165.742087:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0879938000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e0c28cd8-555e-481f-bd03-c3b02aee51c5:3316:1876946942171776:0@lo:103: 00000100:00100000:0.0:1789996165.742126:0:6683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e087993a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0c28cd8-555e-481f-bd03-c3b02aee51c5:6683:1876946942171904:0@lo:502: 00000100:00100000:0.0:1789996165.742182:0:6683:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789996165.742288:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942171904 00000100:00100000:3.0:1789996165.742293:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942171904 00000100:00100000:3.0:1789996165.742332:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789996165.742336:0:6683:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0842b849c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789996165.742341:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852b6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0c28cd8-555e-481f-bd03-c3b02aee51c5+11:6683:x1876946942171904:12345-0@lo:502: 00000100:00100000:3.0:1789996165.742520:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852b6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0c28cd8-555e-481f-bd03-c3b02aee51c5+11:6683:x1876946942171904:12345-0@lo:502: Request processed in 180us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996165.742526:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789996165.742593:0:6683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e087993a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0c28cd8-555e-481f-bd03-c3b02aee51c5:6683:1876946942171904:0@lo:502: 00000040:00080000:0.0:1789996165.743010:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1789996165.743060:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1789996165.743097:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1789996165.743144:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1789996165.743182:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1789996165.743357:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1789996165.743386:0:6683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e087993a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0c28cd8-555e-481f-bd03-c3b02aee51c5:6683:1876946942172032:0@lo:502: 00000100:00100000:0.0:1789996165.743427:0:6683:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996165.743613:0:6683:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0842b849c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789996165.743652:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942172032 00000100:00100000:2.0:1789996165.743657:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942172032 00000100:00100000:2.0:1789996165.743749:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789996165.743758:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852b6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0c28cd8-555e-481f-bd03-c3b02aee51c5+11:6683:x1876946942172032:12345-0@lo:502: 00000100:00100000:2.0:1789996165.743945:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852b6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0c28cd8-555e-481f-bd03-c3b02aee51c5+11:6683:x1876946942172032:12345-0@lo:502: Request processed in 187us (516us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996165.743952:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789996165.744026:0:6683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e087993a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0c28cd8-555e-481f-bd03-c3b02aee51c5:6683:1876946942172032:0@lo:502: 00000040:00080000:0.0:1789996165.744111:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1789996165.744120:0:6683:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:0.0:1789996165.747456:0:6704:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789996165.747469:0:6704:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:0.0:1789996165.747476:0:6704:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789996165.747478:0:6704:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1789996165.747484:0:6704:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789996165.747511:0:6704:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8e0879950000) 00000020:00000080:0.0:1789996165.747531:0:6704:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:0.0:1789996165.747537:0:6704:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1789996165.747918:0:6704:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e0849c2f000 from lustre-OST0000, refs=2 00080000:01000000:0.0:1789996165.747926:0:6704:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:0.0:1789996165.747934:0:6704:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x4173739f0fc80525 00010000:00010000:0.0:1789996165.757472:0:6704:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:1.0:1789996165.758308:0:6704:0:(tgt_lastrcvd.c:1879:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:3.0:1789996165.768931:0:6704:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1789996165.769522:0:6704:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:3.0:1789996165.789404:0:6704:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:3.0:1789996165.790536:0:6704:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:2.0:1789996165.793355:0:6704:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1789996165.793369:0:6704:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789996165.793375:0:6704:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789996165.793382:0:6704:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1789996165.793387:0:6704:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789996165.793391:0:6704:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789996165.793392:0:6704:0:(obd_config.c:1563:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789996165.793395:0:6704:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789996165.793397:0:6704:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1789996165.793454:0:6704:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789996165.793458:0:6704:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789996165.793459:0:6704:0:(obd_config.c:1563:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:2.0:1789996165.793462:0:6704:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1789996165.805128:0:6683:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:3.0:1789996165.805360:0:6683:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.137@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1789996165.805390:0:6683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.137@tcp lock: ffff8e0841524a00/0x4173739f0fc80510 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc80517 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996165.805412:0:6683:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.137@tcp lock: ffff8e0841524a00/0x4173739f0fc80510 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc80517 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789996165.805421:0:6683:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e0849c2f000 from 1 10000000:01000000:3.0:1789996165.805424:0:6683:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789996165.805459:0:6683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.137@tcp lock: ffff8e08429c7200/0x4173739f0fc8052c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996165.805468:0:6683:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.137@tcp lock: ffff8e08429c7200/0x4173739f0fc8052c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996165.805478:0:6683:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.137@tcp lock: ffff8e08429c7200/0x4173739f0fc8052c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789996165.805502:0:6683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fa72d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0c28cd8-555e-481f-bd03-c3b02aee51c5:6683:1876946942172160:0@lo:101: 00000100:00100000:3.0:1789996165.806077:0:6683:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789996165.806125:0:6683:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e08581e06c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789996165.808588:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942172160 00000100:00100000:0.0:1789996165.808602:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942172160 00000100:00100000:0.0:1789996165.808654:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789996165.808664:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852b6e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0c28cd8-555e-481f-bd03-c3b02aee51c5+11:6683:x1876946942172160:12345-0@lo:101: 00010000:00010000:0.0:1789996165.808680:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789996165.808698:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e0840031400/0x4173739f0fc80533 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4173739f0fc8052c expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996165.808726:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e0840031400/0x4173739f0fc80533 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4173739f0fc8052c expref: 12 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996165.808736:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e0840031400/0x4173739f0fc80533 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4173739f0fc8052c expref: 12 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996165.808744:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e0840031400, rc 0) 00000100:00100000:0.0:1789996165.808833:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852b6e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0c28cd8-555e-481f-bd03-c3b02aee51c5+12:6683:x1876946942172160:12345-0@lo:101: Request processed in 170us (3241us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996165.808839:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789996165.810601:0:6683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fa72d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0c28cd8-555e-481f-bd03-c3b02aee51c5:6683:1876946942172160:0@lo:101: 00010000:00010000:1.0:1789996165.810627:0:6683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.137@tcp lock: ffff8e08429c7200/0x4173739f0fc8052c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc80533 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996165.810661:0:6683:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.137@tcp lock: ffff8e08429c7200/0x4173739f0fc8052c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4173739f0fc80533 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789996165.810780:0:6683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0849c75c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0c28cd8-555e-481f-bd03-c3b02aee51c5:6683:1876946942172288:0@lo:501: 00000100:00100000:1.0:1789996165.810844:0:6683:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996165.810889:0:6683:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e08704a1180 going to sleep for 11 seconds 00000100:00100000:2.0:1789996165.811840:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942172288 00000100:00100000:2.0:1789996165.811848:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942172288 00000100:00100000:2.0:1789996165.811887:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789996165.811895:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852b6c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+12:6683:x1876946942172288:12345-0@lo:501: 00000100:00100000:2.0:1789996165.813530:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852b6c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+12:6683:x1876946942172288:12345-0@lo:501: Request processed in 1626us (2676us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996165.813559:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789996165.813936:0:6683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0849c75c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0c28cd8-555e-481f-bd03-c3b02aee51c5:6683:1876946942172288:0@lo:501: 00000100:00100000:1.0:1789996165.813997:0:6683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0849c75c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0c28cd8-555e-481f-bd03-c3b02aee51c5:6683:1876946942172416:0@lo:503: 00000100:00100000:1.0:1789996165.814045:0:6683:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996165.814059:0:6683:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e08704a1180 going to sleep for 11 seconds 00000100:00100000:2.0:1789996165.814299:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942172416 00000100:00100000:2.0:1789996165.814306:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942172416 00000100:00100000:2.0:1789996165.814336:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789996165.814344:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852b6fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+12:6683:x1876946942172416:12345-0@lo:503: 00000100:00100000:0.0:1789996165.815017:0:6683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0849c75c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0c28cd8-555e-481f-bd03-c3b02aee51c5:6683:1876946942172416:0@lo:503: 00000040:00080000:0.0:1789996165.815336:0:6683:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789996165.815405:0:6683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e087993a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0c28cd8-555e-481f-bd03-c3b02aee51c5:6683:1876946942172544:0@lo:502: 00000100:00100000:2.0:1789996165.815450:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852b6fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+12:6683:x1876946942172416:12345-0@lo:503: Request processed in 1106us (1403us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996165.815458:0:6683:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996165.815459:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789996165.815502:0:6683:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0842b84f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789996165.815563:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942172544 00000100:00100000:2.0:1789996165.815568:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942172544 00000100:00100000:2.0:1789996165.815607:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789996165.815615:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852b6d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+12:6683:x1876946942172544:12345-0@lo:502: 00000100:00100000:2.0:1789996165.815887:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852b6d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+12:6683:x1876946942172544:12345-0@lo:502: Request processed in 272us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996165.815903:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789996165.816108:0:6683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e087993a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0c28cd8-555e-481f-bd03-c3b02aee51c5:6683:1876946942172544:0@lo:502: 00000040:00080000:0.0:1789996165.816373:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1789996165.816434:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1789996165.816474:0:6683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e087993a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0c28cd8-555e-481f-bd03-c3b02aee51c5:6683:1876946942172672:0@lo:502: 00000100:00100000:0.0:1789996165.816512:0:6683:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996165.816736:0:6683:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0842b84f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789996165.818952:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942172672 00000100:00100000:2.0:1789996165.818965:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942172672 00000100:00100000:2.0:1789996165.819040:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789996165.819052:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852b6d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0c28cd8-555e-481f-bd03-c3b02aee51c5+12:6683:x1876946942172672:12345-0@lo:502: 00000100:00100000:2.0:1789996165.819582:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852b6d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0c28cd8-555e-481f-bd03-c3b02aee51c5+12:6683:x1876946942172672:12345-0@lo:502: Request processed in 531us (3067us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996165.819590:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789996165.820402:0:6683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e087993a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0c28cd8-555e-481f-bd03-c3b02aee51c5:6683:1876946942172672:0@lo:502: 00000040:00080000:0.0:1789996165.821000:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1789996165.821016:0:6683:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1789996165.825199:0:6708:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789996165.825212:0:6708:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789996165.825215:0:6708:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1789996165.825221:0:6708:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e0849c2f000 00000020:00000080:3.0:1789996165.825233:0:6708:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789996165.825257:0:6708:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789996165.825261:0:6708:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789996165.825262:0:6708:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1789996165.825265:0:6708:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1789996165.826328:0:6683:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1789996165.826363:0:6683:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.137@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789996165.826400:0:6683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.137@tcp lock: ffff8e08429c7200/0x4173739f0fc8052c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc80533 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996165.826414:0:6683:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.137@tcp lock: ffff8e08429c7200/0x4173739f0fc8052c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc80533 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789996165.826475:0:6683:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789996165.826478:0:6683:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8e0849c2f000 10000000:01000000:2.0:1789996165.826481:0:6683:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8e0849c2f000 10000000:01000000:2.0:1789996165.826485:0:6683:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789996165.826491:0:6683:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8e0849c2f000 from 1 10000000:01000000:2.0:1789996165.826494:0:6683:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789996165.826530:0:6683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.137@tcp lock: ffff8e0841524000/0x4173739f0fc8053a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996165.826539:0:6683:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.137@tcp lock: ffff8e0841524000/0x4173739f0fc8053a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996165.826581:0:6683:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.137@tcp lock: ffff8e0841524000/0x4173739f0fc8053a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789996165.826629:0:6683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fa93b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0c28cd8-555e-481f-bd03-c3b02aee51c5:6683:1876946942172800:0@lo:101: 00000100:00100000:2.0:1789996165.826839:0:6683:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996165.826890:0:6683:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0852b61000 going to sleep for 11 seconds 00000100:00100000:1.0:1789996165.827217:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942172800 00000100:00100000:1.0:1789996165.827234:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942172800 00000100:00100000:1.0:1789996165.827289:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789996165.827299:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852b6d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0c28cd8-555e-481f-bd03-c3b02aee51c5+12:6683:x1876946942172800:12345-0@lo:101: 00010000:00010000:1.0:1789996165.827313:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789996165.827328:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e08413f0000/0x4173739f0fc80541 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4173739f0fc8053a expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996165.827352:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e08413f0000/0x4173739f0fc80541 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4173739f0fc8053a expref: 13 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996165.827362:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e08413f0000/0x4173739f0fc80541 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4173739f0fc8053a expref: 13 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996165.827370:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e08413f0000, rc 0) 00000100:00100000:1.0:1789996165.827408:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852b6d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0c28cd8-555e-481f-bd03-c3b02aee51c5+13:6683:x1876946942172800:12345-0@lo:101: Request processed in 111us (570us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996165.827423:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789996165.827655:0:6683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fa93b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0c28cd8-555e-481f-bd03-c3b02aee51c5:6683:1876946942172800:0@lo:101: 00010000:00010000:2.0:1789996165.827671:0:6683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.137@tcp lock: ffff8e0841524000/0x4173739f0fc8053a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc80541 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996165.827691:0:6683:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.137@tcp lock: ffff8e0841524000/0x4173739f0fc8053a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4173739f0fc80541 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789996165.827800:0:6683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fa93b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0c28cd8-555e-481f-bd03-c3b02aee51c5:6683:1876946942172928:0@lo:501: 00000100:00100000:2.0:1789996165.827829:0:6683:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996165.827853:0:6683:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0852b61000 going to sleep for 11 seconds 00000100:00100000:0.0:1789996165.828092:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942172928 00000100:00100000:0.0:1789996165.828097:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942172928 00000100:00100000:0.0:1789996165.828126:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789996165.828134:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852b6cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0c28cd8-555e-481f-bd03-c3b02aee51c5+13:6683:x1876946942172928:12345-0@lo:501: 00000100:00100000:0.0:1789996165.828383:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852b6cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0c28cd8-555e-481f-bd03-c3b02aee51c5+13:6683:x1876946942172928:12345-0@lo:501: Request processed in 248us (551us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996165.828400:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789996165.828860:0:6683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fa93b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0c28cd8-555e-481f-bd03-c3b02aee51c5:6683:1876946942172928:0@lo:501: 00000100:00100000:2.0:1789996165.828895:0:6683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fa93b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0c28cd8-555e-481f-bd03-c3b02aee51c5:6683:1876946942173056:0@lo:503: 00000100:00100000:2.0:1789996165.828941:0:6683:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996165.828981:0:6683:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0852b61000 going to sleep for 11 seconds 00000100:00100000:3.0:1789996165.829031:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942173056 00000100:00100000:3.0:1789996165.829036:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942173056 00000100:00100000:3.0:1789996165.829072:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789996165.829080:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852b6f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+13:6683:x1876946942173056:12345-0@lo:503: 00000100:00100000:3.0:1789996165.829248:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852b6f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+13:6683:x1876946942173056:12345-0@lo:503: Request processed in 167us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996165.829255:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789996165.829413:0:6683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fa93b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0c28cd8-555e-481f-bd03-c3b02aee51c5:6683:1876946942173056:0@lo:503: 00000040:00080000:2.0:1789996165.831105:0:6683:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789996165.831188:0:6683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fa93b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0c28cd8-555e-481f-bd03-c3b02aee51c5:6683:1876946942173184:0@lo:502: 00000100:00100000:2.0:1789996165.831259:0:6683:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996165.831303:0:6683:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0852b61000 going to sleep for 11 seconds 00000100:00100000:3.0:1789996165.831365:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942173184 00000100:00100000:3.0:1789996165.831372:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942173184 00000100:00100000:3.0:1789996165.831415:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789996165.831423:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852b6f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+13:6683:x1876946942173184:12345-0@lo:502: 00000100:00100000:3.0:1789996165.831708:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852b6f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+13:6683:x1876946942173184:12345-0@lo:502: Request processed in 284us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996165.831715:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789996165.832131:0:6683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fa93b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0c28cd8-555e-481f-bd03-c3b02aee51c5:6683:1876946942173184:0@lo:502: 00000040:00080000:2.0:1789996165.832417:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1789996165.832477:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1789996165.832509:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1789996165.832873:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1789996165.832915:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1789996165.832958:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1789996165.832989:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1789996165.833024:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1789996165.833067:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1789996165.833096:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1789996165.833143:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1789996165.833190:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1789996165.833222:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1789996165.833254:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1789996165.833300:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1789996165.833334:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1789996165.833363:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1789996165.833409:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1789996165.833445:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1789996165.833479:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1789996165.833525:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1789996165.834118:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1789996165.834157:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1789996165.834221:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1789996165.834261:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:2.0:1789996165.834296:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:2.0:1789996165.834363:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:2.0:1789996165.834395:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:2.0:1789996165.835088:0:6683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fa93b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0c28cd8-555e-481f-bd03-c3b02aee51c5:6683:1876946942173312:0@lo:502: 00000100:00100000:2.0:1789996165.835181:0:6683:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996165.835278:0:6683:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0852b61000 going to sleep for 11 seconds 00000100:00100000:3.0:1789996165.835334:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942173312 00000100:00100000:3.0:1789996165.835341:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942173312 00000100:00100000:3.0:1789996165.835390:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789996165.835399:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852b6e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+13:6683:x1876946942173312:12345-0@lo:502: 00000100:00100000:3.0:1789996165.836085:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852b6e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+13:6683:x1876946942173312:12345-0@lo:502: Request processed in 685us (902us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996165.836092:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789996165.836271:0:6683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fa93b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0c28cd8-555e-481f-bd03-c3b02aee51c5:6683:1876946942173312:0@lo:502: 00000040:00080000:2.0:1789996165.836371:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:2.0:1789996165.836392:0:6683:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:3.0:1789996165.841520:0:6709:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1789996165.841539:0:6709:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8e08545d3380) 00000020:00000080:0.0:1789996165.842071:0:6709:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:0.0:1789996165.842155:0:6709:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e0849c2f000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1789996165.842159:0:6709:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8e0849c2f000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1789996165.842162:0:6709:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e0849c2f000 3 00010000:00080000:0.0:1789996165.842193:0:6709:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e087f9e2800@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.137@tcp at head 00010000:00010000:0.0:1789996165.846988:0:6709:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:0.0:1789996165.848046:0:6709:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1789996165.848093:0:6709:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789996165.848107:0:6709:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x4173739f0fc8054f 00000100:00080000:0.0:1789996165.848117:0:6709:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789996165.848129:0:6709:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8e087f9e2800 using connection 192.168.204.137@tcp/0@lo 00000100:00100000:0.0:1789996165.848177:0:6709:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e087993a300 x1876946942173440/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789996165.848215:0:6709:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1789996165.848364:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e087993a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3312:1876946942173440:0@lo:38: 00000100:00100000:1.0:1789996165.848466:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996165.848572:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942173440 00000100:00100000:1.0:1789996165.848579:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942173440 00000100:00100000:1.0:1789996165.848610:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789996165.848617:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0849c77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3312:x1876946942173440:12345-0@lo:38: 00010000:00080000:1.0:1789996165.848639:0:5848:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 207 last 0 00000020:00000080:1.0:1789996165.848694:0:5848:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x4173739f0fc80556 00000004:00100000:1.0:1789996165.848709:0:5848:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789996165.848739:0:5848:0:(import.c:65:import_set_state_nolock()) ffff8e0876338800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789996165.848803:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0849c77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876946942173440:12345-0@lo:38: Request processed in 167us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996165.848810:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1789996165.848850:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8e087993a300 x1876946942173440/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789996175 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789996165.848860:0:3312:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789996165.848866:0:3312:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:1.0:1789996165.848872:0:3312:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1789996165.848876:0:3312:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789996165.848878:0:3312:0:(import.c:65:import_set_state_nolock()) ffff8e087f9e2800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789996165.848884:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e087993a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3312:1876946942173440:0@lo:38: 00000040:00080000:0.0:1789996165.862574:0:6709:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:2.0:1789996165.866465:0:6683:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:2.0:1789996165.866505:0:6683:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.137@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789996165.866538:0:6683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.137@tcp lock: ffff8e0841524000/0x4173739f0fc8053a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc80541 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996165.866575:0:6683:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.137@tcp lock: ffff8e0841524000/0x4173739f0fc8053a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc80541 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789996165.866644:0:6683:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1789996165.866647:0:6683:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789996165.866648:0:6683:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789996165.866649:0:6683:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789996165.866651:0:6683:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789996165.866652:0:6683:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789996165.866654:0:6683:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789996165.866655:0:6683:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789996165.866657:0:6683:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789996165.866658:0:6683:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789996165.866659:0:6683:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789996165.866663:0:6683:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:2.0:1789996165.866666:0:6683:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789996165.866667:0:6683:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789996165.866668:0:6683:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789996165.866669:0:6683:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789996165.866671:0:6683:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789996165.866672:0:6683:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789996165.866673:0:6683:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789996165.866674:0:6683:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789996165.866675:0:6683:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789996165.866676:0:6683:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789996165.866677:0:6683:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789996165.866715:0:6683:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1789996165.866732:0:6683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fa93b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0c28cd8-555e-481f-bd03-c3b02aee51c5:6683:1876946942173568:0@lo:253: 00000100:00100000:2.0:1789996165.866811:0:6683:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996165.866863:0:6683:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0852b61600 going to sleep for 11 seconds 00000100:00100000:1.0:1789996165.867650:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942173568 00000100:00100000:1.0:1789996165.867658:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942173568 00000100:00100000:1.0:1789996165.867999:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789996165.868011:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852b6f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0c28cd8-555e-481f-bd03-c3b02aee51c5+13:6683:x1876946942173568:12345-0@lo:253: 20000000:01000000:1.0:1789996165.868051:0:5840:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1789996165.868065:0:5840:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1789996165.868423:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789996165.868448:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fa91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876946942173696:0@lo:400: 00000100:00100000:3.0:1789996165.868499:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996165.868841:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942173696 00000100:00100000:2.0:1789996165.868848:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942173696 00000100:00100000:2.0:1789996165.868892:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789996165.868901:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fa71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876946942173696:12345-0@lo:400: 00000100:00100000:2.0:1789996165.868948:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fa71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876946942173696:12345-0@lo:400: Request processed in 49us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996165.868956:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1789996165.876688:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8e086fa91f80 x1876946942173696/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789996181 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789996165.876709:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fa91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876946942173696:0@lo:400: 20000000:01000000:1.0:1789996165.940856:0:5840:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1789996165.940880:0:5840:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1789996165.940998:0:5862:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789996165.941003:0:5862:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789996165.941026:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e0841525e00/0x4173739f0fc8055d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996165.941045:0:5862:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e08429c6a00/0x4173739f0fc804bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4173739f0fc804b5 expref: 13 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996165.941053:0:5862:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8e0841525e00/0x4173739f0fc8055d lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996165.941092:0:5862:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e08429c6a00/0x4173739f0fc804bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4173739f0fc804b5 expref: 13 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996165.941106:0:5862:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e08429c6a00/0x4173739f0fc804bc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4173739f0fc804b5 expref: 13 pid: 5840 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789996165.941119:0:5862:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fa90700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5862:1876946942173824:0@lo:104: 00000100:00100000:2.0:1789996165.941182:0:5862:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996165.941245:0:5862:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0852b616c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789996165.941309:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942173824 00000100:00100000:3.0:1789996165.941330:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942173824 00000100:00100000:3.0:1789996165.941395:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789996165.941405:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fa93800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e0c28cd8-555e-481f-bd03-c3b02aee51c5+3:5862:x1876946942173824:12345-0@lo:104: 00010000:00010000:3.0:1789996165.941418:0:5830:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.137@tcp lock: ffff8e0840030600/0x4173739f0fc804b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4173739f0fc804bc expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996165.941468:0:5830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789996165.941474:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fa93800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e0c28cd8-555e-481f-bd03-c3b02aee51c5+3:5862:x1876946942173824:12345-0@lo:104: Request processed in 72us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996165.941481:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:3.0:1789996165.941501:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789996165.941507:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.137@tcp lock: ffff8e0840030600/0x4173739f0fc804b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4173739f0fc804bc expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996165.941513:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0840030600 already unused, calling callback (ffffffffc1be0c20) 10000000:00010000:3.0:1789996165.941518:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.137@tcp lock: ffff8e0840030600/0x4173739f0fc804b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4173739f0fc804bc expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996165.941527:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.137@tcp lock: ffff8e0840030600/0x4173739f0fc804b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4173739f0fc804bc expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789996165.941534:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.137@tcp lock: ffff8e0840030600/0x4173739f0fc804b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4173739f0fc804bc expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789996165.941540:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789996165.941602:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.137@tcp lock: ffff8e0840030600/0x4173739f0fc804b5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4173739f0fc804bc expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996165.941608:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789996165.941625:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.137@tcp lock: ffff8e0840030600/0x4173739f0fc804b5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4173739f0fc804bc expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996165.941638:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.137@tcp lock: ffff8e0840030600/0x4173739f0fc804b5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4173739f0fc804bc expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996165.941657:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789996165.941659:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789996165.941661:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789996165.941672:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fa70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e0c28cd8-555e-481f-bd03-c3b02aee51c5:3314:1876946942173952:0@lo:103: 00000100:00100000:3.0:1789996165.941714:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789996165.941753:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942173952 00000100:00100000:3.0:1789996165.941757:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942173952 00010000:00010000:3.0:1789996165.941774:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e08429c6a00/0x4173739f0fc804bc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4173739f0fc804b5 expref: 14 pid: 5840 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789996165.941804:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789996165.941812:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0848c1c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e0c28cd8-555e-481f-bd03-c3b02aee51c5+14:3314:x1876946942173952:12345-0@lo:103: 00010000:00010000:3.0:1789996165.941822:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789996165.941826:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e08429c6a00/0x4173739f0fc804bc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4173739f0fc804b5 expref: 14 pid: 5840 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996165.941836:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e08429c6a00/0x4173739f0fc804bc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4173739f0fc804b5 expref: 14 pid: 5840 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996165.941851:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8e0841525e00/0x4173739f0fc8055d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996165.941859:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e0841525e00/0x4173739f0fc8055d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789996165.941871:0:5832:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001575965s 00010000:00010000:3.0:1789996165.941881:0:5832:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e0841525e00/0x4173739f0fc8055d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996165.941888:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e0841525e00/0x4173739f0fc8055d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996165.941894:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e0841525e00/0x4173739f0fc8055d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996165.941900:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e0841525e00/0x4173739f0fc8055d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996165.941905:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0841525e00 already unused, calling callback (ffffffffc1595910) 00010000:00010000:3.0:1789996165.941909:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e0841525e00/0x4173739f0fc8055d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996165.941915:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e0841525e00/0x4173739f0fc8055d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996165.941923:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e0841525e00/0x4173739f0fc8055d lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996165.941933:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789996165.941962:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0848c1c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e0c28cd8-555e-481f-bd03-c3b02aee51c5+14:3314:x1876946942173952:12345-0@lo:103: Request processed in 151us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996165.941968:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789996165.942023:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fa70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e0c28cd8-555e-481f-bd03-c3b02aee51c5:3314:1876946942173952:0@lo:103: 00010000:00010000:2.0:1789996165.942441:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e08429c6a00/0x4173739f0fc804bc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4173739f0fc804b5 expref: 13 pid: 5840 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789996165.942453:0:5862:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fa90700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5862:1876946942173824:0@lo:104: 00010000:00010000:2.0:1789996165.942475:0:5862:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8e0841525e00/0x4173739f0fc8055d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996165.942483:0:5862:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8e0841525e00/0x4173739f0fc8055d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996165.942489:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e0841525e00/0x4173739f0fc8055d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996165.942494:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e0841525e00/0x4173739f0fc8055d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789996166.018156:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852b6f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0c28cd8-555e-481f-bd03-c3b02aee51c5+12:6683:x1876946942173568:12345-0@lo:253: Request processed in 150139us (151336us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996166.018171:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789996166.019378:0:6683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fa93b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0c28cd8-555e-481f-bd03-c3b02aee51c5:6683:1876946942173568:0@lo:253: 10000000:01000000:0.0:1789996166.019396:0:6683:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1789996166.019399:0:6683:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789996166.019401:0:6683:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789996166.019402:0:6683:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789996166.019403:0:6683:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789996166.019404:0:6683:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789996166.019405:0:6683:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789996166.019406:0:6683:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789996166.019408:0:6683:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789996166.019409:0:6683:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789996166.019411:0:6683:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789996166.019412:0:6683:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1789996166.019428:0:6683:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1789996166.030204:0:6683:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1789996166.030421:0:6683:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1789996166.030680:0:6683:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1789996166.030900:0:6683:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1789996166.031124:0:6683:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1789996166.031367:0:6683:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1789996166.039174:0:6683:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:1.0:1789996166.333447:0:6683:0:(ofd_obd.c:541:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1789996166.333457:0:6683:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1789996166.333574:0:6683:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789996166.333650:0:6683:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.137@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789996166.333686:0:6683:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1789996166.333747:0:6683:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:1.0:1789996166.504703:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789996167.529676:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789996168.552943:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789996169.577938:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789996170.605864:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789996171.253913:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0849c74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3316:1876946942174208:0@lo:400: 00000100:00100000:1.0:1789996171.253977:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996171.254029:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789996171.254035:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0849c77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e0c28cd8-555e-481f-bd03-c3b02aee51c5:3316:1876946942174080:0@lo:400: 00000100:00100000:1.0:1789996171.254061:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996171.254083:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0849c76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1876946942174336:0@lo:400: 00000100:00100000:1.0:1789996171.254102:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996171.254132:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942174208 00000100:00100000:1.0:1789996171.254138:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942174208 00000100:00100000:1.0:1789996171.254174:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942174336 00000100:00100000:1.0:1789996171.254176:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942174336 00000100:00100000:1.0:1789996171.254198:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789996171.254205:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0849c75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1876946942174208:12345-0@lo:400: 00000100:00100000:1.0:1789996171.254249:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0849c75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1876946942174208:12345-0@lo:400: Request processed in 44us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996171.254256:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789996171.254273:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789996171.254280:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0849c76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876946942174336:12345-0@lo:400: 00000100:00100000:1.0:1789996171.254306:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0849c76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876946942174336:12345-0@lo:400: Request processed in 27us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996171.254319:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789996171.254338:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942174080 00000100:00100000:1.0:1789996171.254341:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942174080 00000100:00100000:1.0:1789996171.254363:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789996171.254369:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852b6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+12:3316:x1876946942174080:12345-0@lo:400: 00000100:00100000:1.0:1789996171.254401:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852b6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+12:3316:x1876946942174080:12345-0@lo:400: Request processed in 31us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996171.254407:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:1.0:1789996171.254442:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789996171.254472:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e0849c76a00 x1876946942174336/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789996187 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789996171.254485:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0849c76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1876946942174336:0@lo:400: 00000100:00100000:1.0:1789996171.254509:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0849c77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e0c28cd8-555e-481f-bd03-c3b02aee51c5:3316:1876946942174080:0@lo:400: 00010000:00080000:1.0:1789996171.254519:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e0849c74380 x1876946942174208/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789996187 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789996171.254528:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0849c74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3316:1876946942174208:0@lo:400: 00010000:00010000:3.0:1789996171.625696:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789996172.662907:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789996173.672741:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789996173.800625:0:5843:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789996173.800642:0:5843:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8e08709bf800 from 21 10000000:01000000:0.0:1789996173.800648:0:5843:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789996173.800703:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.137@tcp lock: ffff8e0840030400/0x4173739f0fc80564 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996173.800715:0:5843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.137@tcp lock: ffff8e0840030400/0x4173739f0fc80564 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996173.800734:0:5843:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.137@tcp lock: ffff8e0840030400/0x4173739f0fc80564 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789996173.800758:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0879939c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5843:1876946942174464:0@lo:101: 00000100:00100000:0.0:1789996173.800824:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996173.801049:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e086d6ec480 going to sleep for 11 seconds 00000100:00100000:2.0:1789996173.802576:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942174464 00000100:00100000:2.0:1789996173.802588:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942174464 00000100:00100000:2.0:1789996173.802652:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789996173.802661:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852b6e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0c28cd8-555e-481f-bd03-c3b02aee51c5+12:5843:x1876946942174464:12345-0@lo:101: 00010000:00010000:2.0:1789996173.802675:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789996173.802701:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e0841524e00/0x4173739f0fc8056b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4173739f0fc80564 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996173.802727:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e0841524e00/0x4173739f0fc8056b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4173739f0fc80564 expref: 13 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996173.802737:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e0841524e00/0x4173739f0fc8056b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4173739f0fc80564 expref: 13 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996173.802754:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e0841524e00, rc 0) 00000100:00100000:2.0:1789996173.802811:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852b6e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0c28cd8-555e-481f-bd03-c3b02aee51c5+13:5843:x1876946942174464:12345-0@lo:101: Request processed in 152us (1986us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996173.802817:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789996173.804902:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0879939c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5843:1876946942174464:0@lo:101: 00010000:00010000:0.0:1789996173.804928:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.137@tcp lock: ffff8e0840030400/0x4173739f0fc80564 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc8056b expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996173.804940:0:5843:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.137@tcp lock: ffff8e0840030400/0x4173739f0fc80564 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4173739f0fc8056b expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789996173.805022:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0879939c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5843:1876946942174592:0@lo:501: 00000100:00100000:0.0:1789996173.805071:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996173.805115:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e086d6ec480 going to sleep for 11 seconds 00000100:00100000:1.0:1789996173.805617:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942174592 00000100:00100000:1.0:1789996173.805624:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942174592 00000100:00100000:1.0:1789996173.805685:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789996173.805694:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852b6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0c28cd8-555e-481f-bd03-c3b02aee51c5+13:5843:x1876946942174592:12345-0@lo:501: 00000100:00100000:1.0:1789996173.808572:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852b6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0c28cd8-555e-481f-bd03-c3b02aee51c5+13:5843:x1876946942174592:12345-0@lo:501: Request processed in 2870us (3492us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996173.808586:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789996173.808713:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0879939c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5843:1876946942174592:0@lo:501: 00000100:00100000:0.0:1789996173.808756:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0879939c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5843:1876946942174720:0@lo:503: 00000100:00100000:0.0:1789996173.808816:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996173.808856:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e086d6ec480 going to sleep for 11 seconds 00000100:00100000:1.0:1789996173.811558:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942174720 00000100:00100000:1.0:1789996173.811571:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942174720 00000100:00100000:1.0:1789996173.811644:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789996173.811653:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0870532050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+13:5843:x1876946942174720:12345-0@lo:503: 00000100:00100000:1.0:1789996173.812014:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0870532050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+13:5843:x1876946942174720:12345-0@lo:503: Request processed in 360us (3196us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996173.812021:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789996173.820884:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0879939c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5843:1876946942174720:0@lo:503: 00000100:00100000:0.0:1789996173.827964:0:7001:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0879939c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0c28cd8-555e-481f-bd03-c3b02aee51c5:7001:1876946942174848:0@lo:502: 00000100:00100000:0.0:1789996173.828042:0:7001:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996173.828141:0:7001:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e086d6ec480 going to sleep for 11 seconds 00000100:00100000:2.0:1789996173.828146:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942174848 00000100:00100000:2.0:1789996173.828153:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942174848 00000100:00100000:2.0:1789996173.828665:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789996173.828799:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e08602c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0c28cd8-555e-481f-bd03-c3b02aee51c5+13:7001:x1876946942174848:12345-0@lo:502: 00000100:00100000:2.0:1789996173.831647:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e08602c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0c28cd8-555e-481f-bd03-c3b02aee51c5+13:7001:x1876946942174848:12345-0@lo:502: Request processed in 2950us (3581us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996173.831661:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789996173.834439:0:7001:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0879939c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0c28cd8-555e-481f-bd03-c3b02aee51c5:7001:1876946942174848:0@lo:502: 00000100:00100000:3.0:1789996173.834577:0:7001:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fa70700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0c28cd8-555e-481f-bd03-c3b02aee51c5:7001:1876946942174976:0@lo:502: 00000100:00100000:3.0:1789996173.834672:0:7001:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789996173.839472:0:7001:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e084659e240 going to sleep for 11 seconds 00000100:00100000:0.0:1789996173.846167:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942174976 00000100:00100000:0.0:1789996173.846201:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942174976 00000100:00100000:1.0:1789996173.853172:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789996173.853207:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e08602ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+13:7001:x1876946942174976:12345-0@lo:502: 00000100:00100000:1.0:1789996173.854149:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e08602ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+13:7001:x1876946942174976:12345-0@lo:502: Request processed in 960us (19473us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996173.854159:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789996173.863829:0:7001:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fa70700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0c28cd8-555e-481f-bd03-c3b02aee51c5:7001:1876946942174976:0@lo:502: 00000040:00080000:2.0:1789996173.863890:0:7001:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:0.0:1789996173.864137:0:5843:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:0.0:1789996173.864156:0:5843:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.137@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789996173.864166:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.137@tcp lock: ffff8e0840030400/0x4173739f0fc80564 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc8056b expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996173.864177:0:5843:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.137@tcp lock: ffff8e0840030400/0x4173739f0fc80564 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc8056b expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789996173.864186:0:5843:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789996173.864189:0:5843:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8e08709bf800 from 4 10000000:01000000:0.0:1789996173.864191:0:5843:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789996173.864226:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.137@tcp lock: ffff8e0840031000/0x4173739f0fc80572 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996173.864234:0:5843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.137@tcp lock: ffff8e0840031000/0x4173739f0fc80572 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996173.864243:0:5843:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.137@tcp lock: ffff8e0840031000/0x4173739f0fc80572 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789996173.864261:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e087993b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5843:1876946942175104:0@lo:101: 00000100:00100000:0.0:1789996173.864315:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996173.864363:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e086d6ec480 going to sleep for 11 seconds 00000100:00100000:2.0:1789996173.864800:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942175104 00000100:00100000:2.0:1789996173.864807:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942175104 00000100:00100000:2.0:1789996173.864890:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789996173.864900:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e08602cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0c28cd8-555e-481f-bd03-c3b02aee51c5+13:5843:x1876946942175104:12345-0@lo:101: 00010000:00010000:2.0:1789996173.864913:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789996173.864927:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e0841524c00/0x4173739f0fc80579 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4173739f0fc80572 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996173.864951:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e0841524c00/0x4173739f0fc80579 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4173739f0fc80572 expref: 14 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996173.864961:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e0841524c00/0x4173739f0fc80579 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4173739f0fc80572 expref: 14 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996173.864985:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e0841524c00, rc 0) 00000100:00100000:2.0:1789996173.865075:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e08602cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0c28cd8-555e-481f-bd03-c3b02aee51c5+14:5843:x1876946942175104:12345-0@lo:101: Request processed in 176us (760us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996173.865081:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789996173.865113:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e087993b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5843:1876946942175104:0@lo:101: 00010000:00010000:2.0:1789996173.865125:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.137@tcp lock: ffff8e0840031000/0x4173739f0fc80572 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc80579 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996173.865134:0:5843:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.137@tcp lock: ffff8e0840031000/0x4173739f0fc80572 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4173739f0fc80579 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789996173.865181:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fa90700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5843:1876946942175232:0@lo:256: 00000100:00100000:2.0:1789996173.865212:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996173.865222:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0848652e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789996173.865237:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942175232 00000100:00100000:2.0:1789996173.865240:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942175232 00000100:00100000:2.0:1789996173.865256:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789996173.865261:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e08602cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0c28cd8-555e-481f-bd03-c3b02aee51c5+14:5843:x1876946942175232:12345-0@lo:256: 20000000:01000000:2.0:1789996173.865274:0:5841:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789996173.865290:0:5841:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789996173.865293:0:5841:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:2.0:1789996173.865393:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e08602cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0c28cd8-555e-481f-bd03-c3b02aee51c5+14:5843:x1876946942175232:12345-0@lo:256: Request processed in 130us (180us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996173.865400:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789996173.865433:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fa90700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5843:1876946942175232:0@lo:256: 10000000:01000000:2.0:1789996173.865465:0:5843:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.137@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789996173.865474:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.137@tcp lock: ffff8e0840031000/0x4173739f0fc80572 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc80579 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996173.865481:0:5843:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.137@tcp lock: ffff8e0840031000/0x4173739f0fc80572 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc80579 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789996173.865488:0:5843:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1789996173.865490:0:5843:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:2.0:1789996173.865492:0:5843:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1789996173.865508:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.137@tcp lock: ffff8e0841525200/0x4173739f0fc80580 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996173.865515:0:5843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.137@tcp lock: ffff8e0841525200/0x4173739f0fc80580 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996173.865523:0:5843:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.137@tcp lock: ffff8e0841525200/0x4173739f0fc80580 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789996173.865534:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fa90700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5843:1876946942175360:0@lo:101: 00000100:00100000:2.0:1789996173.865576:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996173.865585:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0848652e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789996173.865600:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942175360 00000100:00100000:2.0:1789996173.865604:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942175360 00000100:00100000:2.0:1789996173.865619:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789996173.865625:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e08602c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0c28cd8-555e-481f-bd03-c3b02aee51c5+14:5843:x1876946942175360:12345-0@lo:101: 00010000:00010000:2.0:1789996173.865646:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789996173.865655:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e0841525e00/0x4173739f0fc80587 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4173739f0fc80580 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996173.865669:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e0841525e00/0x4173739f0fc80587 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4173739f0fc80580 expref: 15 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996173.867817:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e0841525e00/0x4173739f0fc80587 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4173739f0fc80580 expref: 15 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996173.867828:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e0841525e00, rc 0) 00000100:00100000:2.0:1789996173.869570:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e08602c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0c28cd8-555e-481f-bd03-c3b02aee51c5+15:5843:x1876946942175360:12345-0@lo:101: Request processed in 3913us (3962us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996173.869582:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789996173.870035:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fa90700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5843:1876946942175360:0@lo:101: 00010000:00010000:1.0:1789996173.870063:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.137@tcp lock: ffff8e0841525200/0x4173739f0fc80580 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc80587 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996173.870076:0:5843:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.137@tcp lock: ffff8e0841525200/0x4173739f0fc80580 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x4173739f0fc80587 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789996173.870146:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0849c74380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5843:1876946942175488:0@lo:501: 00000100:00100000:1.0:1789996173.870182:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996173.870217:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e08493a8240 going to sleep for 11 seconds 00000100:00100000:1.0:1789996173.870233:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942175488 00000100:00100000:1.0:1789996173.870239:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942175488 00000100:00100000:1.0:1789996173.870267:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789996173.870273:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e08602c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+15:5843:x1876946942175488:12345-0@lo:501: 00000100:00100000:1.0:1789996173.870512:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e08602c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+15:5843:x1876946942175488:12345-0@lo:501: Request processed in 238us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996173.870519:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789996173.870569:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0849c74380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5843:1876946942175488:0@lo:501: 00000100:00100000:1.0:1789996173.870593:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0849c74380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5843:1876946942175616:0@lo:503: 00000100:00100000:1.0:1789996173.870625:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996173.870649:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e08493a8240 going to sleep for 11 seconds 00000100:00100000:1.0:1789996173.870662:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942175616 00000100:00100000:1.0:1789996173.870666:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942175616 00000100:00100000:1.0:1789996173.871776:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789996173.871787:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e08602ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+15:5843:x1876946942175616:12345-0@lo:503: 00000100:00100000:1.0:1789996173.872177:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e08602ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+15:5843:x1876946942175616:12345-0@lo:503: Request processed in 392us (1551us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996173.872185:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789996173.872228:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0849c74380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5843:1876946942175616:0@lo:503: 00000100:00100000:1.0:1789996173.872410:0:7003:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0849c74380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0c28cd8-555e-481f-bd03-c3b02aee51c5:7003:1876946942175744:0@lo:502: 00000100:00100000:1.0:1789996173.876841:0:7003:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996173.877037:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942175744 00000100:00100000:1.0:1789996173.877050:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942175744 00000100:00100000:1.0:1789996173.877100:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789996173.877110:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e08602c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+15:7003:x1876946942175744:12345-0@lo:502: 00000100:00100000:1.0:1789996173.878046:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e08602c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+15:7003:x1876946942175744:12345-0@lo:502: Request processed in 934us (1205us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996173.878056:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789996173.878116:0:7003:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0848e42600 going to sleep for 11 seconds 00000100:00100000:1.0:1789996173.878139:0:7003:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0849c74380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0c28cd8-555e-481f-bd03-c3b02aee51c5:7003:1876946942175744:0@lo:502: 00000020:01000000:1.0:1789996173.878171:0:7003:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789996173.878179:0:7003:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1789996173.878186:0:7003:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789996173.878195:0:7003:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1789996173.878201:0:7003:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789996173.878205:0:7003:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.137@tcp to nid 0x20000c0a8cc89 (192.168.204.137@tcp) 00000020:01000000:1.0:1789996173.878226:0:7003:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1789996173.878230:0:7003:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789996173.878244:0:7003:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8e0849c799c0) 00000020:00000080:1.0:1789996173.878266:0:7003:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:1.0:1789996173.878271:0:7003:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789996173.878346:0:7003:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1789996173.878351:0:7003:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:1.0:1789996173.878358:0:7003:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4173739f0fc80595 00010000:00080000:1.0:1789996173.878386:0:7003:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e0847d07000@lustre-OST0000-osc-MDT0000: add connection 192.168.204.137@tcp at head 00010000:00010000:1.0:1789996173.882102:0:7003:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:0.0:1789996174.023710:0:7003:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1789996174.023736:0:7003:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1789996174.024302:0:7003:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789996174.026271:0:7003:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789996174.026339:0:7003:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:0.0:1789996174.026894:0:7003:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:2.0:1789996174.027431:0:7017:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789996174.027437:0:7017:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1789996174.028214:0:7003:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789996174.028225:0:7003:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1789996174.028256:0:7003:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1789996174.028278:0:7003:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4173739f0fc8059c 00000100:00080000:2.0:1789996174.028288:0:7003:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789996174.028299:0:7003:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8e0847d07000 using connection 192.168.204.137@tcp/0@lo 00000100:00100000:2.0:1789996174.028333:0:7003:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e086fa90e00 x1876946942175872/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789996174.028660:0:7003:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1789996174.028893:0:7003:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789996174.028898:0:7003:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789996174.028901:0:7003:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1789996174.028904:0:7003:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789996174.028909:0:7003:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789996174.028910:0:7003:0:(obd_config.c:1563:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789996174.028913:0:7003:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789996174.028915:0:7003:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1789996174.028946:0:7003:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fa90a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0c28cd8-555e-481f-bd03-c3b02aee51c5:7003:1876946942176000:0@lo:502: 00000100:00100000:2.0:1789996174.029030:0:7003:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996174.029086:0:7003:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0848652e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789996174.029173:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942176000 00000100:00100000:2.0:1789996174.029180:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942176000 00000100:00100000:2.0:1789996174.029219:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789996174.029228:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e08602c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0c28cd8-555e-481f-bd03-c3b02aee51c5+15:7003:x1876946942176000:12345-0@lo:502: 00000100:00100000:0.0:1789996174.031654:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fa90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3312:1876946942175872:0@lo:8: 00000100:00100000:0.0:1789996174.031751:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996174.031838:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942175872 00000100:00100000:0.0:1789996174.031845:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942175872 00000100:00100000:0.0:1789996174.031878:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789996174.031884:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e087993bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3312:x1876946942175872:12345-0@lo:8: 00010000:00080000:0.0:1789996174.031912:0:6688:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 215 last 0 00000020:00000080:0.0:1789996174.031941:0:6688:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4173739f0fc805a3 00002000:00100000:0.0:1789996174.031982:0:6688:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8e087f9e5800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a3f ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1789996174.031988:0:6688:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:0.0:1789996174.031991:0:6688:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:0.0:1789996174.032114:0:6688:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1789996174.032264:0:6688:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789996174.032289:0:6688:0:(import.c:65:import_set_state_nolock()) ffff8e087f9e1800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789996174.032339:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e087993bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3312:x1876946942175872:12345-0@lo:8: Request processed in 453us (588us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996174.032346:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1789996174.032392:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e086fa90e00 x1876946942175872/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789996184 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789996174.032402:0:3312:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00100000:2.0:1789996174.032606:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e08602c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0c28cd8-555e-481f-bd03-c3b02aee51c5+15:7003:x1876946942176000:12345-0@lo:502: Request processed in 3378us (3575us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996174.032615:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:0.0:1789996174.032741:0:3312:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1789996174.032750:0:3312:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1789996174.032756:0:3312:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1789996174.032759:0:3312:0:(import.c:65:import_set_state_nolock()) ffff8e0847d07000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1789996174.032769:0:3312:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1789996174.032774:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fa90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3312:1876946942175872:0@lo:8: 00000004:00080000:0.0:1789996174.032801:0:7017:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1789996174.032902:0:7017:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 215752358814ns, next at 0ns, rc = 0 00000100:00100000:2.0:1789996174.033491:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fa90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1876946942176256:0@lo:400: 00000100:00100000:2.0:1789996174.033570:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996174.033651:0:7003:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fa90a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0c28cd8-555e-481f-bd03-c3b02aee51c5:7003:1876946942176000:0@lo:502: 00000100:00100000:0.0:1789996174.033805:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942176256 00000100:00100000:0.0:1789996174.033811:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942176256 00000100:00100000:0.0:1789996174.033852:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789996174.033860:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fa93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876946942176256:12345-0@lo:400: 00000100:00100000:0.0:1789996174.033907:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fa93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876946942176256:12345-0@lo:400: Request processed in 47us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996174.033913:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1789996174.033945:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e086fa90700 x1876946942176256/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789996190 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789996174.033958:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fa90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1876946942176256:0@lo:400: 00000020:01000000:2.0:1789996174.034595:0:7003:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789996174.034603:0:7003:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789996174.034606:0:7003:0:(obd_config.c:1563:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:2.0:1789996174.034611:0:7003:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:0.0:1789996174.035100:0:5843:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:0.0:1789996174.035127:0:5843:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.137@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1789996174.035139:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.137@tcp lock: ffff8e0841525200/0x4173739f0fc80580 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc80587 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996174.035151:0:5843:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.137@tcp lock: ffff8e0841525200/0x4173739f0fc80580 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc80587 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789996174.035161:0:5843:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1789996174.035164:0:5843:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8e08545d19c0 from 1 10000000:01000000:0.0:1789996174.035167:0:5843:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789996174.035201:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.137@tcp lock: ffff8e0840030600/0x4173739f0fc805aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996174.035209:0:5843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.137@tcp lock: ffff8e0840030600/0x4173739f0fc805aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996174.035219:0:5843:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.137@tcp lock: ffff8e0840030600/0x4173739f0fc805aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789996174.035244:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0879938380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5843:1876946942176384:0@lo:101: 00000100:00100000:0.0:1789996174.035292:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996174.035337:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0842b84cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789996174.035398:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942176384 00000100:00100000:3.0:1789996174.035416:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942176384 00000100:00100000:3.0:1789996174.035459:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789996174.035468:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852bea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0c28cd8-555e-481f-bd03-c3b02aee51c5+15:5843:x1876946942176384:12345-0@lo:101: 00010000:00010000:3.0:1789996174.035478:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789996174.035492:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e08429c6a00/0x4173739f0fc805b1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4173739f0fc805aa expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996174.035516:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e08429c6a00/0x4173739f0fc805b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4173739f0fc805aa expref: 16 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996174.035527:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e08429c6a00/0x4173739f0fc805b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4173739f0fc805aa expref: 16 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996174.035535:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e08429c6a00, rc 0) 00000100:00100000:3.0:1789996174.035603:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852bea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0c28cd8-555e-481f-bd03-c3b02aee51c5+16:5843:x1876946942176384:12345-0@lo:101: Request processed in 136us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996174.035610:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789996174.035821:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0879938380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5843:1876946942176384:0@lo:101: 00010000:00010000:0.0:1789996174.035836:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.137@tcp lock: ffff8e0840030600/0x4173739f0fc805aa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc805b1 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996174.035846:0:5843:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.137@tcp lock: ffff8e0840030600/0x4173739f0fc805aa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x4173739f0fc805b1 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789996174.035893:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0879938380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5843:1876946942176512:0@lo:501: 00000100:00100000:0.0:1789996174.035919:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996174.035946:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0842b84cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789996174.036205:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942176512 00000100:00100000:2.0:1789996174.036210:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942176512 00000100:00100000:2.0:1789996174.036231:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789996174.036238:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852beb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0c28cd8-555e-481f-bd03-c3b02aee51c5+16:5843:x1876946942176512:12345-0@lo:501: 00000100:00100000:2.0:1789996174.036481:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852beb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0c28cd8-555e-481f-bd03-c3b02aee51c5+16:5843:x1876946942176512:12345-0@lo:501: Request processed in 242us (560us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789996174.036489:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789996174.036637:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0879938380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5843:1876946942176512:0@lo:501: 10000000:01000000:0.0:1789996174.036661:0:5843:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.137@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1789996174.036667:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.137@tcp lock: ffff8e0840030600/0x4173739f0fc805aa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc805b1 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996174.036687:0:5843:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.137@tcp lock: ffff8e0840030600/0x4173739f0fc805aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc805b1 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789996174.036836:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789996174.036847:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fa92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876946942176128:0@lo:400: 00000100:00100000:2.0:1789996174.036878:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996174.036953:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942176128 00000100:00100000:0.0:1789996174.036958:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942176128 00000100:00100000:0.0:1789996174.036995:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789996174.037003:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fa90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876946942176128:12345-0@lo:400: 00000100:00100000:0.0:1789996174.037039:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fa90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876946942176128:12345-0@lo:400: Request processed in 37us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996174.037054:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1789996174.040949:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e086fa92680 x1876946942176128/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789996190 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789996174.040987:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fa92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876946942176128:0@lo:400: 00000100:00080000:1.0:1789996174.041198:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:2.0:1789996174.096926:0:5868:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:0.0:1789996174.102958:0:7018:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:0.0:1789996174.102994:0:7018:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e087993aa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7018:1876946942176768:0@lo:7: 00000100:00100000:0.0:1789996174.103061:0:7018:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996174.103114:0:7018:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0844df9b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789996174.103170:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789996174.103183:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0879938380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876946942176640:0@lo:13: 00000100:00100000:3.0:1789996174.103217:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996174.103337:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942176640 00000100:00100000:0.0:1789996174.103344:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942176640 00000100:00100000:3.0:1789996174.103511:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789996174.103523:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fa71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3315:x1876946942176640:12345-0@lo:13: 00002000:00000024:3.0:1789996174.103589:0:6692:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:3.0:1789996174.103647:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fa71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3315:x1876946942176640:12345-0@lo:13: Request processed in 125us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996174.103655:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1789996174.103874:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e0879938380 x1876946942176640/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789996190 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789996174.103893:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0879938380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876946942176640:0@lo:13: 00000100:00080000:1.0:1789996174.104118:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789996174.104211:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942176768 00000100:00100000:3.0:1789996174.104217:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942176768 00000100:00100000:3.0:1789996174.104261:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789996174.104268:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0879939180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7018:x1876946942176768:12345-0@lo:7: 00002000:00080000:3.0:1789996174.123201:0:6690:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:3.0:1789996174.123210:0:6690:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:3.0:1789996174.126340:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0879939180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7018:x1876946942176768:12345-0@lo:7: Request processed in 22049us (23256us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996174.126359:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789996174.129184:0:7018:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e087993aa00 x1876946942176768/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789996190 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789996174.129205:0:7018:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e087993aa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7018:1876946942176768:0@lo:7: 00000004:00080000:0.0:1789996174.129220:0:7018:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:1.0:1789996174.129468:0:7018:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0849c74380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7018:1876946942176896:0@lo:5: 00000100:00100000:1.0:1789996174.129823:0:7018:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996174.129872:0:7018:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e08493a8240 going to sleep for 11 seconds 00000100:00100000:0.0:1789996174.130006:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942176896 00000100:00100000:0.0:1789996174.130014:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942176896 00000100:00100000:0.0:1789996174.130077:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789996174.130087:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0849c77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7018:x1876946942176896:12345-0@lo:5: 00002000:00080000:0.0:1789996174.130115:0:6689:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1789996174.130119:0:6689:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00010000:00080000:2.0:1789996174.130645:0:7018:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e0849c74380 x1876946942176896/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789996190 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789996174.130658:0:7018:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0849c74380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7018:1876946942176896:0@lo:5: 00000004:00080000:2.0:1789996174.130680:0:7018:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:2.0:1789996174.130719:0:7018:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fa92680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7018:1876946942177024:0@lo:700: 00000100:00100000:2.0:1789996174.130748:0:7018:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996174.130774:0:7018:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e08581e1300 going to sleep for 11 seconds 00000100:00100000:3.0:1789996174.130881:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942177024 00000100:00100000:3.0:1789996174.130887:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942177024 00000100:00100000:3.0:1789996174.130919:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789996174.130927:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fa91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+8:7018:x1876946942177024:12345-0@lo:700: 00000100:00100000:3.0:1789996174.130958:0:6696:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fa73800 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6696:1876946942177152:0@lo:700: 00000100:00100000:3.0:1789996174.130991:0:6696:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789996174.131017:0:6696:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e08798249c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789996174.131068:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0849c77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:7018:x1876946942176896:12345-0@lo:5: Request processed in 391us (935us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1789996174.131076:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789996174.131167:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942177152 00000100:00100000:2.0:1789996174.131172:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942177152 00000100:00100000:2.0:1789996174.131204:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789996174.131210:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fa70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6696:x1876946942177152:12345-0@lo:700: 40000000:02000000:2.0:1789996174.219536:0:5853:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:2.0:1789996174.234474:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fa70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6696:x1876946942177152:12345-0@lo:700: Request processed in 103254us (103472us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996174.234488:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1789996174.238540:0:6696:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e086fa73800 x1876946942177152/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789996190 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789996174.238585:0:6696:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fa73800 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6696:1876946942177152:0@lo:700: 40000000:02000000:3.0:1789996174.238603:0:6696:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000100:00100000:3.0:1789996174.321462:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fa91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7018:x1876946942177024:12345-0@lo:700: Request processed in 190526us (190704us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996174.321477:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000001:00080000:3.0:1789996174.321513:0:6715:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:3.0:1789996174.321523:0:6715:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00080000:2.0:1789996174.321727:0:7018:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e086fa92680 x1876946942177024/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789996190 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789996174.321743:0:7018:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fa92680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7018:1876946942177024:0@lo:700: 00000004:02000040:2.0:1789996174.374042:0:7018:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:2.0:1789996174.381200:0:7018:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fa92680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7018:1876946942177280:0@lo:5: 00000100:00100000:2.0:1789996174.381268:0:7018:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996174.384373:0:7018:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e08581e1b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789996174.387580:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942177280 00000100:00100000:3.0:1789996174.387596:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942177280 00000100:00100000:3.0:1789996174.387673:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789996174.387685:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fa91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:7018:x1876946942177280:12345-0@lo:5: 00002000:00080000:3.0:1789996174.397074:0:6690:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:3.0:1789996174.397099:0:6690:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:3.0:1789996174.415521:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fa91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7018:x1876946942177280:12345-0@lo:5: Request processed in 27828us (34243us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1789996174.415535:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1789996174.417364:0:7018:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e086fa92680 x1876946942177280/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789996190 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789996174.417381:0:7018:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1789996174.417397:0:7018:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff8e086fa92680 x1876946942177280/t4294967298(4294967298) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789996190 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789996174.417408:0:7018:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fa92680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7018:1876946942177280:0@lo:5: 00000004:00080000:2.0:1789996174.417422:0:7018:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00000001:02000400:0.0:1789996174.696139:0:7061:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg437-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1789996174.696727:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789996175.724428:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789996176.748855:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789996177.771169:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789996178.794181:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789996179.432821:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fa91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e0c28cd8-555e-481f-bd03-c3b02aee51c5:3313:1876946942177408:0@lo:400: 00000100:00100000:2.0:1789996179.432832:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fa93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876946942177536:0@lo:400: 00000100:00100000:0.0:1789996179.438109:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fa91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876946942177792:0@lo:400: 00000100:00100000:1.0:1789996179.440654:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fa90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1876946942177664:0@lo:400: 00000100:00100000:2.0:1789996179.442302:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996179.442375:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789996179.442387:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e087993aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876946942177920:0@lo:13: 00000100:00100000:2.0:1789996179.442431:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996179.442466:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942177920 00000100:00100000:2.0:1789996179.442474:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942177920 00000100:00100000:2.0:1789996179.442540:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789996179.442563:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fa90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1876946942177920:12345-0@lo:13: 00000100:00100000:3.0:1789996179.442597:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942177536 00000100:00100000:3.0:1789996179.442602:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942177536 00002000:00000024:2.0:1789996179.442603:0:6692:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789996179.442639:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789996179.442645:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fa90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876946942177536:12345-0@lo:400: 00000100:00100000:2.0:1789996179.442650:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fa90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1876946942177920:12345-0@lo:13: Request processed in 89us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996179.442656:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789996179.442676:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fa90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876946942177536:12345-0@lo:400: Request processed in 32us (384us total) trans 0 rc 0/0 00000100:00080000:2.0:1789996179.442677:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789996179.442682:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1789996179.442712:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e087993aa00 x1876946942177920/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789996195 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789996179.442733:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e087993aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876946942177920:0@lo:13: 00010000:00080000:2.0:1789996179.442757:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e086fa93100 x1876946942177536/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789996195 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789996179.442780:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fa93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876946942177536:0@lo:400: 00000100:00100000:0.0:1789996179.443564:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996179.443907:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996179.447563:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942177792 00000100:00100000:2.0:1789996179.447581:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942177792 00000100:00100000:2.0:1789996179.447651:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789996179.447662:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e087993b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3316:x1876946942177792:12345-0@lo:400: 00000100:00100000:2.0:1789996179.447769:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e087993b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3316:x1876946942177792:12345-0@lo:400: Request processed in 98us (4220us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996179.447775:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789996179.447802:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942177408 00000100:00100000:2.0:1789996179.447805:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942177408 00000100:00100000:2.0:1789996179.447833:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789996179.447839:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852be9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0c28cd8-555e-481f-bd03-c3b02aee51c5+16:3313:x1876946942177408:12345-0@lo:400: 00000100:00100000:2.0:1789996179.447961:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852be9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0c28cd8-555e-481f-bd03-c3b02aee51c5+16:3313:x1876946942177408:12345-0@lo:400: Request processed in 121us (4053us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996179.447968:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00010000:00080000:0.0:1789996179.448394:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e086fa91880 x1876946942177792/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789996195 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789996179.448442:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fa91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876946942177792:0@lo:400: 00000100:00100000:0.0:1789996179.459205:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fa91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e0c28cd8-555e-481f-bd03-c3b02aee51c5:3313:1876946942177408:0@lo:400: 00000100:00100000:0.0:1789996179.459294:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996179.459334:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942177664 00000100:00100000:0.0:1789996179.459343:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942177664 00000100:00100000:0.0:1789996179.459396:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789996179.459717:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0879939500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876946942177664:12345-0@lo:400: 00000100:00100000:0.0:1789996179.460113:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0879939500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876946942177664:12345-0@lo:400: Request processed in 708us (819us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996179.460122:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:0.0:1789996179.460173:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e086fa90000 x1876946942177664/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789996195 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789996179.460186:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fa90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1876946942177664:0@lo:400: 00000100:00080000:2.0:1789996179.464036:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:3.0:1789996179.563772:0:6715:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:3.0:1789996179.818872:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789996180.841710:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789996181.864721:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789996182.892360:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789996183.912686:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789996184.553910:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fa73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e0c28cd8-555e-481f-bd03-c3b02aee51c5:3314:1876946942178048:0@lo:400: 00000100:00100000:3.0:1789996184.553988:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789996184.554061:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fa71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876946942178560:0@lo:400: 00000100:00100000:3.0:1789996184.554102:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789996184.554131:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789996184.554140:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0849c76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876946942178304:0@lo:13: 00000100:00100000:3.0:1789996184.554166:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789996184.554194:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fa70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876946942178176:0@lo:400: 00000100:00100000:3.0:1789996184.554222:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789996184.554245:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789996184.554252:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fa72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1876946942178432:0@lo:400: 00000100:00100000:3.0:1789996184.554275:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789996184.554320:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942178560 00000100:00100000:3.0:1789996184.554329:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942178560 00000100:00100000:3.0:1789996184.554399:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789996184.554411:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fa70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1876946942178560:12345-0@lo:400: 00000100:00100000:3.0:1789996184.554482:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fa70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1876946942178560:12345-0@lo:400: Request processed in 74us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996184.554489:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789996184.554513:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942178304 00000100:00100000:3.0:1789996184.554517:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942178304 00000100:00100000:3.0:1789996184.554569:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789996184.554577:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fa70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876946942178304:12345-0@lo:13: 00002000:00000024:3.0:1789996184.554605:0:6692:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789996184.554632:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fa70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876946942178304:12345-0@lo:13: Request processed in 57us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996184.554648:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789996184.554669:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942178176 00000100:00100000:3.0:1789996184.554674:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942178176 00000100:00100000:3.0:1789996184.554904:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942178432 00000100:00100000:3.0:1789996184.554908:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942178432 00000100:00100000:3.0:1789996184.554931:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789996184.554939:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fa72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876946942178176:12345-0@lo:400: 00000100:00100000:3.0:1789996184.554984:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fa72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876946942178176:12345-0@lo:400: Request processed in 46us (760us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996184.554989:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789996184.555002:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789996184.555009:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fa71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876946942178432:12345-0@lo:400: 00000100:00100000:3.0:1789996184.555039:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fa71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876946942178432:12345-0@lo:400: Request processed in 32us (763us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996184.555046:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:3.0:1789996184.555130:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789996184.555135:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789996184.555174:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e086fa72680 x1876946942178432/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789996200 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789996184.555192:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fa72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1876946942178432:0@lo:400: 00010000:00080000:3.0:1789996184.555205:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e086fa70a80 x1876946942178176/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789996200 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789996184.555213:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fa70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876946942178176:0@lo:400: 00010000:00080000:3.0:1789996184.555252:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e0849c76a00 x1876946942178304/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789996200 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789996184.555260:0:3314:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1789996184.555286:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0849c76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876946942178304:0@lo:13: 00010000:00080000:3.0:1789996184.555298:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e086fa71880 x1876946942178560/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789996200 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789996184.555306:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fa71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876946942178560:0@lo:400: 00000100:00100000:1.0:1789996184.556828:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942178048 00000100:00100000:1.0:1789996184.556843:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942178048 00000100:00100000:1.0:1789996184.556895:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789996184.556906:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852bea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+16:3314:x1876946942178048:12345-0@lo:400: 00000100:00100000:1.0:1789996184.556982:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852bea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+16:3314:x1876946942178048:12345-0@lo:400: Request processed in 80us (2994us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996184.557000:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789996184.557953:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fa73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e0c28cd8-555e-481f-bd03-c3b02aee51c5:3314:1876946942178048:0@lo:400: 00010000:00010000:1.0:1789996184.937741:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789996185.960760:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1789996186.300314:0:7642:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1789996186.300318:0:7642:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:0.0:1789996186.300707:0:7642:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8e0847d01800 00000020:01000004:0.0:1789996186.300723:0:7642:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:0.0:1789996186.300734:0:7642:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:0.0:1789996186.300755:0:7642:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8e087f8c3380) 00000020:00000080:0.0:1789996186.300774:0:7642:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1789996186.335175:0:7642:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1789996186.337398:0:7642:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1789996186.366102:0:7642:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1789996186.373677:0:7642:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1789996186.373708:0:7642:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1789996186.373762:0:7642:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1789996186.373785:0:7642:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1789996186.374122:0:7642:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1789996186.374139:0:7642:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789996186.374150:0:7642:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x4173739f0fc805bf 00000020:01000004:2.0:1789996186.374159:0:7642:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1789996186.374181:0:7642:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.137@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1789996186.374185:0:7642:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.137@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1789996186.374191:0:7642:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1789996186.374214:0:7642:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1789996186.374218:0:7642:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.137@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1789996186.404088:0:7642:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.137@tcp ctxt 0 is initialized 00000020:01000004:3.0:1789996186.404124:0:7642:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.137@tcp, index=0001, flags=0x20062 00000020:01000004:3.0:1789996186.404128:0:7642:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1789996186.404130:0:7642:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789996186.404131:0:7642:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789996186.404133:0:7642:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789996186.404134:0:7642:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789996186.404136:0:7642:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789996186.404137:0:7642:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789996186.404139:0:7642:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789996186.404141:0:7642:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789996186.404143:0:7642:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789996186.404144:0:7642:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789996186.404147:0:7642:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:3.0:1789996186.404150:0:7642:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789996186.404151:0:7642:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789996186.404152:0:7642:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789996186.404153:0:7642:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789996186.404154:0:7642:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789996186.404155:0:7642:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789996186.404156:0:7642:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789996186.404157:0:7642:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789996186.404158:0:7642:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789996186.404159:0:7642:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789996186.404160:0:7642:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789996186.404185:0:7642:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1789996186.404202:0:7642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fa73800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0c28cd8-555e-481f-bd03-c3b02aee51c5:7642:1876946942178688:0@lo:253: 00000100:00100000:3.0:1789996186.404280:0:7642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789996186.404346:0:7642:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e087f860780 going to sleep for 11 seconds 00000100:00100000:2.0:1789996186.404656:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942178688 00000100:00100000:2.0:1789996186.404665:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942178688 00000100:00100000:2.0:1789996186.404716:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789996186.404725:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852be8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0c28cd8-555e-481f-bd03-c3b02aee51c5+16:7642:x1876946942178688:12345-0@lo:253: 20000000:01000000:2.0:1789996186.404753:0:5840:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1789996186.404757:0:5840:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:2.0:1789996186.404762:0:5840:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:2.0:1789996186.404765:0:5840:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:0.0:1789996186.415333:0:5840:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789996186.416824:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:0.0:1789996186.416849:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:0.0:1789996186.416924:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:0.0:1789996186.416933:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:0.0:1789996186.416965:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:0.0:1789996186.417017:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:0.0:1789996186.417434:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:0.0:1789996186.417454:0:5840:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.137@tcp 20000000:01000000:0.0:1789996186.417463:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.137@tcp (null) (null) (null) 00000040:00080000:0.0:1789996186.417498:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:0.0:1789996186.417506:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1789996186.419619:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:1.0:1789996186.419643:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.204.137@tcp (null) (null) 00000040:00080000:1.0:1789996186.419719:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:1.0:1789996186.419731:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1789996186.419763:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:1.0:1789996186.419823:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:1.0:1789996186.420653:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:1.0:1789996186.420676:0:5840:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.137@tcp 20000000:01000000:1.0:1789996186.420678:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.137@tcp (null) (null) (null) 00000040:00080000:1.0:1789996186.420713:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:1.0:1789996186.420721:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1789996186.420752:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:1.0:1789996186.420760:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.204.137@tcp (null) (null) 00000040:00080000:1.0:1789996186.420793:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:1.0:1789996186.420801:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1789996186.420874:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:1.0:1789996186.420911:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:1.0:1789996186.420927:0:5840:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:1.0:1789996186.420930:0:5840:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:1.0:1789996186.420936:0:5840:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:1.0:1789996186.420938:0:5840:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1789996186.420940:0:5840:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1789996186.420952:0:5840:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1789996186.420955:0:5840:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1789996186.420990:0:5840:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1789996186.420993:0:5840:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1789996186.428047:0:7645:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 14 1->4: lustre sys.timeout 20000000:01000000:3.0:1789996186.428160:0:7645:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 14 2->4: lustre sys.timeout 00000040:00080000:3.0:1789996186.428196:0:7645:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:1.0:1789996186.431987:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:1.0:1789996186.432045:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:1.0:1789996186.432131:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:1.0:1789996186.432147:0:5840:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1789996186.432150:0:5840:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1789996186.433059:0:7646:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 15 1->4: lustre sys.timeout 20000000:01000000:3.0:1789996186.433115:0:7646:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 15 2->4: lustre sys.timeout 00000040:00080000:3.0:1789996186.433171:0:7646:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:1.0:1789996186.433576:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:1.0:1789996186.433620:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:1.0:1789996186.433656:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:1.0:1789996186.433667:0:5840:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1789996186.433669:0:5840:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1789996186.434381:0:7647:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 16 1->4: lustre sys.timeout 20000000:01000000:3.0:1789996186.434463:0:7647:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 16 2->4: lustre sys.timeout 00000040:00080000:3.0:1789996186.434522:0:7647:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:2.0:1789996186.434793:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:2.0:1789996186.434829:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:2.0:1789996186.434896:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:2.0:1789996186.434910:0:5840:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1789996186.434913:0:5840:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:2.0:1789996186.436106:0:7648:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:3.0:1789996186.436466:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:3.0:1789996186.436515:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:3.0:1789996186.436615:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 10000000:01000000:3.0:1789996186.436638:0:5840:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1789996186.436657:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e08429c6600/0x4173739f0fc805c6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996186.436676:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e08429c6000/0x4173739f0fc80517 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4173739f0fc80510 expref: 16 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996186.436685:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e08413f0000/0x4173739f0fc80541 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4173739f0fc8053a expref: 16 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996186.436692:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e0841524e00/0x4173739f0fc8056b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4173739f0fc80564 expref: 16 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996186.436698:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e0841525e00/0x4173739f0fc80587 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4173739f0fc80580 expref: 16 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996186.436705:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e08429c6a00/0x4173739f0fc805b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4173739f0fc805aa expref: 16 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996186.436721:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8e08429c6600/0x4173739f0fc805c6 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996186.436757:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e08429c6a00/0x4173739f0fc805b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4173739f0fc805aa expref: 16 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996186.436771:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e08429c6a00/0x4173739f0fc805b1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4173739f0fc805aa expref: 16 pid: 5840 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789996186.436785:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fa71880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5840:1876946942178816:0@lo:104: 00000100:00100000:3.0:1789996186.436848:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789996186.436894:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e0841525e00/0x4173739f0fc80587 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4173739f0fc80580 expref: 16 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996186.436902:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e0841525e00/0x4173739f0fc80587 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4173739f0fc80580 expref: 16 pid: 5841 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789996186.436911:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fa70a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5840:1876946942178944:0@lo:104: 00010000:00010000:3.0:1789996186.436949:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e0841524e00/0x4173739f0fc8056b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4173739f0fc80564 expref: 16 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996186.436957:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e0841524e00/0x4173739f0fc8056b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4173739f0fc80564 expref: 16 pid: 5840 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789996186.436965:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fa72680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5840:1876946942179072:0@lo:104: 00010000:00010000:3.0:1789996186.436987:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e08413f0000/0x4173739f0fc80541 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4173739f0fc8053a expref: 16 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996186.436995:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e08413f0000/0x4173739f0fc80541 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4173739f0fc8053a expref: 16 pid: 5840 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789996186.437011:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fa73480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5840:1876946942179200:0@lo:104: 00010000:00010000:3.0:1789996186.437035:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e08429c6000/0x4173739f0fc80517 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4173739f0fc80510 expref: 16 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996186.437043:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e08429c6000/0x4173739f0fc80517 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4173739f0fc80510 expref: 16 pid: 5841 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789996186.437051:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fa72a00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5840:1876946942179328:0@lo:104: 00000100:00100000:3.0:1789996186.437078:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e087f860180 going to sleep for 11 seconds 00000100:00100000:2.0:1789996186.437285:0:5829:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1789996186.437305:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996186.437323:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996186.437332:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996186.437340:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996186.437353:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942178816 00000100:00100000:2.0:1789996186.437360:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942178816 00000100:00100000:2.0:1789996186.437403:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942178944 00000100:00100000:2.0:1789996186.437406:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942178944 00000100:00100000:2.0:1789996186.437417:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942179072 00000100:00100000:2.0:1789996186.437439:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942179072 00000100:00100000:2.0:1789996186.437455:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942179200 00000100:00100000:2.0:1789996186.437458:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942179200 00000100:00100000:2.0:1789996186.437467:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942179328 00000100:00100000:2.0:1789996186.437469:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942179328 00000100:00100000:2.0:1789996186.437482:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789996186.437490:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e08704d2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+7:5840:x1876946942178816:12345-0@lo:104: 00010000:00010000:2.0:1789996186.437502:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.137@tcp lock: ffff8e0840030600/0x4173739f0fc805aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x4173739f0fc805b1 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996186.437581:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789996186.437588:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e08704d2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+7:5840:x1876946942178816:12345-0@lo:104: Request processed in 99us (741us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996186.437594:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789996186.437630:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789996186.437637:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fa93100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+6:5840:x1876946942178944:12345-0@lo:104: 00010000:00010000:2.0:1789996186.437644:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.137@tcp lock: ffff8e0841525200/0x4173739f0fc80580 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x4173739f0fc80587 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996186.437676:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789996186.437681:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fa93100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+6:5840:x1876946942178944:12345-0@lo:104: Request processed in 45us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996186.437686:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789996186.437698:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789996186.437704:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fa92680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+5:5840:x1876946942179072:12345-0@lo:104: 00010000:00010000:2.0:1789996186.437711:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.137@tcp lock: ffff8e0840030400/0x4173739f0fc80564 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x4173739f0fc8056b expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996186.437736:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1789996186.437747:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fa92680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+5:5840:x1876946942179072:12345-0@lo:104: Request processed in 43us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996186.437754:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789996186.437766:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789996186.437772:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fa90000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+4:5840:x1876946942179200:12345-0@lo:104: 00010000:00010000:2.0:1789996186.437779:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.137@tcp lock: ffff8e0841524000/0x4173739f0fc8053a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x4173739f0fc80541 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996186.437806:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1789996186.437811:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fa90000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+4:5840:x1876946942179200:12345-0@lo:104: Request processed in 40us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996186.437816:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789996186.437827:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789996186.437834:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fa91500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+3:5840:x1876946942179328:12345-0@lo:104: 00010000:00010000:2.0:1789996186.437841:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.137@tcp lock: ffff8e0841524a00/0x4173739f0fc80510 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x4173739f0fc80517 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996186.437866:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:2.0:1789996186.437871:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fa91500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+3:5840:x1876946942179328:12345-0@lo:104: Request processed in 39us (530us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996186.437877:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:1.0:1789996186.438305:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1789996186.438313:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.137@tcp lock: ffff8e0840030600/0x4173739f0fc805aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x4173739f0fc805b1 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996186.438321:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0840030600 already unused, calling callback (ffffffffc1be0c20) 10000000:00010000:1.0:1789996186.438325:0:5835:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.137@tcp lock: ffff8e0840030600/0x4173739f0fc805aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x4173739f0fc805b1 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996186.438333:0:5835:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.137@tcp lock: ffff8e0840030600/0x4173739f0fc805aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x4173739f0fc805b1 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789996186.438340:0:5835:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.137@tcp lock: ffff8e0840030600/0x4173739f0fc805aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x4173739f0fc805b1 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789996186.438346:0:5835:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789996186.438393:0:5835:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.137@tcp lock: ffff8e0840030600/0x4173739f0fc805aa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4173739f0fc805b1 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996186.438400:0:5835:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789996186.438437:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.137@tcp lock: ffff8e0840030600/0x4173739f0fc805aa lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4173739f0fc805b1 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996186.438445:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.137@tcp lock: ffff8e0840030600/0x4173739f0fc805aa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4173739f0fc805b1 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996186.438468:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1789996186.438472:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.137@tcp lock: ffff8e0841525200/0x4173739f0fc80580 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4173739f0fc80587 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996186.438477:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0841525200 already unused, calling callback (ffffffffc1be0c20) 10000000:00010000:1.0:1789996186.438480:0:5835:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.137@tcp lock: ffff8e0841525200/0x4173739f0fc80580 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x4173739f0fc80587 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996186.438487:0:5835:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.137@tcp lock: ffff8e0841525200/0x4173739f0fc80580 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x4173739f0fc80587 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789996186.438494:0:5835:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.137@tcp lock: ffff8e0841525200/0x4173739f0fc80580 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x4173739f0fc80587 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789996186.438500:0:5835:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789996186.438514:0:5835:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.137@tcp lock: ffff8e0841525200/0x4173739f0fc80580 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4173739f0fc80587 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996186.438520:0:5835:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789996186.438526:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.137@tcp lock: ffff8e0841525200/0x4173739f0fc80580 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4173739f0fc80587 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996186.438532:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.137@tcp lock: ffff8e0841525200/0x4173739f0fc80580 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4173739f0fc80587 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996186.438572:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789996186.438576:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.137@tcp lock: ffff8e0840030400/0x4173739f0fc80564 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4173739f0fc8056b expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996186.438592:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0840030400 already unused, calling callback (ffffffffc1be0c20) 10000000:00010000:1.0:1789996186.438595:0:5835:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.137@tcp lock: ffff8e0840030400/0x4173739f0fc80564 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x4173739f0fc8056b expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996186.438602:0:5835:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.137@tcp lock: ffff8e0840030400/0x4173739f0fc80564 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x4173739f0fc8056b expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789996186.438608:0:5835:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.137@tcp lock: ffff8e0840030400/0x4173739f0fc80564 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x4173739f0fc8056b expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789996186.438613:0:5835:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789996186.438627:0:5835:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.137@tcp lock: ffff8e0840030400/0x4173739f0fc80564 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4173739f0fc8056b expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996186.438633:0:5835:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789996186.438650:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.137@tcp lock: ffff8e0840030400/0x4173739f0fc80564 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4173739f0fc8056b expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996186.438656:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.137@tcp lock: ffff8e0840030400/0x4173739f0fc80564 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4173739f0fc8056b expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996186.438665:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789996186.438668:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.137@tcp lock: ffff8e0841524000/0x4173739f0fc8053a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4173739f0fc80541 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996186.438673:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0841524000 already unused, calling callback (ffffffffc1be0c20) 10000000:00010000:1.0:1789996186.438676:0:5835:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.137@tcp lock: ffff8e0841524000/0x4173739f0fc8053a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x4173739f0fc80541 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996186.438691:0:5835:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.137@tcp lock: ffff8e0841524000/0x4173739f0fc8053a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x4173739f0fc80541 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789996186.438698:0:5835:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.137@tcp lock: ffff8e0841524000/0x4173739f0fc8053a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x4173739f0fc80541 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789996186.438704:0:5835:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789996186.438716:0:5835:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.137@tcp lock: ffff8e0841524000/0x4173739f0fc8053a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4173739f0fc80541 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996186.438721:0:5835:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789996186.438725:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.137@tcp lock: ffff8e0841524000/0x4173739f0fc8053a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4173739f0fc80541 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996186.438731:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.137@tcp lock: ffff8e0841524000/0x4173739f0fc8053a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4173739f0fc80541 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996186.438739:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789996186.438741:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.137@tcp lock: ffff8e0841524a00/0x4173739f0fc80510 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4173739f0fc80517 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996186.438746:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0841524a00 already unused, calling callback (ffffffffc1be0c20) 10000000:00010000:1.0:1789996186.438749:0:5835:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.137@tcp lock: ffff8e0841524a00/0x4173739f0fc80510 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4173739f0fc80517 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996186.438754:0:5835:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.137@tcp lock: ffff8e0841524a00/0x4173739f0fc80510 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4173739f0fc80517 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789996186.438760:0:5835:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.137@tcp lock: ffff8e0841524a00/0x4173739f0fc80510 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4173739f0fc80517 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789996186.438770:0:5835:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789996186.438780:0:5835:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.137@tcp lock: ffff8e0841524a00/0x4173739f0fc80510 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4173739f0fc80517 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996186.438784:0:5835:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789996186.438788:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.137@tcp lock: ffff8e0841524a00/0x4173739f0fc80510 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4173739f0fc80517 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996186.438793:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.137@tcp lock: ffff8e0841524a00/0x4173739f0fc80510 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4173739f0fc80517 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996186.438816:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789996186.438817:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789996186.438819:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789996186.438825:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789996186.438837:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0849c76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e0c28cd8-555e-481f-bd03-c3b02aee51c5:3316:1876946942179584:0@lo:103: 00000100:00100000:1.0:1789996186.438876:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996186.438911:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1789996186.438916:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0849c75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e0c28cd8-555e-481f-bd03-c3b02aee51c5:3316:1876946942179456:0@lo:103: 00000100:00100000:1.0:1789996186.439024:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996186.439043:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0849c74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e0c28cd8-555e-481f-bd03-c3b02aee51c5:3316:1876946942179968:0@lo:103: 00000100:00100000:1.0:1789996186.439063:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996186.439088:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0849c74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e0c28cd8-555e-481f-bd03-c3b02aee51c5:3313:1876946942179712:0@lo:103: 00000100:00100000:1.0:1789996186.439108:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996186.439120:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789996186.439124:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0849c75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e0c28cd8-555e-481f-bd03-c3b02aee51c5:3313:1876946942179840:0@lo:103: 00000100:00100000:1.0:1789996186.439140:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996186.439175:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942179584 00000100:00100000:1.0:1789996186.439181:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942179584 00010000:00010000:1.0:1789996186.439201:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e0841525e00/0x4173739f0fc80587 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4173739f0fc80580 expref: 17 pid: 5841 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789996186.439218:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942179456 00000100:00100000:1.0:1789996186.439220:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942179456 00010000:00010000:1.0:1789996186.439231:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e08429c6a00/0x4173739f0fc805b1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4173739f0fc805aa expref: 18 pid: 5840 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789996186.439240:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942179968 00000100:00100000:1.0:1789996186.439243:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942179968 00010000:00010000:1.0:1789996186.439251:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e08429c6000/0x4173739f0fc80517 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4173739f0fc80510 expref: 19 pid: 5841 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789996186.439261:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942179712 00000100:00100000:1.0:1789996186.439263:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942179712 00010000:00010000:1.0:1789996186.439271:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e0841524e00/0x4173739f0fc8056b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4173739f0fc80564 expref: 20 pid: 5840 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789996186.439280:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942179840 00000100:00100000:1.0:1789996186.439282:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942179840 00010000:00010000:1.0:1789996186.439292:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e08413f0000/0x4173739f0fc80541 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4173739f0fc8053a expref: 21 pid: 5840 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789996186.439304:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789996186.439310:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0849c74a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e0c28cd8-555e-481f-bd03-c3b02aee51c5+21:3316:x1876946942179584:12345-0@lo:103: 00010000:00010000:1.0:1789996186.439320:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789996186.439325:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e0841525e00/0x4173739f0fc80587 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4173739f0fc80580 expref: 21 pid: 5841 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996186.439334:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e0841525e00/0x4173739f0fc80587 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4173739f0fc80580 expref: 21 pid: 5841 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996186.439355:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789996186.439398:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0849c74a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e0c28cd8-555e-481f-bd03-c3b02aee51c5+21:3316:x1876946942179584:12345-0@lo:103: Request processed in 87us (521us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996186.439404:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789996186.439420:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789996186.439426:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0849c75f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e0c28cd8-555e-481f-bd03-c3b02aee51c5+20:3316:x1876946942179456:12345-0@lo:103: 00010000:00010000:1.0:1789996186.439433:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789996186.439438:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e08429c6a00/0x4173739f0fc805b1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4173739f0fc805aa expref: 20 pid: 5840 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996186.439447:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e08429c6a00/0x4173739f0fc805b1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4173739f0fc805aa expref: 20 pid: 5840 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996186.439457:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789996186.439478:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0849c75f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e0c28cd8-555e-481f-bd03-c3b02aee51c5+20:3316:x1876946942179456:12345-0@lo:103: Request processed in 53us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996186.439484:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789996186.439496:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789996186.439502:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0849c74700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e0c28cd8-555e-481f-bd03-c3b02aee51c5+19:3316:x1876946942179968:12345-0@lo:103: 00010000:00010000:1.0:1789996186.439509:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789996186.439513:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e08429c6000/0x4173739f0fc80517 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4173739f0fc80510 expref: 19 pid: 5841 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996186.439521:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e08429c6000/0x4173739f0fc80517 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4173739f0fc80510 expref: 19 pid: 5841 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996186.439530:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789996186.439572:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0849c74700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e0c28cd8-555e-481f-bd03-c3b02aee51c5+19:3316:x1876946942179968:12345-0@lo:103: Request processed in 70us (508us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996186.439584:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789996186.439597:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789996186.439604:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0849c76d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e0c28cd8-555e-481f-bd03-c3b02aee51c5+18:3313:x1876946942179712:12345-0@lo:103: 00010000:00010000:1.0:1789996186.439610:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789996186.439615:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e0841524e00/0x4173739f0fc8056b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4173739f0fc80564 expref: 18 pid: 5840 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996186.439623:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e0841524e00/0x4173739f0fc8056b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4173739f0fc80564 expref: 18 pid: 5840 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996186.439632:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789996186.439659:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0849c76d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e0c28cd8-555e-481f-bd03-c3b02aee51c5+18:3313:x1876946942179712:12345-0@lo:103: Request processed in 56us (549us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996186.439665:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789996186.439676:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789996186.439681:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0849c75500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e0c28cd8-555e-481f-bd03-c3b02aee51c5+17:3313:x1876946942179840:12345-0@lo:103: 00010000:00010000:1.0:1789996186.439687:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789996186.439691:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e08413f0000/0x4173739f0fc80541 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4173739f0fc8053a expref: 17 pid: 5840 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996186.439700:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e08413f0000/0x4173739f0fc80541 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4173739f0fc8053a expref: 17 pid: 5840 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996186.439711:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8e08429c6600/0x4173739f0fc805c6 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996186.439720:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e08429c6600/0x4173739f0fc805c6 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996186.439745:0:5832:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e08429c6600/0x4173739f0fc805c6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996186.439751:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e08429c6600/0x4173739f0fc805c6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996186.439758:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e08429c6600/0x4173739f0fc805c6 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996186.439764:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e08429c6600/0x4173739f0fc805c6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996186.439770:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e08429c6600 already unused, calling callback (ffffffffc1595910) 00010000:00010000:1.0:1789996186.439773:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e08429c6600/0x4173739f0fc805c6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996186.439779:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e08429c6600/0x4173739f0fc805c6 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996186.439787:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e08429c6600/0x4173739f0fc805c6 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996186.439797:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789996186.439820:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0849c75500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e0c28cd8-555e-481f-bd03-c3b02aee51c5+17:3313:x1876946942179840:12345-0@lo:103: Request processed in 139us (678us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996186.439826:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789996186.439866:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0849c75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e0c28cd8-555e-481f-bd03-c3b02aee51c5:3313:1876946942179840:0@lo:103: 00000100:00100000:1.0:1789996186.439874:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0849c74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e0c28cd8-555e-481f-bd03-c3b02aee51c5:3313:1876946942179712:0@lo:103: 00000100:00100000:1.0:1789996186.439897:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0849c75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e0c28cd8-555e-481f-bd03-c3b02aee51c5:3316:1876946942179456:0@lo:103: 00000100:00100000:1.0:1789996186.439913:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0849c74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e0c28cd8-555e-481f-bd03-c3b02aee51c5:3316:1876946942179968:0@lo:103: 00000100:00100000:1.0:1789996186.439919:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0849c76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e0c28cd8-555e-481f-bd03-c3b02aee51c5:3316:1876946942179584:0@lo:103: 00010000:00010000:3.0:1789996186.440210:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e08429c6a00/0x4173739f0fc805b1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4173739f0fc805aa expref: 16 pid: 5840 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789996186.440225:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fa71880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5840:1876946942178816:0@lo:104: 00010000:00010000:3.0:1789996186.440235:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e0841525e00/0x4173739f0fc80587 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4173739f0fc80580 expref: 15 pid: 5841 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789996186.440243:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fa70a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5840:1876946942178944:0@lo:104: 00010000:00010000:3.0:1789996186.440251:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e0841524e00/0x4173739f0fc8056b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4173739f0fc80564 expref: 14 pid: 5840 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789996186.440258:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fa72680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5840:1876946942179072:0@lo:104: 00010000:00010000:3.0:1789996186.440266:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e08413f0000/0x4173739f0fc80541 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4173739f0fc8053a expref: 13 pid: 5840 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789996186.440275:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fa73480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5840:1876946942179200:0@lo:104: 00010000:00010000:3.0:1789996186.440284:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e08429c6000/0x4173739f0fc80517 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4173739f0fc80510 expref: 12 pid: 5841 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789996186.440303:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fa72a00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5840:1876946942179328:0@lo:104: 00010000:00010000:3.0:1789996186.440323:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8e08429c6600/0x4173739f0fc805c6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996186.440332:0:5840:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8e08429c6600/0x4173739f0fc805c6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996186.440338:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e08429c6600/0x4173739f0fc805c6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996186.440344:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e08429c6600/0x4173739f0fc805c6 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789996186.440357:0:5840:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1789996186.512866:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852be8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0c28cd8-555e-481f-bd03-c3b02aee51c5+11:7642:x1876946942178688:12345-0@lo:253: Request processed in 108133us (108576us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996186.512882:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789996186.513012:0:7642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fa73800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0c28cd8-555e-481f-bd03-c3b02aee51c5:7642:1876946942178688:0@lo:253: 10000000:01000000:3.0:1789996186.513028:0:7642:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1789996186.513031:0:7642:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789996186.513033:0:7642:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789996186.513045:0:7642:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789996186.513046:0:7642:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:3.0:1789996186.513047:0:7642:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789996186.513049:0:7642:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789996186.513050:0:7642:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789996186.513052:0:7642:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1789996186.513053:0:7642:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789996186.513054:0:7642:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1789996186.513073:0:7642:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8e0847d01800 from lustre-OST0001 10000000:01000000:3.0:1789996186.513096:0:7642:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1789996186.513099:0:7642:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1789996186.513106:0:7642:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8e08545d19c0 local copy 10000000:01000000:3.0:1789996186.513109:0:7642:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1789996186.513158:0:7642:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.137@tcp lock: ffff8e08429c6600/0x4173739f0fc805cd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996186.513169:0:7642:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.137@tcp lock: ffff8e08429c6600/0x4173739f0fc805cd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996186.513179:0:7642:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.137@tcp lock: ffff8e08429c6600/0x4173739f0fc805cd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789996186.513196:0:7642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fa73800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0c28cd8-555e-481f-bd03-c3b02aee51c5:7642:1876946942180096:0@lo:101: 00000100:00100000:3.0:1789996186.513235:0:7642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789996186.513299:0:7642:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e087f860e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789996186.513442:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942180096 00000100:00100000:1.0:1789996186.513449:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942180096 00000100:00100000:1.0:1789996186.513491:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789996186.513500:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852be8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+11:7642:x1876946942180096:12345-0@lo:101: 00010000:00010000:1.0:1789996186.513511:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789996186.513525:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e08413f1600/0x4173739f0fc805d4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4173739f0fc805cd expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996186.517003:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e08413f1600/0x4173739f0fc805d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4173739f0fc805cd expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996186.517027:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e08413f1600/0x4173739f0fc805d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4173739f0fc805cd expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996186.517051:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e08413f1600, rc 0) 00000100:00100000:1.0:1789996186.517143:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852be8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+12:7642:x1876946942180096:12345-0@lo:101: Request processed in 3642us (3905us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996186.517152:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789996186.517498:0:7642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fa73800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0c28cd8-555e-481f-bd03-c3b02aee51c5:7642:1876946942180096:0@lo:101: 00010000:00010000:0.0:1789996186.517523:0:7642:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.137@tcp lock: ffff8e08429c6600/0x4173739f0fc805cd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x4173739f0fc805d4 expref: -99 pid: 7642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996186.517533:0:7642:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.137@tcp lock: ffff8e08429c6600/0x4173739f0fc805cd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x4173739f0fc805d4 expref: -99 pid: 7642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789996186.517708:0:7642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e087993ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0c28cd8-555e-481f-bd03-c3b02aee51c5:7642:1876946942180224:0@lo:501: 00000100:00100000:0.0:1789996186.517751:0:7642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996186.517795:0:7642:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0852b62a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789996186.517928:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942180224 00000100:00100000:3.0:1789996186.517936:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942180224 00000100:00100000:3.0:1789996186.517971:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789996186.517980:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852ba5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0c28cd8-555e-481f-bd03-c3b02aee51c5+12:7642:x1876946942180224:12345-0@lo:501: 00000100:00100000:3.0:1789996186.518190:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852ba5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0c28cd8-555e-481f-bd03-c3b02aee51c5+12:7642:x1876946942180224:12345-0@lo:501: Request processed in 210us (438us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789996186.518197:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789996186.518326:0:7642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e087993ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0c28cd8-555e-481f-bd03-c3b02aee51c5:7642:1876946942180224:0@lo:501: 10000000:01000000:0.0:1789996186.518340:0:7642:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.137@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1789996186.518515:0:7642:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.137@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1789996186.518521:0:7642:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.137@tcp lock: ffff8e08429c6600/0x4173739f0fc805cd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x4173739f0fc805d4 expref: -99 pid: 7642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996186.518531:0:7642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.137@tcp lock: ffff8e08429c6600/0x4173739f0fc805cd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x4173739f0fc805d4 expref: -99 pid: 7642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996186.518537:0:7642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.137@tcp lock: ffff8e08429c6600/0x4173739f0fc805cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x4173739f0fc805d4 expref: -99 pid: 7642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996186.518587:0:7642:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1789996186.518606:0:7642:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8e0847d01800 10000000:01000000:0.0:1789996186.518610:0:7642:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1789996186.518622:0:7642:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1789996186.518626:0:7642:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789996186.518630:0:7642:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1789996186.518632:0:7642:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1789996186.518655:0:7642:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.137@tcp lock: ffff8e0840031200/0x4173739f0fc805db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996186.518662:0:7642:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.137@tcp lock: ffff8e0840031200/0x4173739f0fc805db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996186.518670:0:7642:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.137@tcp lock: ffff8e0840031200/0x4173739f0fc805db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789996186.518683:0:7642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e087993ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0c28cd8-555e-481f-bd03-c3b02aee51c5:7642:1876946942180352:0@lo:101: 00000100:00100000:0.0:1789996186.518713:0:7642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789996186.518753:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789996186.518761:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.137@tcp lock: ffff8e08429c6600/0x4173739f0fc805cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x4173739f0fc805d4 expref: -99 pid: 7642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996186.518768:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e08429c6600 already unused, calling callback (ffffffffc1be0c20) 10000000:00010000:1.0:1789996186.518779:0:5835:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.137@tcp lock: ffff8e08429c6600/0x4173739f0fc805cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x4173739f0fc805d4 expref: -99 pid: 7642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789996186.518781:0:7642:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0852b620c0 going to sleep for 11 seconds 00010000:00010000:1.0:1789996186.518788:0:5835:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.137@tcp lock: ffff8e08429c6600/0x4173739f0fc805cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x4173739f0fc805d4 expref: -99 pid: 7642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789996186.518795:0:5835:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.137@tcp lock: ffff8e08429c6600/0x4173739f0fc805cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x4173739f0fc805d4 expref: -99 pid: 7642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789996186.518801:0:5835:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789996186.518820:0:5835:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.137@tcp lock: ffff8e08429c6600/0x4173739f0fc805cd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x4173739f0fc805d4 expref: -99 pid: 7642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996186.518826:0:5835:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789996186.518854:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.137@tcp lock: ffff8e08429c6600/0x4173739f0fc805cd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x4173739f0fc805d4 expref: -99 pid: 7642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996186.518860:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.137@tcp lock: ffff8e08429c6600/0x4173739f0fc805cd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x4173739f0fc805d4 expref: -99 pid: 7642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996186.518875:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789996186.518877:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789996186.518879:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789996186.520470:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789996186.520492:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0849c76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e0c28cd8-555e-481f-bd03-c3b02aee51c5:3315:1876946942180480:0@lo:103: 00000100:00100000:0.0:1789996186.520570:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996186.520599:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942180480 00000100:00100000:1.0:1789996186.520607:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942180480 00000100:00100000:1.0:1789996186.520664:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789996186.520674:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0879939f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e0c28cd8-555e-481f-bd03-c3b02aee51c5+12:3315:x1876946942180480:12345-0@lo:103: 00010000:00010000:1.0:1789996186.520686:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789996186.520703:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e08413f1600/0x4173739f0fc805d4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4173739f0fc805cd expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996186.520738:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789996186.520777:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0879939f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e0c28cd8-555e-481f-bd03-c3b02aee51c5+11:3315:x1876946942180480:12345-0@lo:103: Request processed in 105us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996186.520785:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789996186.520826:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0849c76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e0c28cd8-555e-481f-bd03-c3b02aee51c5:3315:1876946942180480:0@lo:103: 00000100:00100000:3.0:1789996186.524481:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942180352 00000100:00100000:3.0:1789996186.524497:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942180352 00000100:00100000:3.0:1789996186.524638:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789996186.524649:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852ba4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0c28cd8-555e-481f-bd03-c3b02aee51c5+11:7642:x1876946942180352:12345-0@lo:101: 00010000:00010000:3.0:1789996186.524666:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789996186.524688:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e08429c6000/0x4173739f0fc805e2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4173739f0fc805db expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996186.524714:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e08429c6000/0x4173739f0fc805e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4173739f0fc805db expref: 12 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996186.524745:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e08429c6000/0x4173739f0fc805e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4173739f0fc805db expref: 12 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996186.524754:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e08429c6000, rc 0) 00000100:00100000:3.0:1789996186.524845:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852ba4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0c28cd8-555e-481f-bd03-c3b02aee51c5+12:7642:x1876946942180352:12345-0@lo:101: Request processed in 198us (6129us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996186.524852:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789996186.524899:0:7642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e087993ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0c28cd8-555e-481f-bd03-c3b02aee51c5:7642:1876946942180352:0@lo:101: 00010000:00010000:1.0:1789996186.524918:0:7642:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.137@tcp lock: ffff8e0840031200/0x4173739f0fc805db lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc805e2 expref: -99 pid: 7642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996186.524927:0:7642:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.137@tcp lock: ffff8e0840031200/0x4173739f0fc805db lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4173739f0fc805e2 expref: -99 pid: 7642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789996186.525049:0:7642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0849c76300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0c28cd8-555e-481f-bd03-c3b02aee51c5:7642:1876946942180608:0@lo:501: 00000100:00100000:1.0:1789996186.525085:0:7642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996186.531268:0:7642:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0879824900 going to sleep for 11 seconds 00000100:00100000:0.0:1789996186.531271:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942180608 00000100:00100000:0.0:1789996186.531283:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942180608 00000100:00100000:0.0:1789996186.531338:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789996186.531360:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852ba7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0c28cd8-555e-481f-bd03-c3b02aee51c5+12:7642:x1876946942180608:12345-0@lo:501: 00000100:00100000:0.0:1789996186.531694:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852ba7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0c28cd8-555e-481f-bd03-c3b02aee51c5+12:7642:x1876946942180608:12345-0@lo:501: Request processed in 335us (6607us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996186.531702:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789996186.532019:0:7642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0849c76300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0c28cd8-555e-481f-bd03-c3b02aee51c5:7642:1876946942180608:0@lo:501: 00000100:00100000:1.0:1789996186.532194:0:7642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0849c76300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0c28cd8-555e-481f-bd03-c3b02aee51c5:7642:1876946942180736:0@lo:503: 00000100:00100000:1.0:1789996186.532245:0:7642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996186.532834:0:7642:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0879824900 going to sleep for 11 seconds 00000100:00100000:0.0:1789996186.535608:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942180736 00000100:00100000:0.0:1789996186.535755:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942180736 00000100:00100000:1.0:1789996186.536186:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789996186.536197:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852ba7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0c28cd8-555e-481f-bd03-c3b02aee51c5+12:7642:x1876946942180736:12345-0@lo:503: 00000100:00100000:1.0:1789996186.536474:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852ba7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0c28cd8-555e-481f-bd03-c3b02aee51c5+12:7642:x1876946942180736:12345-0@lo:503: Request processed in 278us (4228us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996186.536583:0:7642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0849c76300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0c28cd8-555e-481f-bd03-c3b02aee51c5:7642:1876946942180736:0@lo:503: 00000040:00080000:0.0:1789996186.536940:0:7642:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789996186.537027:0:7642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0879938700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0c28cd8-555e-481f-bd03-c3b02aee51c5:7642:1876946942180864:0@lo:502: 00000100:00100000:0.0:1789996186.537075:0:7642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996186.537114:0:7642:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0852b62c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789996186.537143:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942180864 00000100:00100000:2.0:1789996186.537149:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942180864 00000100:00100000:2.0:1789996186.537175:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789996186.537182:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852ba6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+13:7642:x1876946942180864:12345-0@lo:502: 00000100:00100000:2.0:1789996186.537352:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852ba6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+13:7642:x1876946942180864:12345-0@lo:502: Request processed in 170us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996186.537359:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789996186.537534:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789996186.537630:0:7642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0879938700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0c28cd8-555e-481f-bd03-c3b02aee51c5:7642:1876946942180864:0@lo:502: 00000040:00080000:0.0:1789996186.537865:0:7642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1789996186.537914:0:7642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1789996186.537944:0:7642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1789996186.537986:0:7642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1789996186.538017:0:7642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1789996186.538047:0:7642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1789996186.538070:0:7642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0879938700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0c28cd8-555e-481f-bd03-c3b02aee51c5:7642:1876946942180992:0@lo:502: 00000100:00100000:0.0:1789996186.538106:0:7642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996186.538138:0:7642:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0852b62c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789996186.538414:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942180992 00000100:00100000:2.0:1789996186.538420:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942180992 00000100:00100000:2.0:1789996186.538452:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789996186.538459:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852ba7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+12:7642:x1876946942180992:12345-0@lo:502: 00000100:00100000:2.0:1789996186.538650:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852ba7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+12:7642:x1876946942180992:12345-0@lo:502: Request processed in 191us (543us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996186.538657:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789996186.538837:0:7642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0879938700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0c28cd8-555e-481f-bd03-c3b02aee51c5:7642:1876946942180992:0@lo:502: 00000040:00080000:0.0:1789996186.538926:0:7642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1789996186.538936:0:7642:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:0.0:1789996186.539785:0:7650:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789996186.539794:0:7650:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:0.0:1789996186.539800:0:7650:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789996186.539803:0:7650:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1789996186.539809:0:7650:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789996186.539824:0:7650:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8e087f8c4d40) 00000020:00000080:0.0:1789996186.539847:0:7650:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:0.0:1789996186.539854:0:7650:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1789996186.539927:0:7650:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e0847d01800 from lustre-OST0001, refs=2 00080000:01000000:0.0:1789996186.539934:0:7650:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:0.0:1789996186.539941:0:7650:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x4173739f0fc805f0 00010000:00010000:2.0:1789996186.547371:0:7650:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:2.0:1789996186.547899:0:7650:0:(tgt_lastrcvd.c:1879:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:2.0:1789996186.553507:0:7650:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1789996186.554297:0:7650:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:2.0:1789996186.573099:0:7650:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:2.0:1789996186.574022:0:7650:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:1.0:1789996186.577613:0:7650:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1789996186.577629:0:7650:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789996186.577636:0:7650:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789996186.577639:0:7650:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1789996186.577643:0:7650:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789996186.577648:0:7650:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789996186.577650:0:7650:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789996186.577654:0:7650:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789996186.577656:0:7650:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1789996186.577713:0:7650:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789996186.577716:0:7650:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789996186.577717:0:7650:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:1.0:1789996186.577721:0:7650:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1789996186.582357:0:7642:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:2.0:1789996186.582412:0:7642:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.137@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1789996186.582448:0:7642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.137@tcp lock: ffff8e0840031200/0x4173739f0fc805db lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc805e2 expref: -99 pid: 7642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996186.582462:0:7642:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.137@tcp lock: ffff8e0840031200/0x4173739f0fc805db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc805e2 expref: -99 pid: 7642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789996186.582473:0:7642:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e0847d01800 from 1 10000000:01000000:2.0:1789996186.582770:0:7642:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789996186.582809:0:7642:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.137@tcp lock: ffff8e0842de5200/0x4173739f0fc805f7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996186.582818:0:7642:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.137@tcp lock: ffff8e0842de5200/0x4173739f0fc805f7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996186.582829:0:7642:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.137@tcp lock: ffff8e0842de5200/0x4173739f0fc805f7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789996186.582861:0:7642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fa92300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0c28cd8-555e-481f-bd03-c3b02aee51c5:7642:1876946942181120:0@lo:101: 00000100:00100000:2.0:1789996186.582931:0:7642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996186.583171:0:7642:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e087663bc00 going to sleep for 11 seconds 00000100:00100000:1.0:1789996186.583614:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942181120 00000100:00100000:1.0:1789996186.583624:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942181120 00000100:00100000:1.0:1789996186.583677:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789996186.583687:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852ba5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+12:7642:x1876946942181120:12345-0@lo:101: 00010000:00010000:1.0:1789996186.583714:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789996186.583730:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e08413f1600/0x4173739f0fc805fe lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4173739f0fc805f7 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996186.583755:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e08413f1600/0x4173739f0fc805fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4173739f0fc805f7 expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996186.583766:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e08413f1600/0x4173739f0fc805fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4173739f0fc805f7 expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996186.583775:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e08413f1600, rc 0) 00000100:00100000:1.0:1789996186.583825:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852ba5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+13:7642:x1876946942181120:12345-0@lo:101: Request processed in 140us (894us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996186.583832:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789996186.590143:0:7642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fa92300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0c28cd8-555e-481f-bd03-c3b02aee51c5:7642:1876946942181120:0@lo:101: 00010000:00010000:2.0:1789996186.590173:0:7642:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.137@tcp lock: ffff8e0842de5200/0x4173739f0fc805f7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc805fe expref: -99 pid: 7642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996186.590188:0:7642:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.137@tcp lock: ffff8e0842de5200/0x4173739f0fc805f7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4173739f0fc805fe expref: -99 pid: 7642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789996186.590347:0:7642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fa92300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0c28cd8-555e-481f-bd03-c3b02aee51c5:7642:1876946942181248:0@lo:501: 00000100:00100000:2.0:1789996186.590416:0:7642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996186.590469:0:7642:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e087663bc00 going to sleep for 11 seconds 00000100:00100000:2.0:1789996186.590501:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942181248 00000100:00100000:2.0:1789996186.590507:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942181248 00000100:00100000:2.0:1789996186.590571:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1789996186.590582:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852ba6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+13:7642:x1876946942181248:12345-0@lo:501: 00000100:00100000:2.0:1789996186.591248:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852ba6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+13:7642:x1876946942181248:12345-0@lo:501: Request processed in 666us (830us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996186.591256:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1789996186.591318:0:7642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fa92300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0c28cd8-555e-481f-bd03-c3b02aee51c5:7642:1876946942181248:0@lo:501: 00000100:00100000:2.0:1789996186.593777:0:7642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fa92300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0c28cd8-555e-481f-bd03-c3b02aee51c5:7642:1876946942181376:0@lo:503: 00000100:00100000:2.0:1789996186.593884:0:7642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996186.593929:0:7642:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e087663bc00 going to sleep for 11 seconds 00000100:00100000:2.0:1789996186.597882:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942181376 00000100:00100000:2.0:1789996186.597909:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942181376 00000100:00100000:2.0:1789996186.599140:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1789996186.599157:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852ba4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0c28cd8-555e-481f-bd03-c3b02aee51c5+13:7642:x1876946942181376:12345-0@lo:503: 00000100:00100000:2.0:1789996186.602153:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852ba4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0c28cd8-555e-481f-bd03-c3b02aee51c5+13:7642:x1876946942181376:12345-0@lo:503: Request processed in 2990us (8273us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996186.602167:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1789996186.602864:0:7642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fa92300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0c28cd8-555e-481f-bd03-c3b02aee51c5:7642:1876946942181376:0@lo:503: 00000040:00080000:3.0:1789996186.603202:0:7642:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789996186.603303:0:7642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fa72a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0c28cd8-555e-481f-bd03-c3b02aee51c5:7642:1876946942181504:0@lo:502: 00000100:00100000:3.0:1789996186.603368:0:7642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789996186.603418:0:7642:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e087f8600c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789996186.605221:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942181504 00000100:00100000:1.0:1789996186.605238:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942181504 00000100:00100000:1.0:1789996186.605313:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789996186.605324:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852ba4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0c28cd8-555e-481f-bd03-c3b02aee51c5+13:7642:x1876946942181504:12345-0@lo:502: 00000100:00100000:1.0:1789996186.606249:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852ba4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0c28cd8-555e-481f-bd03-c3b02aee51c5+13:7642:x1876946942181504:12345-0@lo:502: Request processed in 924us (2878us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996186.606259:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789996186.607195:0:7642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fa72a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0c28cd8-555e-481f-bd03-c3b02aee51c5:7642:1876946942181504:0@lo:502: 00000040:00080000:1.0:1789996186.610349:0:7642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1789996186.610452:0:7642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1789996186.613801:0:7642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0849c74e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0c28cd8-555e-481f-bd03-c3b02aee51c5:7642:1876946942181632:0@lo:502: 00000100:00100000:1.0:1789996186.613895:0:7642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996186.613941:0:7642:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0879824900 going to sleep for 11 seconds 00000100:00100000:3.0:1789996186.614580:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942181632 00000100:00100000:3.0:1789996186.614588:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942181632 00000100:00100000:3.0:1789996186.614768:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1789996186.614778:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852ba6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0c28cd8-555e-481f-bd03-c3b02aee51c5+13:7642:x1876946942181632:12345-0@lo:502: 00000100:00100000:3.0:1789996186.615165:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852ba6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0c28cd8-555e-481f-bd03-c3b02aee51c5+13:7642:x1876946942181632:12345-0@lo:502: Request processed in 387us (1269us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996186.615173:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1789996186.615651:0:7642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0849c74e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0c28cd8-555e-481f-bd03-c3b02aee51c5:7642:1876946942181632:0@lo:502: 00000040:00080000:2.0:1789996186.615818:0:7642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1789996186.615835:0:7642:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1789996186.617224:0:7654:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789996186.617237:0:7654:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789996186.617239:0:7654:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1789996186.617249:0:7654:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e0847d01800 00000020:00000080:2.0:1789996186.617252:0:7654:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789996186.617271:0:7654:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789996186.617274:0:7654:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789996186.617728:0:7654:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1789996186.617734:0:7654:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1789996186.627530:0:7642:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1789996186.628011:0:7642:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.137@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789996186.628139:0:7642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.137@tcp lock: ffff8e0842de5200/0x4173739f0fc805f7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc805fe expref: -99 pid: 7642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996186.628155:0:7642:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.137@tcp lock: ffff8e0842de5200/0x4173739f0fc805f7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc805fe expref: -99 pid: 7642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789996186.628215:0:7642:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1789996186.628218:0:7642:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8e0847d01800 10000000:01000000:1.0:1789996186.628221:0:7642:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8e0847d01800 10000000:01000000:1.0:1789996186.628225:0:7642:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789996186.628232:0:7642:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8e0847d01800 from 1 10000000:01000000:1.0:1789996186.628234:0:7642:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789996186.628270:0:7642:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.137@tcp lock: ffff8e08413f1400/0x4173739f0fc80605 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996186.628298:0:7642:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.137@tcp lock: ffff8e08413f1400/0x4173739f0fc80605 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996186.628310:0:7642:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.137@tcp lock: ffff8e08413f1400/0x4173739f0fc80605 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789996186.628333:0:7642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0849c75880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0c28cd8-555e-481f-bd03-c3b02aee51c5:7642:1876946942181760:0@lo:101: 00000100:00100000:1.0:1789996186.628423:0:7642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996186.628477:0:7642:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0879824300 going to sleep for 11 seconds 00000100:00100000:0.0:1789996186.628616:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942181760 00000100:00100000:0.0:1789996186.628630:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942181760 00000100:00100000:0.0:1789996186.628679:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1789996186.628689:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852ba6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+13:7642:x1876946942181760:12345-0@lo:101: 00010000:00010000:0.0:1789996186.628704:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789996186.628721:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e0840031a00/0x4173739f0fc8060c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4173739f0fc80605 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996186.628748:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e0840031a00/0x4173739f0fc8060c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4173739f0fc80605 expref: 14 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996186.628760:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e0840031a00/0x4173739f0fc8060c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4173739f0fc80605 expref: 14 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996186.628769:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e0840031a00, rc 0) 00000100:00100000:0.0:1789996186.628812:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852ba6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+14:7642:x1876946942181760:12345-0@lo:101: Request processed in 124us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996186.628819:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1789996186.629471:0:7642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0849c75880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0c28cd8-555e-481f-bd03-c3b02aee51c5:7642:1876946942181760:0@lo:101: 00010000:00010000:1.0:1789996186.629489:0:7642:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.137@tcp lock: ffff8e08413f1400/0x4173739f0fc80605 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc8060c expref: -99 pid: 7642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996186.629498:0:7642:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.137@tcp lock: ffff8e08413f1400/0x4173739f0fc80605 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4173739f0fc8060c expref: -99 pid: 7642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789996186.629749:0:7642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0849c75880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0c28cd8-555e-481f-bd03-c3b02aee51c5:7642:1876946942181888:0@lo:501: 00000100:00100000:1.0:1789996186.629785:0:7642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996186.629815:0:7642:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0879824300 going to sleep for 11 seconds 00000100:00100000:0.0:1789996186.630188:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942181888 00000100:00100000:0.0:1789996186.630193:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942181888 00000100:00100000:0.0:1789996186.630236:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1789996186.630245:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852ba4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0c28cd8-555e-481f-bd03-c3b02aee51c5+14:7642:x1876946942181888:12345-0@lo:501: 00000100:00100000:0.0:1789996186.630587:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852ba4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0c28cd8-555e-481f-bd03-c3b02aee51c5+14:7642:x1876946942181888:12345-0@lo:501: Request processed in 342us (800us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996186.630595:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789996186.630801:0:7642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0849c75880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0c28cd8-555e-481f-bd03-c3b02aee51c5:7642:1876946942181888:0@lo:501: 00000100:00100000:2.0:1789996186.630841:0:7642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fa92a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0c28cd8-555e-481f-bd03-c3b02aee51c5:7642:1876946942182016:0@lo:503: 00000100:00100000:2.0:1789996186.630881:0:7642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996186.630895:0:7642:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e087663b9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789996186.631066:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942182016 00000100:00100000:0.0:1789996186.631071:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942182016 00000100:00100000:0.0:1789996186.631088:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1789996186.631094:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852ba7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0c28cd8-555e-481f-bd03-c3b02aee51c5+14:7642:x1876946942182016:12345-0@lo:503: 00000100:00100000:0.0:1789996186.631262:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852ba7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0c28cd8-555e-481f-bd03-c3b02aee51c5+14:7642:x1876946942182016:12345-0@lo:503: Request processed in 167us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996186.631276:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1789996186.631530:0:7642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fa92a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0c28cd8-555e-481f-bd03-c3b02aee51c5:7642:1876946942182016:0@lo:503: 00000040:00080000:2.0:1789996186.631839:0:7642:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789996186.631899:0:7642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fa92a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0c28cd8-555e-481f-bd03-c3b02aee51c5:7642:1876946942182144:0@lo:502: 00000100:00100000:2.0:1789996186.631934:0:7642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996186.631962:0:7642:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e087663b9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789996186.632404:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942182144 00000100:00100000:1.0:1789996186.632409:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942182144 00000100:00100000:1.0:1789996186.632444:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1789996186.632452:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852ba5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+14:7642:x1876946942182144:12345-0@lo:502: 00000100:00100000:1.0:1789996186.634848:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852ba5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+14:7642:x1876946942182144:12345-0@lo:502: Request processed in 2390us (2905us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996186.634862:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1789996186.635247:0:7642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fa92a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0c28cd8-555e-481f-bd03-c3b02aee51c5:7642:1876946942182144:0@lo:502: 00000040:00080000:2.0:1789996186.635751:0:7642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1789996186.635813:0:7642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1789996186.635851:0:7642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1789996186.635899:0:7642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1789996186.636923:0:7642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1789996186.637172:0:7642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1789996186.637210:0:7642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1789996186.637243:0:7642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1789996186.637292:0:7642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1789996186.637329:0:7642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1789996186.637389:0:7642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1789996186.637442:0:7642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1789996186.639103:0:7642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1789996186.639181:0:7642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1789996186.639243:0:7642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1789996186.639281:0:7642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1789996186.639317:0:7642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1789996186.639413:0:7642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1789996186.640375:0:7642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1789996186.640446:0:7642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1789996186.640519:0:7642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1789996186.640596:0:7642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1789996186.640647:0:7642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1789996186.640698:0:7642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1789996186.640737:0:7642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:2.0:1789996186.640771:0:7642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:2.0:1789996186.640821:0:7642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:2.0:1789996186.640858:0:7642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:2.0:1789996186.640893:0:7642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:2.0:1789996186.640969:0:7642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:2.0:1789996186.641010:0:7642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:2.0:1789996186.641059:0:7642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:2.0:1789996186.641106:0:7642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:2.0:1789996186.641157:0:7642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:2.0:1789996186.641192:0:7642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:2.0:1789996186.641242:0:7642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:2.0:1789996186.641279:0:7642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:2.0:1789996186.641328:0:7642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fa92a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0c28cd8-555e-481f-bd03-c3b02aee51c5:7642:1876946942182272:0@lo:502: 00000100:00100000:2.0:1789996186.641417:0:7642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996186.641455:0:7642:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e087663b9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789996186.642778:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942182272 00000100:00100000:1.0:1789996186.642789:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942182272 00000100:00100000:1.0:1789996186.642852:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1789996186.642862:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852ba5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+14:7642:x1876946942182272:12345-0@lo:502: 00000100:00100000:1.0:1789996186.643209:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852ba5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+14:7642:x1876946942182272:12345-0@lo:502: Request processed in 348us (1791us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996186.643216:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1789996186.643415:0:7642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fa92a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0c28cd8-555e-481f-bd03-c3b02aee51c5:7642:1876946942182272:0@lo:502: 00000040:00080000:3.0:1789996186.643568:0:7642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:3.0:1789996186.643581:0:7642:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:2.0:1789996186.650848:0:7655:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1789996186.650866:0:7655:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8e08766599c0) 00000020:00000080:2.0:1789996186.650889:0:7655:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:2.0:1789996186.650975:0:7655:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e0847d01800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1789996186.650979:0:7655:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8e0847d01800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1789996186.650981:0:7655:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e0847d01800 3 00010000:00080000:2.0:1789996186.651013:0:7655:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e0850a85000@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.137@tcp at head 00010000:00010000:2.0:1789996186.656067:0:7655:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:2.0:1789996186.656297:0:7655:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1789996186.656335:0:7655:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789996186.656363:0:7655:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x4173739f0fc8061a 00000100:00080000:2.0:1789996186.656374:0:7655:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789996186.656395:0:7655:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8e0850a85000 using connection 192.168.204.137@tcp/0@lo 00000100:00100000:2.0:1789996186.663226:0:7655:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e086fa93480 x1876946942182400/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789996186.663258:0:7655:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1789996186.663505:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0849c74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876946942182528:0@lo:400: 00000100:00100000:3.0:1789996186.663806:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fa93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3312:1876946942182400:0@lo:38: 00000100:00100000:1.0:1789996186.663892:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996186.663947:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789996186.663955:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0849c75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1876946942182656:0@lo:400: 00000100:00100000:3.0:1789996186.664762:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942182528 00000100:00100000:3.0:1789996186.664776:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942182528 00000100:00100000:3.0:1789996186.664850:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789996186.664858:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0849c75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876946942182528:12345-0@lo:400: 00000100:00100000:2.0:1789996186.665134:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789996186.665148:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0849c77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876946942182784:0@lo:400: 00000100:00100000:3.0:1789996186.667057:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0849c75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876946942182528:12345-0@lo:400: Request processed in 2192us (3157us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996186.667072:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000040:00080000:3.0:1789996186.668627:0:7655:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00080000:0.0:1789996186.669260:0:7656:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@ffff8e0879938700 x1876946942182912/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789996186.669272:0:7656:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e08581e19c0 going to sleep for 0 seconds 00000100:00100000:2.0:1789996186.670145:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:2.0:1789996186.670257:0:7642:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:2.0:1789996186.670293:0:7642:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.137@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789996186.670331:0:7642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.137@tcp lock: ffff8e08413f1400/0x4173739f0fc80605 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc8060c expref: -99 pid: 7642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996186.670354:0:7642:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.137@tcp lock: ffff8e08413f1400/0x4173739f0fc80605 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc8060c expref: -99 pid: 7642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789996186.670416:0:7642:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1789996186.670418:0:7642:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789996186.670419:0:7642:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789996186.670420:0:7642:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789996186.670422:0:7642:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789996186.670424:0:7642:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789996186.670425:0:7642:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789996186.670426:0:7642:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789996186.670428:0:7642:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789996186.670430:0:7642:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789996186.670431:0:7642:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789996186.670434:0:7642:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:2.0:1789996186.670437:0:7642:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789996186.670439:0:7642:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789996186.670440:0:7642:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789996186.670441:0:7642:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789996186.670442:0:7642:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789996186.670443:0:7642:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789996186.670444:0:7642:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789996186.670445:0:7642:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789996186.670446:0:7642:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789996186.670447:0:7642:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789996186.670448:0:7642:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789996186.670465:0:7642:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1789996186.670497:0:7642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fa93800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0c28cd8-555e-481f-bd03-c3b02aee51c5:7642:1876946942183040:0@lo:253: 00000100:00100000:2.0:1789996186.670566:0:7642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996186.670597:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942183040 00000100:00100000:2.0:1789996186.670614:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942183040 00000100:00100000:2.0:1789996186.670655:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1789996186.670662:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852ba0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0c28cd8-555e-481f-bd03-c3b02aee51c5+14:7642:x1876946942183040:12345-0@lo:253: 20000000:01000000:2.0:1789996186.670704:0:5840:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1789996186.670718:0:5840:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1789996186.671435:0:7642:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e087663b0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789996186.674604:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996186.674671:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996186.674737:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942182656 00000100:00100000:1.0:1789996186.674747:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942182656 00000100:00100000:1.0:1789996186.674808:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942182400 00000100:00100000:1.0:1789996186.674812:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942182400 00000100:00100000:1.0:1789996186.674826:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789996186.674837:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0849c74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876946942182656:12345-0@lo:400: 00000100:00100000:1.0:1789996186.674908:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0849c74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876946942182656:12345-0@lo:400: Request processed in 74us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996186.674915:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789996186.674936:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789996186.674941:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0849c76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3312:x1876946942182400:12345-0@lo:38: 00010000:00080000:1.0:1789996186.674965:0:5848:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 228 last 0 00000020:00000080:1.0:1789996186.675024:0:5848:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x4173739f0fc80621 00000004:00100000:1.0:1789996186.675048:0:5848:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789996186.675103:0:5848:0:(import.c:65:import_set_state_nolock()) ffff8e0847d00800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789996186.675143:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0849c76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876946942182400:12345-0@lo:38: Request processed in 200us (471us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996186.675149:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:1.0:1789996186.675165:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789996186.675199:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e086fa93480 x1876946942182400/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789996196 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789996186.675210:0:3312:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789996186.675219:0:3312:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:1.0:1789996186.675227:0:3312:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1789996186.675231:0:3312:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789996186.675234:0:3312:0:(import.c:65:import_set_state_nolock()) ffff8e0850a85000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00080000:1.0:1789996186.675240:0:3312:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000545acb39): req@ffff8e0879938700 x1876946942182912/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789996186.675255:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fa93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3312:1876946942182400:0@lo:38: 00010000:00080000:1.0:1789996186.675880:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e0849c75c00 x1876946942182656/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789996202 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789996186.675892:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0849c75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1876946942182656:0@lo:400: 00010000:00080000:1.0:1789996186.675928:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e0849c74000 x1876946942182528/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789996202 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789996186.675938:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0849c74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876946942182528:0@lo:400: 00000100:00100000:0.0:1789996186.678849:0:7656:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996186.678896:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942182912 00000100:00100000:0.0:1789996186.678904:0:5857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942182912 00000100:00100000:0.0:1789996186.678977:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789996186.678987:0:5857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e087993b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7656:x1876946942182912:12345-0@lo:901: 00000100:00100000:0.0:1789996186.679301:0:5857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e087993b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7656:x1876946942182912:12345-0@lo:901: Request processed in 315us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996186.679309:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1789996186.679330:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1789996186.679376:0:7656:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e0879938700 x1876946942182912/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1789996202 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789996186.679400:0:7656:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0879938700 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7656:1876946942182912:0@lo:901: 00000100:00100000:3.0:1789996186.681099:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942182784 00000100:00100000:3.0:1789996186.681111:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942182784 00000100:00100000:3.0:1789996186.681205:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789996186.681215:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fa92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1876946942182784:12345-0@lo:400: 00000100:00100000:3.0:1789996186.681291:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fa92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1876946942182784:12345-0@lo:400: Request processed in 78us (11149us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996186.681297:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1789996186.681747:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789996186.682888:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e0849c77480 x1876946942182784/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789996202 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789996186.682906:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0849c77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876946942182784:0@lo:400: 20000000:01000000:2.0:1789996186.748617:0:5840:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1789996186.748640:0:5840:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1789996186.748820:0:5862:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1789996186.748826:0:5862:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1789996186.748853:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e08429c6a00/0x4173739f0fc80628 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996186.748876:0:5862:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e0841524c00/0x4173739f0fc80579 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4173739f0fc80572 expref: 14 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996186.748885:0:5862:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8e08429c6a00/0x4173739f0fc80628 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996186.748927:0:5862:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e0841524c00/0x4173739f0fc80579 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4173739f0fc80572 expref: 14 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996186.748955:0:5862:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e0841524c00/0x4173739f0fc80579 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4173739f0fc80572 expref: 14 pid: 5841 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789996186.749123:0:5862:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fa73480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5862:1876946942183168:0@lo:104: 00000100:00100000:3.0:1789996186.749182:0:5862:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789996186.749241:0:5862:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e087f860c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789996186.749306:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942183168 00000100:00100000:1.0:1789996186.749316:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942183168 00000100:00100000:1.0:1789996186.749386:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789996186.749398:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fa72680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+3:5862:x1876946942183168:12345-0@lo:104: 00010000:00010000:1.0:1789996186.749421:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.137@tcp lock: ffff8e0840031000/0x4173739f0fc80572 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4173739f0fc80579 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996186.749501:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789996186.749508:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fa72680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+3:5862:x1876946942183168:12345-0@lo:104: Request processed in 113us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996186.749515:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:1.0:1789996186.749568:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789996186.749574:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.137@tcp lock: ffff8e0840031000/0x4173739f0fc80572 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4173739f0fc80579 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996186.749581:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0840031000 already unused, calling callback (ffffffffc1be0c20) 10000000:00010000:1.0:1789996186.749586:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.137@tcp lock: ffff8e0840031000/0x4173739f0fc80572 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4173739f0fc80579 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996186.749594:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.137@tcp lock: ffff8e0840031000/0x4173739f0fc80572 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4173739f0fc80579 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789996186.749777:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.137@tcp lock: ffff8e0840031000/0x4173739f0fc80572 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4173739f0fc80579 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789996186.749785:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789996186.749816:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.137@tcp lock: ffff8e0840031000/0x4173739f0fc80572 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4173739f0fc80579 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996186.749822:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789996186.749839:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.137@tcp lock: ffff8e0840031000/0x4173739f0fc80572 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4173739f0fc80579 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996186.749846:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.137@tcp lock: ffff8e0840031000/0x4173739f0fc80572 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4173739f0fc80579 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996186.749869:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789996186.749871:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789996186.749873:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789996186.749889:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789996186.749901:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0849c74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e0c28cd8-555e-481f-bd03-c3b02aee51c5:3315:1876946942183296:0@lo:103: 00000100:00100000:1.0:1789996186.749934:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996186.749985:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942183296 00000100:00100000:1.0:1789996186.749990:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942183296 00010000:00010000:1.0:1789996186.750013:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e0841524c00/0x4173739f0fc80579 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4173739f0fc80572 expref: 15 pid: 5841 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789996186.750036:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789996186.750043:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0848c1c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e0c28cd8-555e-481f-bd03-c3b02aee51c5+15:3315:x1876946942183296:12345-0@lo:103: 00010000:00010000:1.0:1789996186.750055:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789996186.750060:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e0841524c00/0x4173739f0fc80579 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4173739f0fc80572 expref: 15 pid: 5841 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996186.750071:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e0841524c00/0x4173739f0fc80579 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4173739f0fc80572 expref: 15 pid: 5841 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996186.750088:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8e08429c6a00/0x4173739f0fc80628 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996186.750098:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e08429c6a00/0x4173739f0fc80628 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789996186.750111:0:5833:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001575965s 00010000:00010000:1.0:1789996186.750116:0:5833:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e08429c6a00/0x4173739f0fc80628 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996186.750135:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e08429c6a00/0x4173739f0fc80628 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996186.750142:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e08429c6a00/0x4173739f0fc80628 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996186.750149:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e08429c6a00/0x4173739f0fc80628 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996186.750155:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e08429c6a00 already unused, calling callback (ffffffffc1595910) 00010000:00010000:1.0:1789996186.750159:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e08429c6a00/0x4173739f0fc80628 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996186.750168:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e08429c6a00/0x4173739f0fc80628 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996186.750177:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e08429c6a00/0x4173739f0fc80628 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996186.750188:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789996186.750218:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0848c1c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e0c28cd8-555e-481f-bd03-c3b02aee51c5+15:3315:x1876946942183296:12345-0@lo:103: Request processed in 175us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996186.750225:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789996186.750283:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0849c74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e0c28cd8-555e-481f-bd03-c3b02aee51c5:3315:1876946942183296:0@lo:103: 00010000:00010000:3.0:1789996186.752778:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e0841524c00/0x4173739f0fc80579 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4173739f0fc80572 expref: 14 pid: 5841 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789996186.752801:0:5862:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fa73480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5862:1876946942183168:0@lo:104: 00010000:00010000:3.0:1789996186.752825:0:5862:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8e08429c6a00/0x4173739f0fc80628 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996186.752836:0:5862:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8e08429c6a00/0x4173739f0fc80628 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996186.752842:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e08429c6a00/0x4173739f0fc80628 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996186.752848:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e08429c6a00/0x4173739f0fc80628 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789996186.769967:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852ba0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0c28cd8-555e-481f-bd03-c3b02aee51c5+13:7642:x1876946942183040:12345-0@lo:253: Request processed in 99290us (99385us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996186.769986:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1789996186.771637:0:7642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fa93800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e0c28cd8-555e-481f-bd03-c3b02aee51c5:7642:1876946942183040:0@lo:253: 10000000:01000000:2.0:1789996186.771656:0:7642:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1789996186.771659:0:7642:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789996186.771661:0:7642:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789996186.771662:0:7642:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789996186.771663:0:7642:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789996186.771665:0:7642:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789996186.771666:0:7642:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789996186.771667:0:7642:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789996186.771669:0:7642:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789996186.771670:0:7642:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789996186.771672:0:7642:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789996186.771673:0:7642:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1789996186.771690:0:7642:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1789996186.784904:0:7642:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1789996186.785243:0:7642:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1789996186.785504:0:7642:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1789996186.792931:0:7642:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1789996186.793253:0:7642:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1789996186.794095:0:7642:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1789996186.797268:0:7642:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00010000:00010000:0.0:1789996186.985036:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1789996187.184047:0:7642:0:(ofd_obd.c:541:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1789996187.184055:0:7642:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1789996187.184087:0:7642:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1789996187.184152:0:7642:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.137@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1789996187.184168:0:7642:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1789996187.184195:0:7642:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:3.0:1789996188.008709:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789996189.037492:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789996189.674944:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0849c74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876946942183424:0@lo:13: 00000100:00100000:2.0:1789996189.675027:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789996189.675153:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942183424 00000100:00100000:3.0:1789996189.675162:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942183424 00000100:00100000:3.0:1789996189.675240:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789996189.675250:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fa93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876946942183424:12345-0@lo:13: 00002000:00000024:3.0:1789996189.675282:0:6692:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1789996189.675361:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789996189.675936:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fa93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876946942183424:12345-0@lo:13: Request processed in 685us (906us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996189.675946:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1789996189.676082:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e0849c74000 x1876946942183424/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789996205 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789996189.676103:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0849c74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876946942183424:0@lo:13: 00010000:00010000:1.0:1789996190.056816:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789996191.081352:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789996191.730848:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fa91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e0c28cd8-555e-481f-bd03-c3b02aee51c5:3314:1876946942183552:0@lo:400: 00000100:00100000:1.0:1789996191.730918:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789996191.731017:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942183552 00000100:00100000:3.0:1789996191.731025:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942183552 00000100:00100000:3.0:1789996191.731084:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1789996191.731093:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852ba0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0c28cd8-555e-481f-bd03-c3b02aee51c5+13:3314:x1876946942183552:12345-0@lo:400: 00000100:00100000:0.0:1789996191.731609:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fa92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876946942183936:0@lo:400: 00000100:00100000:0.0:1789996191.732335:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996191.732405:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942183936 00000100:00100000:0.0:1789996191.732411:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942183936 00000100:00100000:0.0:1789996191.732461:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789996191.732469:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0879938700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1876946942183936:12345-0@lo:400: 00000100:00100000:0.0:1789996191.732514:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0879938700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1876946942183936:12345-0@lo:400: Request processed in 46us (854us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996191.732521:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:0.0:1789996191.732559:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789996191.732588:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e086fa92300 x1876946942183936/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789996207 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789996191.732604:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fa92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876946942183936:0@lo:400: 00000100:00100000:3.0:1789996191.733004:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852ba0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0c28cd8-555e-481f-bd03-c3b02aee51c5+13:3314:x1876946942183552:12345-0@lo:400: Request processed in 1911us (2085us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996191.733013:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1789996191.733203:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fa91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e0c28cd8-555e-481f-bd03-c3b02aee51c5:3314:1876946942183552:0@lo:400: 00000100:00100000:3.0:1789996191.734102:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fa93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876946942183680:0@lo:400: 00000100:00100000:3.0:1789996191.734165:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789996191.734208:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789996191.734215:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fa92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1876946942183808:0@lo:400: 00000100:00100000:3.0:1789996191.734237:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789996191.734272:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942183680 00000100:00100000:3.0:1789996191.734303:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942183680 00000100:00100000:3.0:1789996191.734341:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942183808 00000100:00100000:3.0:1789996191.734345:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942183808 00000100:00100000:3.0:1789996191.734367:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789996191.734375:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fa73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876946942183680:12345-0@lo:400: 00000100:00100000:3.0:1789996191.734418:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fa73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876946942183680:12345-0@lo:400: Request processed in 43us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996191.734424:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789996191.734437:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789996191.734442:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fa70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876946942183808:12345-0@lo:400: 00000100:00100000:3.0:1789996191.734463:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fa70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876946942183808:12345-0@lo:400: Request processed in 22us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996191.734475:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:3.0:1789996191.734505:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e086fa92a00 x1876946942183808/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789996207 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789996191.734517:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fa92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1876946942183808:0@lo:400: 00010000:00080000:3.0:1789996191.734526:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e086fa93480 x1876946942183680/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789996207 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789996191.734534:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fa93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876946942183680:0@lo:400: 00000100:00080000:0.0:1789996191.734626:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789996191.735176:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fa93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3314:1876946942184064:0@lo:400: 00000100:00100000:0.0:1789996191.735212:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789996191.736363:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942184064 00000100:00100000:3.0:1789996191.736372:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942184064 00000100:00100000:3.0:1789996191.736431:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789996191.736439:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0879938e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876946942184064:12345-0@lo:400: 00000100:00080000:2.0:1789996191.736578:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789996191.737583:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0879938e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876946942184064:12345-0@lo:400: Request processed in 1141us (2366us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996191.737594:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:0.0:1789996191.742327:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e086fa93480 x1876946942184064/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789996207 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789996191.742346:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fa93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3314:1876946942184064:0@lo:400: 00010000:00010000:0.0:1789996192.106874:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789996193.128799:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789996193.371756:0:7998:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg437-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1789996194.153898:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789996194.793046:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789996194.793075:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0879939f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876946942184192:0@lo:13: 00000100:00100000:2.0:1789996194.793138:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996194.793602:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942184192 00000100:00100000:0.0:1789996194.793611:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942184192 00000100:00100000:0.0:1789996194.793663:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789996194.793672:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fa92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1876946942184192:12345-0@lo:13: 00002000:00000024:0.0:1789996194.793705:0:6692:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789996194.793759:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fa92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1876946942184192:12345-0@lo:13: Request processed in 89us (621us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996194.793767:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1789996194.794163:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789996194.794197:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e0879939f80 x1876946942184192/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789996210 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789996194.794218:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0879939f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876946942184192:0@lo:13: 00010000:00010000:0.0:1789996195.176841:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789996195.816719:0:5843:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789996195.816728:0:5843:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8e0849c2f000 from 30 10000000:01000000:1.0:1789996195.816735:0:5843:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789996195.816786:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.137@tcp lock: ffff8e08413f1000/0x4173739f0fc8062f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996195.816799:0:5843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.137@tcp lock: ffff8e08413f1000/0x4173739f0fc8062f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996195.816810:0:5843:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.137@tcp lock: ffff8e08413f1000/0x4173739f0fc8062f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789996195.816832:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0849c74a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5843:1876946942184320:0@lo:101: 00000100:00100000:1.0:1789996195.816903:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996195.816966:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0858c43840 going to sleep for 11 seconds 00000100:00100000:3.0:1789996195.817231:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942184320 00000100:00100000:3.0:1789996195.817240:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942184320 00000100:00100000:3.0:1789996195.817309:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1789996195.817320:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852ba2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0c28cd8-555e-481f-bd03-c3b02aee51c5+13:5843:x1876946942184320:12345-0@lo:101: 00010000:00010000:3.0:1789996195.817334:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789996195.817349:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e08429c7c00/0x4173739f0fc80636 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4173739f0fc8062f expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996195.817508:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e08429c7c00/0x4173739f0fc80636 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4173739f0fc8062f expref: 14 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996195.817522:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e08429c7c00/0x4173739f0fc80636 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4173739f0fc8062f expref: 14 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996195.817583:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e08429c7c00, rc 0) 00000100:00100000:3.0:1789996195.817692:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852ba2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0c28cd8-555e-481f-bd03-c3b02aee51c5+14:5843:x1876946942184320:12345-0@lo:101: Request processed in 374us (789us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996195.817699:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1789996195.820965:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0849c74a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5843:1876946942184320:0@lo:101: 00010000:00010000:0.0:1789996195.821004:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.137@tcp lock: ffff8e08413f1000/0x4173739f0fc8062f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc80636 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996195.821016:0:5843:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.137@tcp lock: ffff8e08413f1000/0x4173739f0fc8062f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4173739f0fc80636 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789996195.821095:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e087993ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5843:1876946942184448:0@lo:501: 00000100:00100000:0.0:1789996195.821152:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996195.821219:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0741b00f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789996195.825250:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942184448 00000100:00100000:2.0:1789996195.825269:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942184448 00000100:00100000:2.0:1789996195.825365:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1789996195.825377:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852ba2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+14:5843:x1876946942184448:12345-0@lo:501: 00000100:00100000:2.0:1789996195.826054:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852ba2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+14:5843:x1876946942184448:12345-0@lo:501: Request processed in 678us (4900us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996195.826065:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1789996195.826176:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e087993ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5843:1876946942184448:0@lo:501: 00000100:00100000:0.0:1789996195.826238:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e087993ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5843:1876946942184576:0@lo:503: 00000100:00100000:0.0:1789996195.826287:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996195.826327:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0741b00f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789996195.826402:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942184576 00000100:00100000:3.0:1789996195.826408:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942184576 00000100:00100000:3.0:1789996195.826452:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1789996195.826460:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852ba0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0c28cd8-555e-481f-bd03-c3b02aee51c5+14:5843:x1876946942184576:12345-0@lo:503: 00000100:00100000:3.0:1789996195.826808:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852ba0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0c28cd8-555e-481f-bd03-c3b02aee51c5+14:5843:x1876946942184576:12345-0@lo:503: Request processed in 348us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996195.826814:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1789996195.827279:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e087993ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5843:1876946942184576:0@lo:503: 00000100:00100000:0.0:1789996195.836001:0:8102:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e087993ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0c28cd8-555e-481f-bd03-c3b02aee51c5:8102:1876946942184704:0@lo:502: 00000100:00100000:0.0:1789996195.836095:0:8102:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996195.836144:0:8102:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0741b009c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789996195.836162:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942184704 00000100:00100000:2.0:1789996195.836170:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942184704 00000100:00100000:2.0:1789996195.836235:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1789996195.836254:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852ba3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+14:8102:x1876946942184704:12345-0@lo:502: 00000100:00100000:2.0:1789996195.837001:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852ba3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+14:8102:x1876946942184704:12345-0@lo:502: Request processed in 754us (903us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996195.837011:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1789996195.840367:0:8102:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e087993ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0c28cd8-555e-481f-bd03-c3b02aee51c5:8102:1876946942184704:0@lo:502: 00000100:00100000:0.0:1789996195.840469:0:8102:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e087993ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0c28cd8-555e-481f-bd03-c3b02aee51c5:8102:1876946942184832:0@lo:502: 00000100:00100000:0.0:1789996195.840574:0:8102:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996195.840635:0:8102:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0741b009c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789996195.840737:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942184832 00000100:00100000:2.0:1789996195.840746:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942184832 00000100:00100000:2.0:1789996195.840854:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1789996195.840864:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852ba1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0c28cd8-555e-481f-bd03-c3b02aee51c5+14:8102:x1876946942184832:12345-0@lo:502: 00000100:00100000:2.0:1789996195.841233:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852ba1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0c28cd8-555e-481f-bd03-c3b02aee51c5+14:8102:x1876946942184832:12345-0@lo:502: Request processed in 371us (659us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996195.841241:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1789996195.841319:0:8102:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e087993ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0c28cd8-555e-481f-bd03-c3b02aee51c5:8102:1876946942184832:0@lo:502: 00000040:00080000:0.0:1789996195.841344:0:8102:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1789996195.844761:0:5843:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1789996195.844797:0:5843:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.137@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789996195.844811:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.137@tcp lock: ffff8e08413f1000/0x4173739f0fc8062f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc80636 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996195.844825:0:5843:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.137@tcp lock: ffff8e08413f1000/0x4173739f0fc8062f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc80636 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789996195.844839:0:5843:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1789996195.844843:0:5843:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:1.0:1789996195.844846:0:5843:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1789996195.844894:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.137@tcp lock: ffff8e08413f1800/0x4173739f0fc8063d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996195.844921:0:5843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.137@tcp lock: ffff8e08413f1800/0x4173739f0fc8063d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996195.844933:0:5843:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.137@tcp lock: ffff8e08413f1800/0x4173739f0fc8063d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789996195.844956:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0849c75f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5843:1876946942184960:0@lo:101: 00000100:00100000:1.0:1789996195.845145:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996195.845246:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0858c43c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789996195.849177:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942184960 00000100:00100000:2.0:1789996195.849195:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942184960 00000100:00100000:2.0:1789996195.849296:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1789996195.849306:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852ba1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+14:5843:x1876946942184960:12345-0@lo:101: 00010000:00010000:2.0:1789996195.849322:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789996195.849338:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e0842de5a00/0x4173739f0fc80644 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4173739f0fc8063d expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996195.849366:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e0842de5a00/0x4173739f0fc80644 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4173739f0fc8063d expref: 15 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996195.849377:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e0842de5a00/0x4173739f0fc80644 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4173739f0fc8063d expref: 15 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996195.849386:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e0842de5a00, rc 0) 00000100:00100000:2.0:1789996195.849463:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852ba1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+15:5843:x1876946942184960:12345-0@lo:101: Request processed in 159us (4318us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996195.849470:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1789996195.849561:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0849c75f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5843:1876946942184960:0@lo:101: 00010000:00010000:1.0:1789996195.849580:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.137@tcp lock: ffff8e08413f1800/0x4173739f0fc8063d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc80644 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996195.849590:0:5843:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.137@tcp lock: ffff8e08413f1800/0x4173739f0fc8063d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x4173739f0fc80644 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789996195.849662:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0849c75f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5843:1876946942185088:0@lo:501: 00000100:00100000:1.0:1789996195.849694:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996195.852340:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0858c43c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789996195.852468:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942185088 00000100:00100000:3.0:1789996195.852477:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942185088 00000100:00100000:0.0:1789996195.852570:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1789996195.852583:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852ba1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0c28cd8-555e-481f-bd03-c3b02aee51c5+15:5843:x1876946942185088:12345-0@lo:501: 00000100:00100000:0.0:1789996195.852948:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852ba1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0c28cd8-555e-481f-bd03-c3b02aee51c5+15:5843:x1876946942185088:12345-0@lo:501: Request processed in 368us (3252us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996195.852956:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1789996195.853930:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0849c75f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5843:1876946942185088:0@lo:501: 00000100:00100000:1.0:1789996195.854005:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0849c75f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5843:1876946942185216:0@lo:503: 00000100:00100000:1.0:1789996195.854064:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996195.854105:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0858c43c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789996195.854244:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942185216 00000100:00100000:2.0:1789996195.854252:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942185216 00000100:00100000:2.0:1789996195.855825:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1789996195.855842:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852ba0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+15:5843:x1876946942185216:12345-0@lo:503: 00000100:00100000:2.0:1789996195.857020:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852ba0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+15:5843:x1876946942185216:12345-0@lo:503: Request processed in 1179us (2950us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996195.857042:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1789996195.857594:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0849c75f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5843:1876946942185216:0@lo:503: 00000100:00100000:2.0:1789996195.858261:0:8103:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fa91880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0c28cd8-555e-481f-bd03-c3b02aee51c5:8103:1876946942185344:0@lo:502: 00000100:00100000:2.0:1789996195.859038:0:8103:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996195.859219:0:8103:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0742281e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789996195.860242:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942185344 00000100:00100000:3.0:1789996195.860252:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942185344 00000100:00100000:3.0:1789996195.860375:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1789996195.860387:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852ba3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0c28cd8-555e-481f-bd03-c3b02aee51c5+15:8103:x1876946942185344:12345-0@lo:502: 00000100:00100000:3.0:1789996195.861265:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852ba3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0c28cd8-555e-481f-bd03-c3b02aee51c5+15:8103:x1876946942185344:12345-0@lo:502: Request processed in 878us (2225us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996195.861275:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1789996195.861575:0:8103:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fa91880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0c28cd8-555e-481f-bd03-c3b02aee51c5:8103:1876946942185344:0@lo:502: 00000020:01000000:2.0:1789996195.861624:0:8103:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789996195.861636:0:8103:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789996195.861639:0:8103:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789996195.861644:0:8103:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789996195.861646:0:8103:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1789996195.861677:0:8103:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fa91880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0c28cd8-555e-481f-bd03-c3b02aee51c5:8103:1876946942185472:0@lo:502: 00000100:00100000:2.0:1789996195.861726:0:8103:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996195.862434:0:8103:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e084a778240 going to sleep for 11 seconds 00000100:00100000:0.0:1789996195.864485:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942185472 00000100:00100000:0.0:1789996195.864500:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942185472 00000100:00100000:0.0:1789996195.864587:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1789996195.864599:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852ba3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+15:8103:x1876946942185472:12345-0@lo:502: 00000100:00100000:0.0:1789996195.865658:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852ba3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+15:8103:x1876946942185472:12345-0@lo:502: Request processed in 1057us (3927us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996195.865670:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1789996195.865833:0:8103:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fa91880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0c28cd8-555e-481f-bd03-c3b02aee51c5:8103:1876946942185472:0@lo:502: 00000020:01000000:3.0:1789996195.865869:0:8103:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789996195.865877:0:8103:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789996195.865879:0:8103:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:3.0:1789996195.865884:0:8103:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:1.0:1789996195.866056:0:5843:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:1.0:1789996195.866083:0:5843:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.137@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1789996195.866094:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.137@tcp lock: ffff8e08413f1800/0x4173739f0fc8063d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc80644 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996195.866119:0:5843:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.137@tcp lock: ffff8e08413f1800/0x4173739f0fc8063d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc80644 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789996195.866130:0:5843:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789996195.866132:0:5843:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8e08709bf800 from 30 10000000:01000000:1.0:1789996195.866135:0:5843:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789996195.866166:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.137@tcp lock: ffff8e08413f0000/0x4173739f0fc8064b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996195.866175:0:5843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.137@tcp lock: ffff8e08413f0000/0x4173739f0fc8064b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996195.866184:0:5843:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.137@tcp lock: ffff8e08413f0000/0x4173739f0fc8064b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789996195.866215:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0849c75f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5843:1876946942185600:0@lo:101: 00000100:00100000:1.0:1789996195.866255:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996195.866295:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0858c43c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789996195.866436:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942185600 00000100:00100000:3.0:1789996195.866449:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942185600 00000100:00100000:3.0:1789996195.866490:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1789996195.866498:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852ba2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0c28cd8-555e-481f-bd03-c3b02aee51c5+15:5843:x1876946942185600:12345-0@lo:101: 00010000:00010000:3.0:1789996195.866509:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789996195.866522:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e08429c6a00/0x4173739f0fc80652 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4173739f0fc8064b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996195.866577:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e08429c6a00/0x4173739f0fc80652 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4173739f0fc8064b expref: 16 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996195.866588:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e08429c6a00/0x4173739f0fc80652 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4173739f0fc8064b expref: 16 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996195.866597:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e08429c6a00, rc 0) 00000100:00100000:3.0:1789996195.866635:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852ba2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0c28cd8-555e-481f-bd03-c3b02aee51c5+16:5843:x1876946942185600:12345-0@lo:101: Request processed in 138us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996195.866643:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1789996195.866658:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0849c75f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5843:1876946942185600:0@lo:101: 00010000:00010000:0.0:1789996195.866675:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.137@tcp lock: ffff8e08413f0000/0x4173739f0fc8064b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc80652 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996195.866685:0:5843:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.137@tcp lock: ffff8e08413f0000/0x4173739f0fc8064b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x4173739f0fc80652 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789996195.866734:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e087993ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5843:1876946942185728:0@lo:501: 00000100:00100000:0.0:1789996195.866760:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996195.866788:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0741b00b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789996195.866932:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942185728 00000100:00100000:1.0:1789996195.866937:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942185728 00000100:00100000:1.0:1789996195.866969:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1789996195.866976:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852ba3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0c28cd8-555e-481f-bd03-c3b02aee51c5+16:5843:x1876946942185728:12345-0@lo:501: 00000100:00100000:1.0:1789996195.867381:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852ba3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0c28cd8-555e-481f-bd03-c3b02aee51c5+16:5843:x1876946942185728:12345-0@lo:501: Request processed in 404us (619us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996195.867389:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1789996195.868392:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e087993ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5843:1876946942185728:0@lo:501: 00000100:00100000:0.0:1789996195.868467:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e087993ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5843:1876946942185856:0@lo:503: 00000100:00100000:0.0:1789996195.868519:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996195.868577:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0741b00b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789996195.868642:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942185856 00000100:00100000:3.0:1789996195.868648:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942185856 00000100:00100000:3.0:1789996195.868694:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1789996195.868703:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852ba1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0c28cd8-555e-481f-bd03-c3b02aee51c5+16:5843:x1876946942185856:12345-0@lo:503: 00000100:00100000:3.0:1789996195.868915:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852ba1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0c28cd8-555e-481f-bd03-c3b02aee51c5+16:5843:x1876946942185856:12345-0@lo:503: Request processed in 212us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996195.868922:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1789996195.869318:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e087993ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5843:1876946942185856:0@lo:503: 00000100:00100000:1.0:1789996195.869839:0:8104:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0849c74700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0c28cd8-555e-481f-bd03-c3b02aee51c5:8104:1876946942185984:0@lo:502: 00000100:00100000:1.0:1789996195.869902:0:8104:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996195.869938:0:8104:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e087056c540 going to sleep for 11 seconds 00000100:00100000:2.0:1789996195.870121:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942185984 00000100:00100000:2.0:1789996195.870128:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942185984 00000100:00100000:2.0:1789996195.870167:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1789996195.870176:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852ba2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0c28cd8-555e-481f-bd03-c3b02aee51c5+16:8104:x1876946942185984:12345-0@lo:502: 00000100:00100000:2.0:1789996195.870402:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852ba2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0c28cd8-555e-481f-bd03-c3b02aee51c5+16:8104:x1876946942185984:12345-0@lo:502: Request processed in 226us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996195.870409:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1789996195.871286:0:8104:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0849c74700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0c28cd8-555e-481f-bd03-c3b02aee51c5:8104:1876946942185984:0@lo:502: 00000100:00100000:1.0:1789996195.871345:0:8104:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0849c74700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0c28cd8-555e-481f-bd03-c3b02aee51c5:8104:1876946942186112:0@lo:502: 00000100:00100000:1.0:1789996195.871386:0:8104:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996195.871585:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942186112 00000100:00100000:0.0:1789996195.871591:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942186112 00000100:00100000:0.0:1789996195.871623:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1789996195.871631:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852b6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+16:8104:x1876946942186112:12345-0@lo:502: 00000100:00100000:0.0:1789996195.871971:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852b6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+16:8104:x1876946942186112:12345-0@lo:502: Request processed in 339us (582us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996195.871979:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1789996195.872433:0:8104:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e087056c540 going to sleep for 11 seconds 00000100:00100000:1.0:1789996195.872452:0:8104:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0849c74700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0c28cd8-555e-481f-bd03-c3b02aee51c5:8104:1876946942186112:0@lo:502: 00000040:00080000:1.0:1789996195.872481:0:8104:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:3.0:1789996195.873087:0:5843:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:3.0:1789996195.873130:0:5843:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.137@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789996195.873140:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.137@tcp lock: ffff8e08413f0000/0x4173739f0fc8064b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc80652 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996195.873170:0:5843:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.137@tcp lock: ffff8e08413f0000/0x4173739f0fc8064b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc80652 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789996195.873181:0:5843:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789996195.873184:0:5843:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8e08709bf800 from 5 10000000:01000000:3.0:1789996195.873187:0:5843:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789996195.873232:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.137@tcp lock: ffff8e08429c7600/0x4173739f0fc80659 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996195.873241:0:5843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.137@tcp lock: ffff8e08429c7600/0x4173739f0fc80659 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996195.873251:0:5843:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.137@tcp lock: ffff8e08429c7600/0x4173739f0fc80659 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789996195.873271:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fa71880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5843:1876946942186240:0@lo:101: 00000100:00100000:3.0:1789996195.873317:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789996195.873372:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0742b28e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789996195.873605:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942186240 00000100:00100000:2.0:1789996195.873614:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942186240 00000100:00100000:2.0:1789996195.873656:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1789996195.873665:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852b6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0c28cd8-555e-481f-bd03-c3b02aee51c5+16:5843:x1876946942186240:12345-0@lo:101: 00010000:00010000:2.0:1789996195.873677:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789996195.873692:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e0842de4400/0x4173739f0fc80660 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4173739f0fc80659 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996195.873731:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e0842de4400/0x4173739f0fc80660 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4173739f0fc80659 expref: 17 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996195.873742:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e0842de4400/0x4173739f0fc80660 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4173739f0fc80659 expref: 17 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996195.873752:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e0842de4400, rc 0) 00000100:00100000:2.0:1789996195.873798:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852b6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0c28cd8-555e-481f-bd03-c3b02aee51c5+17:5843:x1876946942186240:12345-0@lo:101: Request processed in 135us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996195.873804:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1789996195.875604:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fa71880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5843:1876946942186240:0@lo:101: 00010000:00010000:3.0:1789996195.875628:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.137@tcp lock: ffff8e08429c7600/0x4173739f0fc80659 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc80660 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996195.875640:0:5843:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.137@tcp lock: ffff8e08429c7600/0x4173739f0fc80659 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4173739f0fc80660 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789996195.875708:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fa71880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5843:1876946942186368:0@lo:256: 00000100:00100000:3.0:1789996195.875763:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789996195.875812:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0742b28e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789996195.878586:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942186368 00000100:00100000:2.0:1789996195.878600:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942186368 00000100:00100000:2.0:1789996195.878660:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1789996195.878670:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852b6e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0c28cd8-555e-481f-bd03-c3b02aee51c5+17:5843:x1876946942186368:12345-0@lo:256: 20000000:01000000:2.0:1789996195.878696:0:5841:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789996195.878721:0:5841:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789996195.878725:0:5841:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:2.0:1789996195.879004:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852b6e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0c28cd8-555e-481f-bd03-c3b02aee51c5+17:5843:x1876946942186368:12345-0@lo:256: Request processed in 334us (3239us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996195.879013:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1789996195.879237:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fa71880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5843:1876946942186368:0@lo:256: 10000000:01000000:3.0:1789996195.879293:0:5843:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.137@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789996195.879304:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.137@tcp lock: ffff8e08429c7600/0x4173739f0fc80659 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc80660 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996195.879315:0:5843:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.137@tcp lock: ffff8e08429c7600/0x4173739f0fc80659 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc80660 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789996195.879326:0:5843:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1789996195.879330:0:5843:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:3.0:1789996195.879333:0:5843:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1789996195.879365:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.137@tcp lock: ffff8e08429c6200/0x4173739f0fc80667 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996195.879374:0:5843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.137@tcp lock: ffff8e08429c6200/0x4173739f0fc80667 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996195.879383:0:5843:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.137@tcp lock: ffff8e08429c6200/0x4173739f0fc80667 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789996195.879400:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fa71880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5843:1876946942186496:0@lo:101: 00000100:00100000:3.0:1789996195.879443:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789996195.879480:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0742b28e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789996195.879982:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942186496 00000100:00100000:0.0:1789996195.879989:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942186496 00000100:00100000:0.0:1789996195.880033:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1789996195.880041:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852b6c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+17:5843:x1876946942186496:12345-0@lo:101: 00010000:00010000:0.0:1789996195.880050:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789996195.880065:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e0840030400/0x4173739f0fc8066e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x4173739f0fc80667 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996195.880087:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e0840030400/0x4173739f0fc8066e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4173739f0fc80667 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996195.880107:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e0840030400/0x4173739f0fc8066e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4173739f0fc80667 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996195.880116:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e0840030400, rc 0) 00000100:00100000:0.0:1789996195.880161:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852b6c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+18:5843:x1876946942186496:12345-0@lo:101: Request processed in 121us (718us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996195.880168:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1789996195.880526:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fa71880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5843:1876946942186496:0@lo:101: 00010000:00010000:3.0:1789996195.880580:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.137@tcp lock: ffff8e08429c6200/0x4173739f0fc80667 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc8066e expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996195.880589:0:5843:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.137@tcp lock: ffff8e08429c6200/0x4173739f0fc80667 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x4173739f0fc8066e expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789996195.880656:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fa71880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5843:1876946942186624:0@lo:501: 00000100:00100000:3.0:1789996195.880687:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789996195.880721:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0742b28e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789996195.880969:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942186624 00000100:00100000:2.0:1789996195.880975:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942186624 00000100:00100000:2.0:1789996195.881012:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1789996195.881020:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852b6fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0c28cd8-555e-481f-bd03-c3b02aee51c5+18:5843:x1876946942186624:12345-0@lo:501: 00000100:00100000:2.0:1789996195.882478:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852b6fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0c28cd8-555e-481f-bd03-c3b02aee51c5+18:5843:x1876946942186624:12345-0@lo:501: Request processed in 1452us (1783us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996195.882491:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1789996195.887682:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fa71880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5843:1876946942186624:0@lo:501: 00000100:00100000:3.0:1789996195.887756:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fa71880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5843:1876946942186752:0@lo:503: 00000100:00100000:3.0:1789996195.887836:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789996195.887875:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0742b28e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789996195.888606:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942186752 00000100:00100000:1.0:1789996195.888615:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942186752 00000100:00100000:1.0:1789996195.888667:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1789996195.888676:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852b6d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0c28cd8-555e-481f-bd03-c3b02aee51c5+18:5843:x1876946942186752:12345-0@lo:503: 00000100:00100000:1.0:1789996195.889059:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852b6d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0c28cd8-555e-481f-bd03-c3b02aee51c5+18:5843:x1876946942186752:12345-0@lo:503: Request processed in 383us (1223us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996195.889068:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1789996195.889418:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fa71880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5843:1876946942186752:0@lo:503: 00000100:00100000:1.0:1789996195.892409:0:8105:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0849c74700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0c28cd8-555e-481f-bd03-c3b02aee51c5:8105:1876946942186880:0@lo:502: 00000100:00100000:1.0:1789996195.892904:0:8105:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996195.892989:0:8105:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0858c43c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789996195.898373:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942186880 00000100:00100000:0.0:1789996195.898388:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942186880 00000100:00100000:0.0:1789996195.898513:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1789996195.898524:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852b6d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+18:8105:x1876946942186880:12345-0@lo:502: 00000100:00100000:0.0:1789996195.898992:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852b6d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+18:8105:x1876946942186880:12345-0@lo:502: Request processed in 469us (6088us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996195.899000:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1789996195.899730:0:8105:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0849c74700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0c28cd8-555e-481f-bd03-c3b02aee51c5:8105:1876946942186880:0@lo:502: 00000020:01000000:2.0:1789996195.899776:0:8105:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789996195.899783:0:8105:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1789996195.899791:0:8105:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789996195.899794:0:8105:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1789996195.899799:0:8105:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1789996195.899804:0:8105:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.137@tcp to nid 0x20000c0a8cc89 (192.168.204.137@tcp) 00000020:01000000:2.0:1789996195.899828:0:8105:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1789996195.899831:0:8105:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789996195.899847:0:8105:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8e087665b380) 00000020:00000080:2.0:1789996195.899869:0:8105:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:2.0:1789996195.899874:0:8105:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1789996195.899954:0:8105:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1789996195.899961:0:8105:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:2.0:1789996195.899967:0:8105:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4173739f0fc8067c 00010000:00080000:2.0:1789996195.899998:0:8105:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e08704c3000@lustre-OST0001-osc-MDT0000: add connection 192.168.204.137@tcp at head 00010000:00010000:2.0:1789996195.903945:0:8105:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:2.0:1789996195.906917:0:8105:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:2.0:1789996195.906939:0:8105:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1789996195.910019:0:8105:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789996195.912520:0:8105:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789996195.913508:0:8105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:2.0:1789996195.913613:0:8105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:1.0:1789996195.914501:0:8106:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789996195.914508:0:8106:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1789996195.915862:0:8105:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789996195.915876:0:8105:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1789996195.915911:0:8105:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1789996195.915934:0:8105:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4173739f0fc80683 00000100:00080000:2.0:1789996195.915947:0:8105:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789996195.915960:0:8105:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8e08704c3000 using connection 192.168.204.137@tcp/0@lo 00000100:00100000:2.0:1789996195.922352:0:8105:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e086fa92300 x1876946942187008/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789996195.923879:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fa92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3312:1876946942187008:0@lo:8: 00000100:00100000:3.0:1789996195.923963:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789996195.924042:0:8105:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1789996195.924137:0:8105:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789996195.924144:0:8105:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789996195.924146:0:8105:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1789996195.924149:0:8105:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789996195.924153:0:8105:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789996195.924155:0:8105:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789996195.924158:0:8105:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789996195.924160:0:8105:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1789996195.924196:0:8105:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fa73b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0c28cd8-555e-481f-bd03-c3b02aee51c5:8105:1876946942187136:0@lo:502: 00000100:00100000:3.0:1789996195.924259:0:8105:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789996195.924287:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942187136 00000100:00100000:3.0:1789996195.924294:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942187136 00000100:00100000:3.0:1789996195.924335:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1789996195.924339:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0879938380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1876946942187392:0@lo:400: 00000100:00100000:3.0:1789996195.924344:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852b6d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0c28cd8-555e-481f-bd03-c3b02aee51c5+18:8105:x1876946942187136:12345-0@lo:502: 00000100:00100000:0.0:1789996195.924370:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996195.924391:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789996195.924397:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e087993b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876946942187520:0@lo:400: 00000100:00100000:0.0:1789996195.924417:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996195.924443:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942187392 00000100:00100000:0.0:1789996195.924447:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942187392 00000100:00100000:0.0:1789996195.924479:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789996195.924485:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e087993a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876946942187392:12345-0@lo:400: 00000100:00100000:0.0:1789996195.924525:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e087993a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876946942187392:12345-0@lo:400: Request processed in 40us (153us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996195.924531:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789996195.924576:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942187008 00000100:00100000:0.0:1789996195.924580:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942187008 00000100:00100000:0.0:1789996195.924594:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942187520 00000100:00100000:0.0:1789996195.924596:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942187520 00000100:00100000:0.0:1789996195.924612:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789996195.924617:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852b6d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0c28cd8-555e-481f-bd03-c3b02aee51c5+18:8105:x1876946942187136:12345-0@lo:502: Request processed in 274us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996195.924617:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e087993a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1876946942187520:12345-0@lo:400: 00000100:00100000:3.0:1789996195.924624:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1789996195.924644:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e087993a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1876946942187520:12345-0@lo:400: Request processed in 27us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996195.924650:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789996195.924662:0:8105:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0742b28540 going to sleep for 11 seconds 00000100:00100000:0.0:1789996195.924667:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789996195.924671:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fa71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3312:x1876946942187008:12345-0@lo:8: 00000100:00100000:3.0:1789996195.924681:0:8105:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fa73b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0c28cd8-555e-481f-bd03-c3b02aee51c5:8105:1876946942187136:0@lo:502: 00010000:00080000:0.0:1789996195.924691:0:6689:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 237 last 0 00000020:01000000:3.0:1789996195.924706:0:8105:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789996195.924709:0:8105:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789996195.924711:0:8105:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:3.0:1789996195.924715:0:8105:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:00000080:0.0:1789996195.924721:0:6689:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4173739f0fc8068a 00002000:00100000:0.0:1789996195.924734:0:6689:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8e0876bb2000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a3f ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1789996195.924738:0:6689:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:0.0:1789996195.924742:0:6689:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00000020:01000000:3.0:1789996195.924764:0:5843:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:3.0:1789996195.924786:0:5843:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.137@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1789996195.924795:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.137@tcp lock: ffff8e08429c6200/0x4173739f0fc80667 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc8066e expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996195.924806:0:5843:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.137@tcp lock: ffff8e08429c6200/0x4173739f0fc80667 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc8066e expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789996195.924815:0:5843:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1789996195.924818:0:5843:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8e08545d19c0 from 1 10000000:01000000:3.0:1789996195.924820:0:5843:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1789996195.924841:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.137@tcp lock: ffff8e08429c6e00/0x4173739f0fc80691 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996195.924849:0:5843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.137@tcp lock: ffff8e08429c6e00/0x4173739f0fc80691 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00100000:0.0:1789996195.924853:0:6689:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00010000:00010000:3.0:1789996195.924857:0:5843:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.137@tcp lock: ffff8e08429c6e00/0x4173739f0fc80691 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789996195.924868:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fa73b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5843:1876946942187776:0@lo:101: 00000100:00100000:3.0:1789996195.924900:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789996195.924916:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0742b28540 going to sleep for 11 seconds 00002000:00080000:0.0:1789996195.925358:0:6689:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789996195.925384:0:6689:0:(import.c:65:import_set_state_nolock()) ffff8e0876bb5000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789996195.925437:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fa71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3312:x1876946942187008:12345-0@lo:8: Request processed in 764us (1474us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996195.925443:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1789996195.925488:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e087993b100 x1876946942187520/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789996211 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789996195.925500:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e087993b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876946942187520:0@lo:400: 00010000:00080000:0.0:1789996195.925510:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e0879938380 x1876946942187392/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789996211 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789996195.925519:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0879938380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1876946942187392:0@lo:400: 00000100:00100000:0.0:1789996195.925571:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942187776 00000100:00100000:0.0:1789996195.925576:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942187776 00000100:00100000:0.0:1789996195.925604:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1789996195.925611:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852b6cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+18:5843:x1876946942187776:12345-0@lo:101: 00010000:00010000:0.0:1789996195.925619:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789996195.925633:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e0840030600/0x4173739f0fc80698 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x4173739f0fc80691 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996195.925664:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e0840030600/0x4173739f0fc80698 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4173739f0fc80691 expref: 19 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996195.925675:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e0840030600/0x4173739f0fc80698 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4173739f0fc80691 expref: 19 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996195.925684:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e0840030600, rc 0) 00000100:00100000:0.0:1789996195.925714:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852b6cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+19:5843:x1876946942187776:12345-0@lo:101: Request processed in 103us (813us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996195.925720:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1789996195.925751:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fa73b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5843:1876946942187776:0@lo:101: 00010000:00010000:0.0:1789996195.925765:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.137@tcp lock: ffff8e08429c6e00/0x4173739f0fc80691 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc80698 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996195.925774:0:5843:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.137@tcp lock: ffff8e08429c6e00/0x4173739f0fc80691 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x4173739f0fc80698 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789996195.925821:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0879938380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5843:1876946942187904:0@lo:501: 00000100:00100000:0.0:1789996195.925847:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996195.925868:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942187904 00000100:00100000:0.0:1789996195.925872:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942187904 00000100:00100000:0.0:1789996195.925892:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1789996195.925898:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852b6f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0c28cd8-555e-481f-bd03-c3b02aee51c5+19:5843:x1876946942187904:12345-0@lo:501: 00000100:00100000:2.0:1789996195.926676:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e087993aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3316:1876946942187264:0@lo:400: 00000100:00100000:2.0:1789996195.926719:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996195.926798:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789996195.926806:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0879939c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3316:1876946942187648:0@lo:400: 00000100:00100000:2.0:1789996195.926833:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1789996195.926915:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e086fa92300 x1876946942187008/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789996205 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789996195.926925:0:3312:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789996195.926933:0:3312:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1789996195.926941:0:3312:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1789996195.926946:0:3312:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1789996195.926949:0:3312:0:(import.c:65:import_set_state_nolock()) ffff8e08704c3000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1789996195.926961:0:3312:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1789996195.926967:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fa92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3312:1876946942187008:0@lo:8: 00000100:00100000:0.0:1789996195.926982:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852b6f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0c28cd8-555e-481f-bd03-c3b02aee51c5+19:5843:x1876946942187904:12345-0@lo:501: Request processed in 1083us (1134us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789996195.926991:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1789996195.927069:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e08475d1cc0 going to sleep for 11 seconds 00000100:00080000:3.0:1789996195.927075:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789996195.927112:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0879938380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5843:1876946942187904:0@lo:501: 10000000:01000000:0.0:1789996195.927412:0:5843:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.137@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1789996195.927419:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.137@tcp lock: ffff8e08429c6e00/0x4173739f0fc80691 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc80698 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996195.927429:0:5843:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.137@tcp lock: ffff8e08429c6e00/0x4173739f0fc80691 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc80698 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789996195.927986:0:8106:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1789996195.928377:0:8106:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 237647832846ns, next at 0ns, rc = 0 00000100:00100000:1.0:1789996195.934780:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942187264 00000100:00100000:1.0:1789996195.934798:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942187264 00000100:00100000:1.0:1789996195.934863:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942187648 00000100:00100000:1.0:1789996195.934867:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942187648 00000100:00100000:1.0:1789996195.934903:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789996195.934925:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fa91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1876946942187264:12345-0@lo:400: 00000100:00100000:1.0:1789996195.935021:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fa91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1876946942187264:12345-0@lo:400: Request processed in 98us (8300us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996195.935029:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789996195.935046:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789996195.935053:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fa93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1876946942187648:12345-0@lo:400: 00000100:00100000:1.0:1789996195.935105:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fa93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1876946942187648:12345-0@lo:400: Request processed in 52us (8270us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996195.935111:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:1.0:1789996195.935131:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789996195.935166:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e0879939c00 x1876946942187648/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789996211 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789996195.935180:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0879939c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3316:1876946942187648:0@lo:400: 00010000:00080000:1.0:1789996195.935190:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e087993aa00 x1876946942187264/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789996211 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789996195.935211:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e087993aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3316:1876946942187264:0@lo:400: 00000004:00080000:0.0:1789996195.969812:0:8107:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:0.0:1789996195.969847:0:8107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e087993b100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8107:1876946942188160:0@lo:7: 00000100:00100000:0.0:1789996195.969920:0:8107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996195.969952:0:8107:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e08704a1780 going to sleep for 11 seconds 00000100:00100000:0.0:1789996195.969974:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942188160 00000100:00100000:0.0:1789996195.969982:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942188160 00000100:00100000:0.0:1789996195.970043:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789996195.970054:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0879938000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8107:x1876946942188160:12345-0@lo:7: 00000100:00080000:1.0:1789996195.970383:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789996195.975872:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0879938380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876946942188032:0@lo:13: 00000100:00100000:3.0:1789996195.975947:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996195.976381:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942188032 00000100:00100000:1.0:1789996195.976463:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942188032 00002000:00080000:0.0:1789996195.978850:0:6689:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:0.0:1789996195.978859:0:6689:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:0.0:1789996195.978952:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0879938000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:8107:x1876946942188160:12345-0@lo:7: Request processed in 8896us (9029us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996195.978962:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1789996195.979021:0:8107:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e087993b100 x1876946942188160/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789996211 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789996195.979037:0:8107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e087993b100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8107:1876946942188160:0@lo:7: 00000004:00080000:0.0:1789996195.979050:0:8107:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:0.0:1789996195.979098:0:8107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e087993b100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8107:1876946942188288:0@lo:5: 00000100:00100000:0.0:1789996195.979132:0:8107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996195.979166:0:8107:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e08704a1780 going to sleep for 11 seconds 00000100:00100000:0.0:1789996195.979186:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942188288 00000100:00100000:0.0:1789996195.979193:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942188288 00000100:00100000:0.0:1789996195.979237:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789996195.979245:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0879939880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:8107:x1876946942188288:12345-0@lo:5: 00002000:00080000:0.0:1789996195.979270:0:6690:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1789996195.979274:0:6690:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:1.0:1789996195.979484:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789996195.979494:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fa71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3316:x1876946942188032:12345-0@lo:13: 00000100:00100000:0.0:1789996195.990064:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0879939880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:8107:x1876946942188288:12345-0@lo:5: Request processed in 10809us (10921us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1789996195.990077:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00002000:00000024:1.0:1789996195.990331:0:6692:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:1.0:1789996195.990381:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fa71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3316:x1876946942188032:12345-0@lo:13: Request processed in 10889us (14434us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996195.990389:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1789996195.990661:0:8107:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e087993b100 x1876946942188288/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789996211 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789996195.990681:0:8107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e087993b100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8107:1876946942188288:0@lo:5: 00000004:00080000:3.0:1789996195.990694:0:8107:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00010000:00080000:1.0:1789996195.991106:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e0879938380 x1876946942188032/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789996211 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789996195.991123:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0879938380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876946942188032:0@lo:13: 00000004:00080000:2.0:1789996196.008493:0:5868:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00010000:00010000:0.0:1789996196.200800:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789996197.225864:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789996197.487659:0:7659:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:3.0:1789996197.487682:0:7659:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:2.0:1789996198.249261:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789996199.017332:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1789996199.017420:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927485056 00000100:00100000:3.0:1789996199.017431:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927485056 00000100:00100000:3.0:1789996199.017482:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 112 00000100:00100000:3.0:1789996199.017491:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852b6f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2361:x1876946927485056:12345-192.168.204.37@tcp:250: 00010000:00080000:3.0:1789996199.017522:0:5841:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from f78f7903-47ba-48a7-bb82-1f616cb85fc0@192.168.204.37@tcp t0 exp 0000000000000000 cur 240 last 0 00000020:00000080:3.0:1789996199.017597:0:5841:0:(genops.c:1384:class_connect()) connect: client f78f7903-47ba-48a7-bb82-1f616cb85fc0, cookie 0x4173739f0fc8069f 00000100:00080000:3.0:1789996199.017756:0:5841:0:(import.c:65:import_set_state_nolock()) ffff8e086fde6000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789996199.018052:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852b6f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f78f7903-47ba-48a7-bb82-1f616cb85fc0+5:2361:x1876946927485056:12345-192.168.204.37@tcp:250: Request processed in 559us (730us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996199.018061:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 112 00000100:00100000:3.0:1789996199.024604:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996199.026737:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927485184 00000100:00100000:0.0:1789996199.026753:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927485184 00000100:00100000:0.0:1789996199.026807:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 113 00000100:00100000:0.0:1789996199.026818:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852b6e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f78f7903-47ba-48a7-bb82-1f616cb85fc0+5:5587:x1876946927485184:12345-192.168.204.37@tcp:101: 00010000:00010000:0.0:1789996199.026835:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789996199.026853:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e0840031800/0x4173739f0fc806a6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b97003095e353b1 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996199.026881:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e0840031800/0x4173739f0fc806a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e353b1 expref: 6 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996199.026892:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e0840031800/0x4173739f0fc806a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e353b1 expref: 6 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996199.026901:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e0840031800, rc 0) 00000100:00100000:0.0:1789996199.026959:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852b6e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f78f7903-47ba-48a7-bb82-1f616cb85fc0+6:5587:x1876946927485184:12345-192.168.204.37@tcp:101: Request processed in 143us (2366us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996199.026974:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 113 00000100:00100000:1.0:1789996199.030599:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996199.031316:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927485312 00000100:00100000:2.0:1789996199.031328:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927485312 00000100:00100000:2.0:1789996199.031381:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 114 00000100:00100000:2.0:1789996199.031390:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852b6f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f78f7903-47ba-48a7-bb82-1f616cb85fc0+6:5587:x1876946927485312:12345-192.168.204.37@tcp:501: 00000100:00100000:2.0:1789996199.031682:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852b6f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f78f7903-47ba-48a7-bb82-1f616cb85fc0+6:5587:x1876946927485312:12345-192.168.204.37@tcp:501: Request processed in 291us (1092us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789996199.031690:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 114 00000100:00100000:0.0:1789996199.037003:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1789996199.037159:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927485440 00000100:00100000:3.0:1789996199.037172:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927485440 00000100:00100000:3.0:1789996199.037317:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 115 00000100:00100000:3.0:1789996199.037329:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852b6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f78f7903-47ba-48a7-bb82-1f616cb85fc0+6:5587:x1876946927485440:12345-192.168.204.37@tcp:101: 00010000:00010000:3.0:1789996199.037347:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789996199.037369:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e08429c6600/0x4173739f0fc806ad lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b97003095e353b8 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996199.037397:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e08429c6600/0x4173739f0fc806ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e353b8 expref: 7 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996199.037409:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e08429c6600/0x4173739f0fc806ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e353b8 expref: 7 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996199.037420:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e08429c6600, rc 0) 00000100:00100000:3.0:1789996199.037480:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852b6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f78f7903-47ba-48a7-bb82-1f616cb85fc0+7:5587:x1876946927485440:12345-192.168.204.37@tcp:101: Request processed in 153us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996199.037488:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 115 00000100:00100000:0.0:1789996199.039913:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996199.039984:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927485568 00000100:00100000:2.0:1789996199.039993:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927485568 00000100:00100000:2.0:1789996199.040195:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 116 00000100:00100000:2.0:1789996199.040207:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852b6e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f78f7903-47ba-48a7-bb82-1f616cb85fc0+7:5587:x1876946927485568:12345-192.168.204.37@tcp:501: 00000100:00100000:2.0:1789996199.040485:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852b6e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f78f7903-47ba-48a7-bb82-1f616cb85fc0+8:5587:x1876946927485568:12345-192.168.204.37@tcp:501: Request processed in 279us (578us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996199.040493:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 116 00000100:00100000:1.0:1789996199.046990:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1789996199.047169:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927485696 00000100:00100000:3.0:1789996199.047179:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927485696 00000100:00100000:3.0:1789996199.047361:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 117 00000100:00100000:3.0:1789996199.047372:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852b6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f78f7903-47ba-48a7-bb82-1f616cb85fc0+8:5587:x1876946927485696:12345-192.168.204.37@tcp:503: 00000100:00100000:3.0:1789996199.047976:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852b6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f78f7903-47ba-48a7-bb82-1f616cb85fc0+8:5587:x1876946927485696:12345-192.168.204.37@tcp:503: Request processed in 603us (992us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996199.047994:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 117 00000100:00100000:3.0:1789996199.056780:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996199.056973:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927485824 00000100:00100000:0.0:1789996199.056985:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927485824 00000100:00100000:0.0:1789996199.057171:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 118 00000100:00100000:0.0:1789996199.057190:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0870532050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f78f7903-47ba-48a7-bb82-1f616cb85fc0+8:5605:x1876946927485824:12345-192.168.204.37@tcp:502: 00000100:00100000:0.0:1789996199.057635:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0870532050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f78f7903-47ba-48a7-bb82-1f616cb85fc0+8:5605:x1876946927485824:12345-192.168.204.37@tcp:502: Request processed in 453us (865us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996199.058559:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 118 00000100:00100000:1.0:1789996199.089052:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1789996199.089198:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927485952 00000100:00100000:3.0:1789996199.089208:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927485952 00000100:00100000:3.0:1789996199.089264:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 119 00000100:00100000:3.0:1789996199.089274:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e08602c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f78f7903-47ba-48a7-bb82-1f616cb85fc0+8:5605:x1876946927485952:12345-192.168.204.37@tcp:502: 00000100:00100000:3.0:1789996199.089626:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e08602c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f78f7903-47ba-48a7-bb82-1f616cb85fc0+8:5605:x1876946927485952:12345-192.168.204.37@tcp:502: Request processed in 352us (593us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996199.089635:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 119 00000100:00100000:3.0:1789996199.092766:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1789996199.096440:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927486080 00000100:00100000:1.0:1789996199.096463:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927486080 00000100:00100000:1.0:1789996199.096527:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 120 00000100:00100000:1.0:1789996199.096537:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e08602ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f78f7903-47ba-48a7-bb82-1f616cb85fc0+8:5587:x1876946927486080:12345-192.168.204.37@tcp:101: 00010000:00010000:1.0:1789996199.096578:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789996199.096598:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e08413f0600/0x4173739f0fc806b4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b97003095e353e2 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996199.096633:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e08413f0600/0x4173739f0fc806b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e353e2 expref: 9 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996199.096916:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e08413f0600/0x4173739f0fc806b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e353e2 expref: 9 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996199.096928:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e08413f0600, rc 0) 00000100:00100000:0.0:1789996199.097216:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e08602ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f78f7903-47ba-48a7-bb82-1f616cb85fc0+9:5587:x1876946927486080:12345-192.168.204.37@tcp:101: Request processed in 676us (4454us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996199.097226:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 120 00000100:00100000:3.0:1789996199.101391:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1789996199.101502:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927486208 00000100:00100000:1.0:1789996199.101516:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927486208 00000100:00100000:1.0:1789996199.101600:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 121 00000100:00100000:1.0:1789996199.101610:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e08602cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f78f7903-47ba-48a7-bb82-1f616cb85fc0+9:5587:x1876946927486208:12345-192.168.204.37@tcp:256: 20000000:01000000:1.0:1789996199.101657:0:5840:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1789996199.101694:0:5840:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1789996199.101699:0:5840:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1789996199.101702:0:5840:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1789996199.101705:0:5840:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:1.0:1789996199.104266:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e08602cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f78f7903-47ba-48a7-bb82-1f616cb85fc0+9:5587:x1876946927486208:12345-192.168.204.37@tcp:256: Request processed in 2646us (2877us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996199.104289:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 121 00000100:00100000:3.0:1789996199.112750:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996199.113518:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927486336 00000100:00100000:0.0:1789996199.113528:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927486336 00000100:00100000:0.0:1789996199.113777:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 122 00000100:00100000:0.0:1789996199.113801:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e08602cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f78f7903-47ba-48a7-bb82-1f616cb85fc0+9:5587:x1876946927486336:12345-192.168.204.37@tcp:101: 00010000:00010000:0.0:1789996199.113819:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789996199.113836:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e0840031e00/0x4173739f0fc806bb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b97003095e353e9 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996199.113865:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e0840031e00/0x4173739f0fc806bb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e353e9 expref: 10 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996199.113878:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e0840031e00/0x4173739f0fc806bb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e353e9 expref: 10 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996199.113911:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e0840031e00, rc 0) 00000100:00100000:0.0:1789996199.113982:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e08602cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f78f7903-47ba-48a7-bb82-1f616cb85fc0+10:5587:x1876946927486336:12345-192.168.204.37@tcp:101: Request processed in 183us (1241us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996199.113990:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 122 00000100:00100000:0.0:1789996199.123441:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1789996199.123639:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927486464 00000100:00100000:1.0:1789996199.123648:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927486464 00000100:00100000:1.0:1789996199.123691:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 123 00000100:00100000:1.0:1789996199.123700:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e08602c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f78f7903-47ba-48a7-bb82-1f616cb85fc0+10:5587:x1876946927486464:12345-192.168.204.37@tcp:501: 00000100:00100000:1.0:1789996199.124898:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e08602c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f78f7903-47ba-48a7-bb82-1f616cb85fc0+10:5587:x1876946927486464:12345-192.168.204.37@tcp:501: Request processed in 1192us (1464us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996199.124909:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 123 00000100:00100000:1.0:1789996199.129258:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996199.129371:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927486592 00000100:00100000:2.0:1789996199.129393:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927486592 00000100:00100000:2.0:1789996199.129485:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 124 00000100:00100000:2.0:1789996199.129610:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e08602c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f78f7903-47ba-48a7-bb82-1f616cb85fc0+10:5587:x1876946927486592:12345-192.168.204.37@tcp:503: 00000100:00100000:2.0:1789996199.130147:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e08602c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f78f7903-47ba-48a7-bb82-1f616cb85fc0+10:5587:x1876946927486592:12345-192.168.204.37@tcp:503: Request processed in 639us (887us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996199.130156:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 124 00000100:00100000:1.0:1789996199.140509:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1789996199.141376:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927486720 00000100:00100000:3.0:1789996199.141390:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927486720 00000100:00100000:3.0:1789996199.141455:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 125 00000100:00100000:3.0:1789996199.141465:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e08602ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f78f7903-47ba-48a7-bb82-1f616cb85fc0+10:5607:x1876946927486720:12345-192.168.204.37@tcp:502: 00000100:00100000:3.0:1789996199.142380:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e08602ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f78f7903-47ba-48a7-bb82-1f616cb85fc0+10:5607:x1876946927486720:12345-192.168.204.37@tcp:502: Request processed in 912us (1878us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996199.142389:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 125 00000100:00100000:3.0:1789996199.154654:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996199.154815:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927486848 00000100:00100000:2.0:1789996199.154826:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927486848 00000100:00100000:2.0:1789996199.154871:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 126 00000100:00100000:2.0:1789996199.154882:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e08602c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f78f7903-47ba-48a7-bb82-1f616cb85fc0+10:5607:x1876946927486848:12345-192.168.204.37@tcp:502: 00000100:00100000:2.0:1789996199.155278:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e08602c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f78f7903-47ba-48a7-bb82-1f616cb85fc0+10:5607:x1876946927486848:12345-192.168.204.37@tcp:502: Request processed in 396us (648us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996199.155296:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 126 00000100:00100000:3.0:1789996199.167080:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996199.167296:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927486976 00000100:00100000:0.0:1789996199.167307:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927486976 00000100:00100000:0.0:1789996199.167356:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 4 00000100:00100000:0.0:1789996199.167364:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fa72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2361:x1876946927486976:12345-192.168.204.37@tcp:38: 00010000:00080000:0.0:1789996199.167393:0:5846:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 189efa8a-c7eb-4b69-9afa-1dd36d6775f1@192.168.204.37@tcp t0 exp 0000000000000000 cur 240 last 0 00000020:00000080:0.0:1789996199.167439:0:5846:0:(genops.c:1384:class_connect()) connect: client 189efa8a-c7eb-4b69-9afa-1dd36d6775f1, cookie 0x4173739f0fc806c2 00000004:00100000:0.0:1789996199.167473:0:5846:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:0.0:1789996199.167481:0:5846:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:0.0:1789996199.210713:0:5846:0:(import.c:65:import_set_state_nolock()) ffff8e0876bb1800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789996199.210874:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fa72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+6:2361:x1876946927486976:12345-192.168.204.37@tcp:38: Request processed in 43507us (43801us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996199.210885:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 4 00010000:00010000:3.0:1789996199.275055:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789996199.912824:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789996199.912853:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0879938a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876946942188416:0@lo:13: 00000100:00100000:1.0:1789996199.912930:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789996199.913173:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942188416 00000100:00100000:3.0:1789996199.913182:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942188416 00000100:00100000:3.0:1789996199.913253:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789996199.913263:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0849c76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876946942188416:12345-0@lo:13: 00002000:00000024:3.0:1789996199.913324:0:6691:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789996199.913373:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0849c76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876946942188416:12345-0@lo:13: Request processed in 111us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996199.913380:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:1.0:1789996199.913612:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789996199.913643:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e0879938a80 x1876946942188416/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789996215 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789996199.913660:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0879938a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876946942188416:0@lo:13: 00000100:00100000:3.0:1789996200.218629:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1789996200.218689:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996200.224815:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927487232 00000100:00100000:0.0:1789996200.224833:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927487232 00000100:00080000:2.0:1789996200.225091:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789996200.226749:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927487104 00000100:00100000:0.0:1789996200.226762:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927487104 00000100:00100000:0.0:1789996200.226813:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 5 00000100:00100000:0.0:1789996200.226824:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fa73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+7:5587:x1876946927487232:12345-192.168.204.37@tcp:41: 00000004:00000024:0.0:1789996200.226872:0:5847:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1789996200.226957:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fa73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+7:5587:x1876946927487232:12345-192.168.204.37@tcp:41: Request processed in 134us (8353us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996200.226980:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 5 00000100:00100000:0.0:1789996200.227004:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 6 00000100:00100000:0.0:1789996200.227012:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fa72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+6:0:x1876946927487104:12345-192.168.204.37@tcp:41: 00000004:00000024:0.0:1789996200.227024:0:5847:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1789996200.227046:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fa72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+6:0:x1876946927487104:12345-192.168.204.37@tcp:41: Request processed in 36us (8357us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996200.227053:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 6 00000100:00100000:3.0:1789996200.233085:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996200.233197:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927487360 00000100:00100000:0.0:1789996200.233207:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927487360 00000100:00100000:0.0:1789996200.233268:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 7 00000100:00100000:0.0:1789996200.233279:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fa73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+6:5587:x1876946927487360:12345-192.168.204.37@tcp:40: 00000100:00100000:0.0:1789996200.233406:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fa73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+6:5587:x1876946927487360:12345-192.168.204.37@tcp:40: Request processed in 128us (951us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996200.233414:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 7 00000100:00100000:2.0:1789996200.242581:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996200.242706:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996200.245281:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927487488 00000100:00100000:0.0:1789996200.245302:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927487488 00000100:00100000:0.0:1789996200.245366:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927487616 00000100:00100000:0.0:1789996200.245369:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927487616 00000100:00100000:0.0:1789996200.245388:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 7 00000100:00100000:0.0:1789996200.245396:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fa92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2361:x1876946927487488:12345-192.168.204.37@tcp:8: 00010000:00080000:0.0:1789996200.245424:0:6690:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 189efa8a-c7eb-4b69-9afa-1dd36d6775f1@192.168.204.37@tcp t0 exp 0000000000000000 cur 241 last 0 00000100:00100000:1.0:1789996200.245456:0:6688:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000020:00000080:0.0:1789996200.245459:0:6690:0:(genops.c:1384:class_connect()) connect: client 189efa8a-c7eb-4b69-9afa-1dd36d6775f1, cookie 0x4173739f0fc806c9 00000100:00100000:1.0:1789996200.245468:0:6688:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00002000:00100000:0.0:1789996200.245473:0:6690:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 189efa8a-c7eb-4b69-9afa-1dd36d6775f1/ffff8e0876bb0000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a3f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789996200.245485:0:6690:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:1.0:1789996200.245764:0:8222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 8 00000100:00100000:1.0:1789996200.245771:0:8222:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0876619c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2361:x1876946927487616:12345-192.168.204.37@tcp:8: 00010000:00080000:1.0:1789996200.245799:0:8222:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 189efa8a-c7eb-4b69-9afa-1dd36d6775f1@192.168.204.37@tcp t0 exp 0000000000000000 cur 241 last 0 00000020:00000080:1.0:1789996200.245826:0:8222:0:(genops.c:1384:class_connect()) connect: client 189efa8a-c7eb-4b69-9afa-1dd36d6775f1, cookie 0x4173739f0fc806d0 00002000:00100000:1.0:1789996200.245834:0:8222:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 189efa8a-c7eb-4b69-9afa-1dd36d6775f1/ffff8e07427dc800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a3f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789996200.245852:0:8222:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789996200.245908:0:6690:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789996200.245959:0:6690:0:(import.c:65:import_set_state_nolock()) ffff8e0876bb6800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789996200.246034:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fa92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+6:2361:x1876946927487488:12345-192.168.204.37@tcp:8: Request processed in 637us (3463us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996200.246042:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 7 00002000:00080000:1.0:1789996200.246642:0:8222:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789996200.246666:0:8222:0:(import.c:65:import_set_state_nolock()) ffff8e07427d9800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789996200.246759:0:8222:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0876619c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+6:2361:x1876946927487616:12345-192.168.204.37@tcp:8: Request processed in 986us (4052us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996200.246767:0:8222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 8 00000100:00100000:2.0:1789996200.247642:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996200.247712:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1789996200.247778:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927487872 00000100:00100000:3.0:1789996200.247787:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927487872 00000100:00100000:3.0:1789996200.247835:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 127 00000100:00100000:3.0:1789996200.247844:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e08602c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f78f7903-47ba-48a7-bb82-1f616cb85fc0+10:2364:x1876946927487872:12345-192.168.204.37@tcp:400: 00000100:00100000:3.0:1789996200.247890:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e08602c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f78f7903-47ba-48a7-bb82-1f616cb85fc0+10:2364:x1876946927487872:12345-192.168.204.37@tcp:400: Request processed in 46us (177us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996200.247897:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 127 00000100:00100000:1.0:1789996200.248175:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927487744 00000100:00100000:1.0:1789996200.248179:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927487744 00000100:00100000:1.0:1789996200.248257:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 0 00000100:00100000:1.0:1789996200.248265:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e087661b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+6:5587:x1876946927487744:12345-192.168.204.37@tcp:33: 00000004:00080000:2.0:1789996200.289025:0:5849:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 40703us 00010000:00010000:2.0:1789996200.296843:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00200000:2.0:1789996200.329286:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1789996200.329407:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e087661b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+6:5587:x1876946927487744:12345-192.168.204.37@tcp:33: Request processed in 81137us (81763us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996200.329421:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 0 00000100:00100000:2.0:1789996200.525700:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1789996200.525801:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927488000 00000100:00100000:3.0:1789996200.525813:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927488000 00000100:00100000:3.0:1789996200.525884:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 8 00000100:00100000:3.0:1789996200.525897:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e087661bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+6:5625:x1876946927488000:12345-192.168.204.37@tcp:101: 00010000:00010000:3.0:1789996200.525921:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789996200.525976:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0841524c00/0x4173739f0fc806d7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b97003095e35413 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996200.526066:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0841524e00/0x4173739f0fc806de lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996200.526080:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0841524e00/0x4173739f0fc806de lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996200.526135:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0841524e00/0x4173739f0fc806de lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789996200.526494:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789996200.526499:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789996200.526523:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e0841524e00/0x4173739f0fc806de lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996200.526600:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0841524c00/0x4173739f0fc806d7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35413 expref: 8 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996200.526624:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0841524e00/0x4173739f0fc806de lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35413 expref: 7 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996200.526634:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e0846583100) 00010000:00010000:3.0:1789996200.526637:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789996200.526641:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e0841524e00, rc 0) 00000100:00100000:3.0:1789996200.526708:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e087661bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+7:5625:x1876946927488000:12345-192.168.204.37@tcp:101: Request processed in 814us (1019us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996200.526717:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 8 00000100:00100000:3.0:1789996200.936911:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0879938380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876946942188672:0@lo:400: 00000100:00100000:2.0:1789996200.936947:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0879939c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876946942188928:0@lo:400: 00000100:00100000:3.0:1789996200.936988:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996200.937010:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996200.937139:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0879938a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e0c28cd8-555e-481f-bd03-c3b02aee51c5:3314:1876946942188544:0@lo:400: 00000100:00100000:1.0:1789996200.937173:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789996200.937218:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0879939f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876946942189184:0@lo:400: 00000100:00100000:3.0:1789996200.937256:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789996200.938116:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789996200.938127:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e087993aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1876946942188800:0@lo:400: 00000100:00100000:3.0:1789996200.938172:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789996200.938231:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942188800 00000100:00100000:3.0:1789996200.938238:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942188800 00000100:00100000:3.0:1789996200.938296:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789996200.938304:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e087f829880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876946942188800:12345-0@lo:400: 00000100:00100000:3.0:1789996200.938356:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e087f829880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876946942188800:12345-0@lo:400: Request processed in 53us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996200.938363:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789996200.938398:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e087993aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1876946942188800:0@lo:400: 00000100:00100000:3.0:1789996200.938437:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942188928 00000100:00100000:3.0:1789996200.938441:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942188928 00000100:00100000:3.0:1789996200.938461:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942189184 00000100:00100000:3.0:1789996200.938464:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942189184 00000100:00100000:3.0:1789996200.938496:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789996200.938503:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0876618380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1876946942188928:12345-0@lo:400: 00000100:00100000:3.0:1789996200.938534:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0876618380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1876946942188928:12345-0@lo:400: Request processed in 32us (1524us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996200.938555:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789996200.938568:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789996200.938575:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e087f82a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1876946942189184:12345-0@lo:400: 00000100:00100000:3.0:1789996200.938607:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e087f82a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1876946942189184:12345-0@lo:400: Request processed in 33us (1350us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996200.938613:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1789996200.938642:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e0879939f80 x1876946942189184/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789996216 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789996200.938653:0:3315:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1789996200.938663:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0879939f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876946942189184:0@lo:400: 00000100:00080000:3.0:1789996200.938683:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789996200.938694:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789996200.938715:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942188544 00000100:00100000:3.0:1789996200.938719:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942188544 00000100:00100000:3.0:1789996200.938747:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1789996200.938755:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852bea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0c28cd8-555e-481f-bd03-c3b02aee51c5+19:3314:x1876946942188544:12345-0@lo:400: 00010000:00080000:2.0:1789996200.938779:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e0879939c00 x1876946942188928/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789996216 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789996200.938791:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0879939c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876946942188928:0@lo:400: 00000100:00100000:3.0:1789996200.938924:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852bea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0c28cd8-555e-481f-bd03-c3b02aee51c5+19:3314:x1876946942188544:12345-0@lo:400: Request processed in 169us (1748us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996200.938930:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1789996200.938994:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942188672 00000100:00100000:0.0:1789996200.938999:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942188672 00000100:00100000:0.0:1789996200.939114:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789996200.939121:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fa70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876946942188672:12345-0@lo:400: 00000100:00100000:0.0:1789996200.939170:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fa70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876946942188672:12345-0@lo:400: Request processed in 50us (2184us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996200.939177:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789996200.939257:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0879938a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e0c28cd8-555e-481f-bd03-c3b02aee51c5:3314:1876946942188544:0@lo:400: 00000100:00100000:1.0:1789996200.939265:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e087993ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3314:1876946942189056:0@lo:400: 00000100:00100000:1.0:1789996200.939293:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789996200.939380:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942189056 00000100:00100000:3.0:1789996200.939384:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942189056 00000100:00100000:3.0:1789996200.939421:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789996200.939427:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0849c75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876946942189056:12345-0@lo:400: 00000100:00100000:3.0:1789996200.939461:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0849c75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876946942189056:12345-0@lo:400: Request processed in 34us (168us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996200.939466:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:1.0:1789996200.939630:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789996200.939651:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e087993ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3314:1876946942189056:0@lo:400: 00000100:00100000:2.0:1789996200.940098:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0879938380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876946942188672:0@lo:400: 00010000:00010000:3.0:1789996201.320718:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789996201.448915:0:8107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e087993ad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8107:1876946942189440:0@lo:700: 00000100:00100000:0.0:1789996201.448992:0:8107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996201.449071:0:8107:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e08475503c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789996201.449129:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942189440 00000100:00100000:0.0:1789996201.449137:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942189440 00000100:00100000:0.0:1789996201.449196:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789996201.449207:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0879938a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8107:x1876946942189440:12345-0@lo:700: 00000100:00100000:0.0:1789996201.449243:0:6696:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0879939c00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6696:1876946942189568:0@lo:700: 00000100:00100000:0.0:1789996201.449272:0:6696:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996201.449301:0:6696:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e08475509c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789996201.449361:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942189568 00000100:00100000:3.0:1789996201.449366:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942189568 00000100:00100000:3.0:1789996201.449420:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789996201.449428:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0879939f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6696:x1876946942189568:12345-0@lo:700: 00000100:00100000:2.0:1789996201.451025:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0879938380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876946942189312:0@lo:13: 00000100:00100000:2.0:1789996201.451106:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996201.452221:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942189312 00000100:00100000:0.0:1789996201.452232:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942189312 00000100:00100000:0.0:1789996201.452284:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789996201.452293:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e087661aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3316:x1876946942189312:12345-0@lo:13: 00002000:00000024:0.0:1789996201.452325:0:6691:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44367872 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789996201.453806:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e087661aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3316:x1876946942189312:12345-0@lo:13: Request processed in 1504us (2689us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996201.453817:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1789996201.453980:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e0879938380 x1876946942189312/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789996217 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789996201.454004:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0879938380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876946942189312:0@lo:13: 00000001:00100000:2.0:1789996201.531609:0:6715:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 189efa8a-c7eb-4b69-9afa-1dd36d6775f1 40000000:02000000:2.0:1789996201.531889:0:5853:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000001:00100000:3.0:1789996201.531900:0:5868:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 189efa8a-c7eb-4b69-9afa-1dd36d6775f1 00000100:00100000:3.0:1789996201.538479:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0879939f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6696:x1876946942189568:12345-0@lo:700: Request processed in 89040us (89195us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996201.538494:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789996201.538984:0:6696:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0879939c00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6696:1876946942189568:0@lo:700: 40000000:02000000:1.0:1789996201.539001:0:6696:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000100:00100000:2.0:1789996201.600251:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0879938a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8107:x1876946942189440:12345-0@lo:700: Request processed in 151035us (151248us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996201.600270:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789996201.600369:0:8107:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e087993ad80 x1876946942189440/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789996217 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789996201.600385:0:8107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e087993ad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8107:1876946942189440:0@lo:700: 00000001:00100000:3.0:1789996201.614902:0:7659:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 189efa8a-c7eb-4b69-9afa-1dd36d6775f1 00000004:02000040:0.0:1789996201.627378:0:8107:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:0.0:1789996201.630923:0:8107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e087993ad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8107:1876946942189696:0@lo:5: 00000100:00100000:0.0:1789996201.631330:0:8107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996201.631515:0:8107:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e08475503c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789996201.631859:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942189696 00000100:00100000:3.0:1789996201.631868:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942189696 00000100:00100000:0.0:1789996201.631972:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789996201.631981:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0879938380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:8107:x1876946942189696:12345-0@lo:5: 00002000:00080000:0.0:1789996201.636738:0:6688:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:0.0:1789996201.636763:0:6688:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:0.0:1789996201.640460:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0879938380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8107:x1876946942189696:12345-0@lo:5: Request processed in 8472us (9124us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1789996201.640473:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:3.0:1789996201.640624:0:8107:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e087993ad80 x1876946942189696/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789996217 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789996201.640653:0:8107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e087993ad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8107:1876946942189696:0@lo:5: 00000004:00080000:3.0:1789996201.640669:0:8107:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:2.0:1789996202.345320:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789996202.693529:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1789996202.693642:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927488128 00000100:00100000:3.0:1789996202.693652:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927488128 00000100:00100000:3.0:1789996202.693741:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 9 00000100:00100000:3.0:1789996202.693752:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e087993b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+6:5677:x1876946927488128:12345-192.168.204.37@tcp:41: 00000004:00000024:3.0:1789996202.693804:0:5847:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1789996202.693875:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e087993b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+6:5677:x1876946927488128:12345-192.168.204.37@tcp:41: Request processed in 124us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996202.693881:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 9 00000100:00080000:1.0:1789996202.695226:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789996202.698475:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1789996202.698571:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927488256 00000100:00100000:3.0:1789996202.698582:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927488256 00000100:00100000:3.0:1789996202.698661:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 8 00000100:00100000:3.0:1789996202.698671:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e087993aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+5:5677:x1876946927488256:12345-192.168.204.37@tcp:13: 00002000:00000024:3.0:1789996202.698708:0:6691:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1789996202.698884:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789996202.699252:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e087993aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+5:5677:x1876946927488256:12345-192.168.204.37@tcp:13: Request processed in 111us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996202.699262:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 8 00000100:00100000:2.0:1789996202.701031:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1789996202.701219:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927488384 00000100:00100000:3.0:1789996202.701229:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927488384 00000100:00100000:3.0:1789996202.701298:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 9 00000100:00100000:3.0:1789996202.701308:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0876619180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+5:5677:x1876946927488384:12345-192.168.204.37@tcp:13: 00002000:00000024:3.0:1789996202.701333:0:6691:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789996202.701401:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0876619180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+5:5677:x1876946927488384:12345-192.168.204.37@tcp:13: Request processed in 93us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996202.701423:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 9 00000100:00080000:1.0:1789996202.701499:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1789996203.368650:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789996204.395339:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789996205.017933:0:8311:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:0.0:1789996205.034304:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789996205.034331:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0879939c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876946942189824:0@lo:13: 00000100:00100000:0.0:1789996205.034412:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996205.034478:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942189824 00000100:00100000:0.0:1789996205.034493:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942189824 00000100:00100000:0.0:1789996205.034572:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789996205.034582:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0847555c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876946942189824:12345-0@lo:13: 00002000:00000024:0.0:1789996205.034614:0:6691:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789996205.034655:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0847555c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876946942189824:12345-0@lo:13: Request processed in 76us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996205.034661:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:0.0:1789996205.034680:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789996205.034723:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e0879939c00 x1876946942189824/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789996221 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789996205.034741:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0879939c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876946942189824:0@lo:13: 00000100:00100000:2.0:1789996205.361065:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996205.361311:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927488512 00000100:00100000:0.0:1789996205.361323:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927488512 00000100:00100000:0.0:1789996205.361386:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 129 00000100:00100000:0.0:1789996205.361397:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852beb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f78f7903-47ba-48a7-bb82-1f616cb85fc0+10:2363:x1876946927488512:12345-192.168.204.37@tcp:400: 00000100:00100000:0.0:1789996205.361506:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852beb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f78f7903-47ba-48a7-bb82-1f616cb85fc0+10:2363:x1876946927488512:12345-192.168.204.37@tcp:400: Request processed in 111us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996205.361514:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 129 00000100:00100000:2.0:1789996205.361782:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996205.361929:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996205.361955:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996205.361980:0:8222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927488768 00000100:00100000:2.0:1789996205.361985:0:8222:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927488768 00000100:00100000:2.0:1789996205.362040:0:8222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927488896 00000100:00100000:2.0:1789996205.362044:0:8222:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927488896 00000100:00100000:2.0:1789996205.362066:0:8222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 7 00000100:00100000:1.0:1789996205.362378:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927488640 00000100:00100000:1.0:1789996205.362384:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927488640 00000100:00100000:1.0:1789996205.362419:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 22 00000100:00100000:1.0:1789996205.362428:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0876619500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+6:2363:x1876946927488640:12345-192.168.204.37@tcp:400: 00000100:00100000:1.0:1789996205.362492:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0876619500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+6:2363:x1876946927488640:12345-192.168.204.37@tcp:400: Request processed in 64us (562us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996205.362499:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 22 00000100:00080000:1.0:1789996205.362520:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789996205.362524:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789996205.362527:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789996205.362604:0:8222:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e087661b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+5:2363:x1876946927488768:12345-192.168.204.37@tcp:400: 00000100:00100000:2.0:1789996205.362633:0:8222:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e087661b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+5:2363:x1876946927488768:12345-192.168.204.37@tcp:400: Request processed in 34us (853us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996205.363450:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 8 00000100:00100000:3.0:1789996205.363480:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e087661ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+5:2363:x1876946927488896:12345-192.168.204.37@tcp:400: 00000100:00100000:3.0:1789996205.363521:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e087661ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+5:2363:x1876946927488896:12345-192.168.204.37@tcp:400: Request processed in 47us (1565us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996205.363528:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 8 00000100:00100000:2.0:1789996205.365935:0:8222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 7 00010000:00010000:3.0:1789996205.416791:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789996206.063734:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0876618e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876946942190336:0@lo:400: 00000100:00100000:2.0:1789996206.063804:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996206.063865:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789996206.063871:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0876619f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e0c28cd8-555e-481f-bd03-c3b02aee51c5:3313:1876946942189952:0@lo:400: 00000100:00100000:2.0:1789996206.063915:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996206.063939:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0876618a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3313:1876946942190464:0@lo:400: 00000100:00100000:2.0:1789996206.063961:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996206.063987:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0876618700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876946942190080:0@lo:400: 00000100:00100000:2.0:1789996206.064024:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996206.064039:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e087661a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876946942190592:0@lo:400: 00000100:00100000:2.0:1789996206.064083:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996206.064104:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789996206.064109:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e087661b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1876946942190208:0@lo:400: 00000100:00100000:2.0:1789996206.064132:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996206.066671:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942190464 00000100:00100000:1.0:1789996206.066689:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942190464 00000100:00100000:1.0:1789996206.066761:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942190080 00000100:00100000:1.0:1789996206.066764:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942190080 00000100:00100000:1.0:1789996206.066778:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942190208 00000100:00100000:1.0:1789996206.066781:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942190208 00000100:00100000:1.0:1789996206.066802:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789996206.066810:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0876618000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876946942190464:12345-0@lo:400: 00000100:00100000:1.0:1789996206.066911:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0876618000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876946942190464:12345-0@lo:400: Request processed in 102us (2948us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996206.066918:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789996206.066936:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789996206.066942:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e087661a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876946942190080:12345-0@lo:400: 00000100:00100000:1.0:1789996206.066974:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e087661a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876946942190080:12345-0@lo:400: Request processed in 33us (2949us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996206.066980:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789996206.066992:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789996206.067022:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0846267480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876946942190208:12345-0@lo:400: 00000100:00100000:1.0:1789996206.067052:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0846267480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876946942190208:12345-0@lo:400: Request processed in 33us (2918us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996206.067058:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:1.0:1789996206.067075:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789996206.067116:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0876618a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3313:1876946942190464:0@lo:400: 00000100:00100000:1.0:1789996206.067149:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e087661b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1876946942190208:0@lo:400: 00000100:00100000:1.0:1789996206.067160:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0876618700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876946942190080:0@lo:400: 00000100:00100000:0.0:1789996206.070380:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942190336 00000100:00100000:0.0:1789996206.070400:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942190336 00000100:00100000:0.0:1789996206.070470:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942190592 00000100:00100000:0.0:1789996206.070473:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942190592 00000100:00100000:0.0:1789996206.070517:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789996206.070528:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0876619880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1876946942190336:12345-0@lo:400: 00000100:00100000:0.0:1789996206.070654:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0876619880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1876946942190336:12345-0@lo:400: Request processed in 128us (6849us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996206.070661:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789996206.070696:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789996206.070703:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0846265180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3315:x1876946942190592:12345-0@lo:400: 00000100:00100000:0.0:1789996206.070741:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0846265180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3315:x1876946942190592:12345-0@lo:400: Request processed in 39us (6657us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996206.070747:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:1.0:1789996206.071069:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1789996206.071109:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e0876618e00 x1876946942190336/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789996222 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789996206.071125:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0876618e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876946942190336:0@lo:400: 00010000:00080000:1.0:1789996206.071159:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e087661a680 x1876946942190592/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789996222 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789996206.071170:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e087661a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876946942190592:0@lo:400: 00000100:00100000:3.0:1789996206.072254:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942189952 00000100:00100000:3.0:1789996206.072264:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942189952 00000100:00100000:3.0:1789996206.072355:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1789996206.072364:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852be9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0c28cd8-555e-481f-bd03-c3b02aee51c5+19:3313:x1876946942189952:12345-0@lo:400: 00000100:00100000:3.0:1789996206.072536:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852be9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0c28cd8-555e-481f-bd03-c3b02aee51c5+19:3313:x1876946942189952:12345-0@lo:400: Request processed in 173us (8618us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996206.072558:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1789996206.080757:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0876619f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e0c28cd8-555e-481f-bd03-c3b02aee51c5:3313:1876946942189952:0@lo:400: 00010000:00010000:2.0:1789996206.440736:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789996206.572315:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789996206.572346:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0849c75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876946942190720:0@lo:13: 00000100:00100000:1.0:1789996206.572429:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996206.582109:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942190720 00000100:00100000:0.0:1789996206.582125:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942190720 00000100:00100000:0.0:1789996206.582185:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789996206.582194:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0849c76a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3315:x1876946942190720:12345-0@lo:13: 00002000:00000024:0.0:1789996206.582229:0:6691:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789996206.582317:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0849c76a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3315:x1876946942190720:12345-0@lo:13: Request processed in 123us (9887us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996206.582324:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:0.0:1789996206.582660:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e0849c75c00 x1876946942190720/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789996222 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789996206.582687:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0849c75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876946942190720:0@lo:13: 00000001:00080000:1.0:1789996206.686140:0:7659:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:3.0:1789996207.466050:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789996208.489650:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789996208.497252:0:8460:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe7728a720 20000000:00000080:0.0:1789996208.497270:0:8460:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8e086fdef000 uarg=0000000000000000 20000000:01000000:0.0:1789996208.497307:0:8460:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:0.0:1789996208.497310:0:8460:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:0.0:1789996208.497312:0:8460:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:0.0:1789996208.497317:0:8460:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:0.0:1789996208.497321:0:8460:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:0.0:1789996208.497336:0:8460:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1789996208.497339:0:8460:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1789996208.497702:0:8460:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1789996208.497705:0:8460:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1789996208.498440:0:8461:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:0.0:1789996208.498996:0:8460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:0.0:1789996208.499074:0:8460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:0.0:1789996208.499105:0:8460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 20000000:01000000:0.0:1789996208.499116:0:8460:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1789996208.499118:0:8460:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1789996208.499884:0:8462:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:0.0:1789996208.500310:0:8460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:0.0:1789996208.500352:0:8460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:0.0:1789996208.500385:0:8460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:0.0:1789996208.500396:0:8460:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1789996208.500398:0:8460:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1789996208.501334:0:8463:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:0.0:1789996208.501831:0:8460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:0.0:1789996208.501883:0:8460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:0.0:1789996208.501937:0:8460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:0.0:1789996208.501949:0:8460:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1789996208.501952:0:8460:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1789996208.502991:0:8464:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:0.0:1789996208.503431:0:8460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:0.0:1789996208.503490:0:8460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:0.0:1789996208.503529:0:8460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 10000000:01000000:0.0:1789996208.503722:0:8460:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1789996208.503744:0:8460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e0840030200/0x4173739f0fc806e5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996208.503764:0:8460:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e08429c6000/0x4173739f0fc805e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4173739f0fc805db expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996208.503772:0:8460:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e0840031a00/0x4173739f0fc8060c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4173739f0fc80605 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996208.503779:0:8460:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e08429c7c00/0x4173739f0fc80636 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4173739f0fc8062f expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996208.503786:0:8460:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e0842de5a00/0x4173739f0fc80644 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4173739f0fc8063d expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996208.503806:0:8460:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e08429c6a00/0x4173739f0fc80652 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4173739f0fc8064b expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996208.503812:0:8460:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e0840030400/0x4173739f0fc8066e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4173739f0fc80667 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996208.503819:0:8460:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e0840030600/0x4173739f0fc80698 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4173739f0fc80691 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996208.503828:0:8460:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e0840031800/0x4173739f0fc806a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e353b1 expref: 9 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996208.503836:0:8460:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e08429c6600/0x4173739f0fc806ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e353b8 expref: 9 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996208.503843:0:8460:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8e0840030200/0x4173739f0fc806e5 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996208.503881:0:8460:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e08429c6600/0x4173739f0fc806ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e353b8 expref: 9 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996208.503896:0:8460:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e08429c6600/0x4173739f0fc806ad lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e353b8 expref: 9 pid: 5840 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789996208.503910:0:8460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0847557100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8460:1876946942190848:192.168.204.37@tcp:104: 00010000:00010000:0.0:1789996208.504580:0:8460:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e0840031800/0x4173739f0fc806a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e353b1 expref: 9 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996208.504591:0:8460:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e0840031800/0x4173739f0fc806a6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e353b1 expref: 9 pid: 5839 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789996208.504610:0:8460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0847557b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8460:1876946942190976:192.168.204.37@tcp:104: 00010000:00010000:0.0:1789996208.504657:0:8460:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e0840030600/0x4173739f0fc80698 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4173739f0fc80691 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996208.504666:0:8460:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e0840030600/0x4173739f0fc80698 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4173739f0fc80691 expref: 18 pid: 5839 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789996208.504676:0:8460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0847554380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8460:1876946942191104:0@lo:104: 00000100:00100000:0.0:1789996208.504712:0:8460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789996208.504744:0:8460:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e0840030400/0x4173739f0fc8066e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4173739f0fc80667 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996208.504752:0:8460:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e0840030400/0x4173739f0fc8066e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4173739f0fc80667 expref: 18 pid: 5839 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789996208.504761:0:8460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0847555180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8460:1876946942191232:0@lo:104: 00000100:00100000:0.0:1789996208.504781:0:8460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789996208.504799:0:8460:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e08429c6a00/0x4173739f0fc80652 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4173739f0fc8064b expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996208.504806:0:8460:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e08429c6a00/0x4173739f0fc80652 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4173739f0fc8064b expref: 18 pid: 5840 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789996208.504814:0:8460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0847557480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8460:1876946942191360:0@lo:104: 00010000:00010000:0.0:1789996208.504838:0:8460:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e0842de5a00/0x4173739f0fc80644 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4173739f0fc8063d expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996208.504845:0:8460:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e0842de5a00/0x4173739f0fc80644 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4173739f0fc8063d expref: 18 pid: 5839 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789996208.505496:0:8460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0847555500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8460:1876946942191488:0@lo:104: 00010000:00010000:0.0:1789996208.505536:0:8460:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e08429c7c00/0x4173739f0fc80636 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4173739f0fc8062f expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996208.505575:0:8460:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e08429c7c00/0x4173739f0fc80636 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4173739f0fc8062f expref: 18 pid: 5840 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789996208.505585:0:8460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0847556d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8460:1876946942191616:0@lo:104: 00010000:00010000:0.0:1789996208.505617:0:8460:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e0840031a00/0x4173739f0fc8060c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4173739f0fc80605 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996208.505625:0:8460:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e0840031a00/0x4173739f0fc8060c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4173739f0fc80605 expref: 18 pid: 5839 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789996208.505633:0:8460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0847555f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8460:1876946942191744:0@lo:104: 00010000:00010000:0.0:1789996208.505656:0:8460:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e08429c6000/0x4173739f0fc805e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4173739f0fc805db expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996208.505664:0:8460:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e08429c6000/0x4173739f0fc805e2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4173739f0fc805db expref: 18 pid: 5841 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789996208.505671:0:8460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0847554700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8460:1876946942191872:0@lo:104: 00000100:00100000:0.0:1789996208.505688:0:8460:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0847550000 going to sleep for 11 seconds 00000100:00100000:1.0:1789996208.505994:0:5829:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1789996208.506032:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996208.506047:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996208.506055:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996208.506063:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996208.506085:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996208.506095:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942191104 00000100:00100000:1.0:1789996208.506102:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942191104 00000100:00100000:1.0:1789996208.506139:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942191232 00000100:00100000:1.0:1789996208.506142:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942191232 00000100:00100000:1.0:1789996208.506151:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942191360 00000100:00100000:1.0:1789996208.506153:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942191360 00000100:00100000:1.0:1789996208.506162:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942191488 00000100:00100000:1.0:1789996208.506164:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942191488 00000100:00100000:1.0:1789996208.506172:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942191616 00000100:00100000:1.0:1789996208.506174:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942191616 00000100:00100000:1.0:1789996208.506182:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942191744 00000100:00100000:1.0:1789996208.506184:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942191744 00000100:00100000:1.0:1789996208.506191:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942191872 00000100:00100000:1.0:1789996208.506193:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942191872 00000100:00100000:1.0:1789996208.506206:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789996208.506215:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0847556a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+9:8460:x1876946942191104:12345-0@lo:104: 00010000:00010000:1.0:1789996208.506228:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.137@tcp lock: ffff8e08429c6e00/0x4173739f0fc80691 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x4173739f0fc80698 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996208.506618:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789996208.506626:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0847556a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+9:8460:x1876946942191104:12345-0@lo:104: Request processed in 412us (1914us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996208.506635:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789996208.506654:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789996208.506661:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0877ae2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+8:8460:x1876946942191232:12345-0@lo:104: 00010000:00010000:1.0:1789996208.506669:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.137@tcp lock: ffff8e08429c6200/0x4173739f0fc80667 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x4173739f0fc8066e expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996208.506707:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789996208.506712:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0877ae2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+8:8460:x1876946942191232:12345-0@lo:104: Request processed in 52us (1930us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996208.506725:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789996208.506754:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789996208.506760:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0849c74380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+7:8460:x1876946942191360:12345-0@lo:104: 00010000:00010000:1.0:1789996208.506768:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.137@tcp lock: ffff8e08413f0000/0x4173739f0fc8064b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x4173739f0fc80652 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996208.506796:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1789996208.506801:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0849c74380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+7:8460:x1876946942191360:12345-0@lo:104: Request processed in 42us (774us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996208.506806:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789996208.506817:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789996208.506823:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0849c75c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+6:8460:x1876946942191488:12345-0@lo:104: 00010000:00010000:1.0:1789996208.506829:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.137@tcp lock: ffff8e08413f1800/0x4173739f0fc8063d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x4173739f0fc80644 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996208.507028:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789996208.507036:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.137@tcp lock: ffff8e08429c6e00/0x4173739f0fc80691 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x4173739f0fc80698 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996208.507044:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e08429c6e00 already unused, calling callback (ffffffffc1be0c20) 10000000:00010000:2.0:1789996208.507048:0:5835:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.137@tcp lock: ffff8e08429c6e00/0x4173739f0fc80691 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x4173739f0fc80698 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996208.507056:0:5835:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.137@tcp lock: ffff8e08429c6e00/0x4173739f0fc80691 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x4173739f0fc80698 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789996208.507075:0:5835:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.137@tcp lock: ffff8e08429c6e00/0x4173739f0fc80691 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x4173739f0fc80698 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789996208.507080:0:5835:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789996208.507120:0:5835:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.137@tcp lock: ffff8e08429c6e00/0x4173739f0fc80691 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4173739f0fc80698 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996208.507127:0:5835:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789996208.507147:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.137@tcp lock: ffff8e08429c6e00/0x4173739f0fc80691 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4173739f0fc80698 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996208.507154:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.137@tcp lock: ffff8e08429c6e00/0x4173739f0fc80691 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4173739f0fc80698 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996208.507172:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789996208.507175:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.137@tcp lock: ffff8e08429c6200/0x4173739f0fc80667 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x4173739f0fc8066e expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996208.507181:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e08429c6200 already unused, calling callback (ffffffffc1be0c20) 10000000:00010000:2.0:1789996208.507183:0:5835:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.137@tcp lock: ffff8e08429c6200/0x4173739f0fc80667 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x4173739f0fc8066e expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996208.507190:0:5835:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.137@tcp lock: ffff8e08429c6200/0x4173739f0fc80667 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x4173739f0fc8066e expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789996208.507196:0:5835:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.137@tcp lock: ffff8e08429c6200/0x4173739f0fc80667 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x4173739f0fc8066e expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789996208.507202:0:5835:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789996208.507224:0:5835:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.137@tcp lock: ffff8e08429c6200/0x4173739f0fc80667 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4173739f0fc8066e expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996208.507229:0:5835:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789996208.507235:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.137@tcp lock: ffff8e08429c6200/0x4173739f0fc80667 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4173739f0fc8066e expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996208.507241:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.137@tcp lock: ffff8e08429c6200/0x4173739f0fc80667 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4173739f0fc8066e expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996208.507251:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789996208.507254:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.137@tcp lock: ffff8e08413f0000/0x4173739f0fc8064b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x4173739f0fc80652 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996208.507259:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e08413f0000 already unused, calling callback (ffffffffc1be0c20) 10000000:00010000:2.0:1789996208.507262:0:5835:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.137@tcp lock: ffff8e08413f0000/0x4173739f0fc8064b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x4173739f0fc80652 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996208.507269:0:5835:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.137@tcp lock: ffff8e08413f0000/0x4173739f0fc8064b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x4173739f0fc80652 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789996208.507275:0:5835:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.137@tcp lock: ffff8e08413f0000/0x4173739f0fc8064b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x4173739f0fc80652 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789996208.507280:0:5835:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789996208.507292:0:5835:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.137@tcp lock: ffff8e08413f0000/0x4173739f0fc8064b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4173739f0fc80652 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996208.507297:0:5835:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789996208.507312:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.137@tcp lock: ffff8e08413f0000/0x4173739f0fc8064b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4173739f0fc80652 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996208.507329:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.137@tcp lock: ffff8e08413f0000/0x4173739f0fc8064b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4173739f0fc80652 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996208.507339:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789996208.507341:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789996208.507343:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789996208.507359:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0846265500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e0c28cd8-555e-481f-bd03-c3b02aee51c5:3313:1876946942192000:0@lo:103: 00000100:00100000:0.0:1789996208.507846:0:8460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0847554380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8460:1876946942191104:0@lo:104: 00000100:00100000:0.0:1789996208.507888:0:8460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0847555180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8460:1876946942191232:0@lo:104: 00000100:00100000:0.0:1789996208.507895:0:8460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0847557480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8460:1876946942191360:0@lo:104: 00000100:00100000:0.0:1789996208.507902:0:8460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0847555500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8460:1876946942191488:0@lo:104: 00010000:00010000:1.0:1789996208.508664:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789996208.508674:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0849c75c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+6:8460:x1876946942191488:12345-0@lo:104: Request processed in 1849us (2623us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996208.508686:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789996208.508720:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789996208.508732:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0849c74700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+5:8460:x1876946942191616:12345-0@lo:104: 00010000:00010000:1.0:1789996208.508745:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.137@tcp lock: ffff8e08413f1000/0x4173739f0fc8062f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4173739f0fc80636 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996208.508798:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789996208.508804:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0849c74700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+5:8460:x1876946942191616:12345-0@lo:104: Request processed in 76us (2747us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996208.508819:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789996208.508832:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789996208.508839:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0849c75f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+4:8460:x1876946942191744:12345-0@lo:104: 00010000:00010000:1.0:1789996208.508847:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.137@tcp lock: ffff8e08413f1400/0x4173739f0fc80605 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4173739f0fc8060c expref: -99 pid: 7642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789996208.509767:0:8460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0847556d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8460:1876946942191616:0@lo:104: 00010000:00010000:1.0:1789996208.509911:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1789996208.509918:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0849c75f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+4:8460:x1876946942191744:12345-0@lo:104: Request processed in 1080us (3853us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996208.509925:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789996208.509946:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789996208.509965:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0849c74a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+3:8460:x1876946942191872:12345-0@lo:104: 00010000:00010000:1.0:1789996208.509975:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.137@tcp lock: ffff8e0840031200/0x4173739f0fc805db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4173739f0fc805e2 expref: -99 pid: 7642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789996208.510096:0:8460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0847555f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8460:1876946942191744:0@lo:104: 00000100:00100000:0.0:1789996208.510104:0:8460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0847554700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8460:1876946942191872:0@lo:104: 00010000:00010000:1.0:1789996208.510129:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1789996208.510135:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0849c74a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+3:8460:x1876946942191872:12345-0@lo:104: Request processed in 183us (4048us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996208.510141:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:1.0:1789996208.510160:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1789996208.510166:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.137@tcp lock: ffff8e08413f1800/0x4173739f0fc8063d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4173739f0fc80644 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996208.510173:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e08413f1800 already unused, calling callback (ffffffffc1be0c20) 10000000:00010000:1.0:1789996208.510177:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.137@tcp lock: ffff8e08413f1800/0x4173739f0fc8063d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x4173739f0fc80644 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996208.510200:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.137@tcp lock: ffff8e08413f1800/0x4173739f0fc8063d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x4173739f0fc80644 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789996208.510207:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.137@tcp lock: ffff8e08413f1800/0x4173739f0fc8063d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x4173739f0fc80644 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789996208.510212:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789996208.510254:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.137@tcp lock: ffff8e08413f1800/0x4173739f0fc8063d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4173739f0fc80644 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996208.510261:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789996208.510273:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.137@tcp lock: ffff8e08413f1800/0x4173739f0fc8063d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4173739f0fc80644 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996208.510280:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.137@tcp lock: ffff8e08413f1800/0x4173739f0fc8063d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4173739f0fc80644 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996208.510292:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789996208.510295:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.137@tcp lock: ffff8e08413f1000/0x4173739f0fc8062f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4173739f0fc80636 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996208.510301:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e08413f1000 already unused, calling callback (ffffffffc1be0c20) 10000000:00010000:1.0:1789996208.510304:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.137@tcp lock: ffff8e08413f1000/0x4173739f0fc8062f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x4173739f0fc80636 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996208.510310:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.137@tcp lock: ffff8e08413f1000/0x4173739f0fc8062f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x4173739f0fc80636 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789996208.510315:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.137@tcp lock: ffff8e08413f1000/0x4173739f0fc8062f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x4173739f0fc80636 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789996208.510325:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789996208.510339:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.137@tcp lock: ffff8e08413f1000/0x4173739f0fc8062f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4173739f0fc80636 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996208.510344:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789996208.510351:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.137@tcp lock: ffff8e08413f1000/0x4173739f0fc8062f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4173739f0fc80636 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996208.510357:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.137@tcp lock: ffff8e08413f1000/0x4173739f0fc8062f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4173739f0fc80636 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996208.510366:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789996208.510369:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.137@tcp lock: ffff8e08413f1400/0x4173739f0fc80605 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4173739f0fc8060c expref: -99 pid: 7642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996208.510374:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e08413f1400 already unused, calling callback (ffffffffc1be0c20) 10000000:00010000:1.0:1789996208.510377:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.137@tcp lock: ffff8e08413f1400/0x4173739f0fc80605 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x4173739f0fc8060c expref: -99 pid: 7642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996208.510383:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.137@tcp lock: ffff8e08413f1400/0x4173739f0fc80605 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x4173739f0fc8060c expref: -99 pid: 7642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789996208.510389:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.137@tcp lock: ffff8e08413f1400/0x4173739f0fc80605 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x4173739f0fc8060c expref: -99 pid: 7642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789996208.510394:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789996208.510405:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.137@tcp lock: ffff8e08413f1400/0x4173739f0fc80605 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4173739f0fc8060c expref: -99 pid: 7642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996208.510409:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789996208.510418:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.137@tcp lock: ffff8e08413f1400/0x4173739f0fc80605 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4173739f0fc8060c expref: -99 pid: 7642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996208.510425:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.137@tcp lock: ffff8e08413f1400/0x4173739f0fc80605 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4173739f0fc8060c expref: -99 pid: 7642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996208.510434:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789996208.510436:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.137@tcp lock: ffff8e0840031200/0x4173739f0fc805db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4173739f0fc805e2 expref: -99 pid: 7642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996208.510442:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0840031200 already unused, calling callback (ffffffffc1be0c20) 10000000:00010000:1.0:1789996208.510444:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.137@tcp lock: ffff8e0840031200/0x4173739f0fc805db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4173739f0fc805e2 expref: -99 pid: 7642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996208.510450:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.137@tcp lock: ffff8e0840031200/0x4173739f0fc805db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4173739f0fc805e2 expref: -99 pid: 7642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789996208.510456:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.137@tcp lock: ffff8e0840031200/0x4173739f0fc805db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4173739f0fc805e2 expref: -99 pid: 7642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789996208.510461:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789996208.510470:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.137@tcp lock: ffff8e0840031200/0x4173739f0fc805db lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4173739f0fc805e2 expref: -99 pid: 7642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996208.510477:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789996208.510480:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.137@tcp lock: ffff8e0840031200/0x4173739f0fc805db lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4173739f0fc805e2 expref: -99 pid: 7642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996208.510486:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.137@tcp lock: ffff8e0840031200/0x4173739f0fc805db lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4173739f0fc805e2 expref: -99 pid: 7642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996208.510497:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789996208.510504:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789996208.510506:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789996208.510857:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996208.510911:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0849c77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e0c28cd8-555e-481f-bd03-c3b02aee51c5:3313:1876946942192512:0@lo:103: 00000100:00100000:2.0:1789996208.510938:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996208.510975:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789996208.510982:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0846266d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e0c28cd8-555e-481f-bd03-c3b02aee51c5:3313:1876946942192128:0@lo:103: 00000100:00100000:2.0:1789996208.511015:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996208.511034:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fa93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e0c28cd8-555e-481f-bd03-c3b02aee51c5:3313:1876946942192640:0@lo:103: 00000100:00100000:2.0:1789996208.511052:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996208.511073:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0846265f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e0c28cd8-555e-481f-bd03-c3b02aee51c5:3315:1876946942192256:0@lo:103: 00000100:00100000:2.0:1789996208.511091:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996208.511099:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fa92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e0c28cd8-555e-481f-bd03-c3b02aee51c5:3315:1876946942192768:0@lo:103: 00000100:00100000:2.0:1789996208.511113:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996208.511122:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789996208.511126:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0849c74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e0c28cd8-555e-481f-bd03-c3b02aee51c5:3315:1876946942192384:0@lo:103: 00000100:00100000:2.0:1789996208.511144:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996208.511167:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942192000 00000100:00100000:2.0:1789996208.511173:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942192000 00010000:00010000:2.0:1789996208.511200:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e0840030600/0x4173739f0fc80698 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4173739f0fc80691 expref: 19 pid: 5839 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789996208.511225:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942192512 00000100:00100000:2.0:1789996208.511228:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942192512 00010000:00010000:2.0:1789996208.511241:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e08429c7c00/0x4173739f0fc80636 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4173739f0fc8062f expref: 20 pid: 5840 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789996208.511250:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942192128 00000100:00100000:2.0:1789996208.511253:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942192128 00010000:00010000:2.0:1789996208.511262:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e0840030400/0x4173739f0fc8066e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4173739f0fc80667 expref: 21 pid: 5839 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789996208.511272:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942192640 00000100:00100000:2.0:1789996208.511274:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942192640 00010000:00010000:2.0:1789996208.511284:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e0840031a00/0x4173739f0fc8060c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4173739f0fc80605 expref: 22 pid: 5839 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789996208.511293:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942192256 00000100:00100000:2.0:1789996208.511296:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942192256 00010000:00010000:2.0:1789996208.511305:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e08429c6a00/0x4173739f0fc80652 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4173739f0fc8064b expref: 23 pid: 5840 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789996208.511313:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942192768 00000100:00100000:2.0:1789996208.511316:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942192768 00010000:00010000:2.0:1789996208.511323:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e08429c6000/0x4173739f0fc805e2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4173739f0fc805db expref: 24 pid: 5841 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789996208.511332:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942192384 00000100:00100000:2.0:1789996208.511333:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942192384 00010000:00010000:2.0:1789996208.511341:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e0842de5a00/0x4173739f0fc80644 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4173739f0fc8063d expref: 25 pid: 5839 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789996208.511352:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789996208.511365:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0846264700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+25:3313:x1876946942192000:12345-0@lo:103: 00010000:00010000:2.0:1789996208.511377:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789996208.511383:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e0840030600/0x4173739f0fc80698 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4173739f0fc80691 expref: 25 pid: 5839 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996208.511393:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e0840030600/0x4173739f0fc80698 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4173739f0fc80691 expref: 25 pid: 5839 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996208.511407:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e0840030600/0x4173739f0fc80698 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4173739f0fc80691 expref: 25 pid: 5839 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996208.511422:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789996208.511454:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0846264700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+24:3313:x1876946942192000:12345-0@lo:103: Request processed in 90us (609us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996208.511461:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789996208.511476:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789996208.511482:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0846267800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+23:3313:x1876946942192512:12345-0@lo:103: 00010000:00010000:2.0:1789996208.511490:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789996208.511494:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e08429c7c00/0x4173739f0fc80636 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4173739f0fc8062f expref: 23 pid: 5840 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996208.511502:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e08429c7c00/0x4173739f0fc80636 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4173739f0fc8062f expref: 23 pid: 5840 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996208.511512:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e08429c7c00/0x4173739f0fc80636 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4173739f0fc8062f expref: 23 pid: 5840 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996208.511521:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789996208.511564:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0846267800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+22:3313:x1876946942192512:12345-0@lo:103: Request processed in 60us (602us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996208.511580:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789996208.511593:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789996208.511598:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0846264e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+21:3313:x1876946942192128:12345-0@lo:103: 00010000:00010000:2.0:1789996208.511606:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789996208.511611:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e0840030400/0x4173739f0fc8066e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4173739f0fc80667 expref: 21 pid: 5839 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996208.511619:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e0840030400/0x4173739f0fc8066e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4173739f0fc80667 expref: 21 pid: 5839 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996208.511629:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e0840030400/0x4173739f0fc8066e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4173739f0fc80667 expref: 21 pid: 5839 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996208.511637:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789996208.511658:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0846264e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+20:3313:x1876946942192128:12345-0@lo:103: Request processed in 60us (643us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996208.511664:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789996208.511675:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789996208.511680:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0846264a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+19:3313:x1876946942192640:12345-0@lo:103: 00010000:00010000:2.0:1789996208.511687:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789996208.511691:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e0840031a00/0x4173739f0fc8060c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4173739f0fc80605 expref: 19 pid: 5839 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996208.511699:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e0840031a00/0x4173739f0fc8060c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4173739f0fc80605 expref: 19 pid: 5839 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996208.511709:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e0840031a00/0x4173739f0fc8060c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4173739f0fc80605 expref: 19 pid: 5839 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996208.511727:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789996208.511747:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0846264a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+18:3313:x1876946942192640:12345-0@lo:103: Request processed in 67us (693us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996208.511752:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789996208.511764:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789996208.511770:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0846266680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+17:3315:x1876946942192256:12345-0@lo:103: 00010000:00010000:2.0:1789996208.511776:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789996208.511780:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e08429c6a00/0x4173739f0fc80652 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4173739f0fc8064b expref: 17 pid: 5840 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996208.511788:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e08429c6a00/0x4173739f0fc80652 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4173739f0fc8064b expref: 17 pid: 5840 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996208.511797:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e08429c6a00/0x4173739f0fc80652 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4173739f0fc8064b expref: 17 pid: 5840 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996208.511808:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789996208.511834:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0846266680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+16:3315:x1876946942192256:12345-0@lo:103: Request processed in 64us (742us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996208.511840:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789996208.511852:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789996208.511859:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0846265880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+15:3315:x1876946942192768:12345-0@lo:103: 00010000:00010000:2.0:1789996208.511867:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789996208.511870:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e08429c6000/0x4173739f0fc805e2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4173739f0fc805db expref: 15 pid: 5841 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996208.511878:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e08429c6000/0x4173739f0fc805e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4173739f0fc805db expref: 15 pid: 5841 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996208.511893:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e08429c6000/0x4173739f0fc805e2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4173739f0fc805db expref: 15 pid: 5841 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996208.511901:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789996208.511924:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0846265880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+14:3315:x1876946942192768:12345-0@lo:103: Request processed in 66us (811us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996208.511930:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789996208.511942:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789996208.511948:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0848c1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+13:3315:x1876946942192384:12345-0@lo:103: 00010000:00010000:2.0:1789996208.511967:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789996208.511972:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e0842de5a00/0x4173739f0fc80644 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4173739f0fc8063d expref: 13 pid: 5839 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996208.511980:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e0842de5a00/0x4173739f0fc80644 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4173739f0fc8063d expref: 13 pid: 5839 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996208.511990:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e0842de5a00/0x4173739f0fc80644 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4173739f0fc8063d expref: 13 pid: 5839 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996208.511998:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789996208.512019:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0848c1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+12:3315:x1876946942192384:12345-0@lo:103: Request processed in 72us (874us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996208.512025:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789996208.512072:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0849c74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e0c28cd8-555e-481f-bd03-c3b02aee51c5:3315:1876946942192384:0@lo:103: 00000100:00100000:2.0:1789996208.512080:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0846265f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e0c28cd8-555e-481f-bd03-c3b02aee51c5:3315:1876946942192256:0@lo:103: 00000100:00100000:2.0:1789996208.512086:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fa92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e0c28cd8-555e-481f-bd03-c3b02aee51c5:3315:1876946942192768:0@lo:103: 00010000:00010000:2.0:1789996208.512121:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789996208.512135:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0846266d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e0c28cd8-555e-481f-bd03-c3b02aee51c5:3313:1876946942192128:0@lo:103: 00000100:00100000:2.0:1789996208.512141:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fa93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e0c28cd8-555e-481f-bd03-c3b02aee51c5:3313:1876946942192640:0@lo:103: 00000100:00100000:2.0:1789996208.512147:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0849c77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e0c28cd8-555e-481f-bd03-c3b02aee51c5:3313:1876946942192512:0@lo:103: 00000100:00100000:2.0:1789996208.512154:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0846265500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e0c28cd8-555e-481f-bd03-c3b02aee51c5:3313:1876946942192000:0@lo:103: 00000100:00100000:3.0:1789996208.516313:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1789996208.516359:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1789996208.516388:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927489024 00000100:00100000:3.0:1789996208.516396:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927489024 00010000:00010000:3.0:1789996208.516432:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e08429c6600/0x4173739f0fc806ad lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e353b8 expref: 10 pid: 5840 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789996208.516479:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927489152 00000100:00100000:3.0:1789996208.516483:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927489152 00010000:00010000:3.0:1789996208.516496:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e0840031800/0x4173739f0fc806a6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e353b1 expref: 11 pid: 5839 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789996208.516513:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 19 00000100:00100000:3.0:1789996208.516523:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e087f828000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f78f7903-47ba-48a7-bb82-1f616cb85fc0+11:2362:x1876946927489024:12345-192.168.204.37@tcp:103: 00010000:00010000:3.0:1789996208.516536:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789996208.516565:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e08429c6600/0x4173739f0fc806ad lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e353b8 expref: 11 pid: 5840 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996208.516577:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e08429c6600/0x4173739f0fc806ad lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e353b8 expref: 11 pid: 5840 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996208.516598:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789996208.516651:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e087f828000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f78f7903-47ba-48a7-bb82-1f616cb85fc0+11:2362:x1876946927489024:12345-192.168.204.37@tcp:103: Request processed in 129us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996208.516658:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 19 00000100:00100000:3.0:1789996208.516677:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 20 00000100:00100000:3.0:1789996208.516684:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e087f82a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f78f7903-47ba-48a7-bb82-1f616cb85fc0+10:2363:x1876946927489152:12345-192.168.204.37@tcp:103: 00010000:00010000:3.0:1789996208.516692:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789996208.516697:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e0840031800/0x4173739f0fc806a6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e353b1 expref: 10 pid: 5839 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996208.516706:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e0840031800/0x4173739f0fc806a6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e353b1 expref: 10 pid: 5839 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996208.516728:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8e0840030200/0x4173739f0fc806e5 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996208.516737:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e0840030200/0x4173739f0fc806e5 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996208.516751:0:5832:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e0840030200/0x4173739f0fc806e5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996208.516759:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e0840030200/0x4173739f0fc806e5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996208.516765:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e0840030200/0x4173739f0fc806e5 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996208.516772:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e0840030200/0x4173739f0fc806e5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996208.516778:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0840030200 already unused, calling callback (ffffffffc1595910) 00010000:00010000:3.0:1789996208.516782:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e0840030200/0x4173739f0fc806e5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996208.516790:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e0840030200/0x4173739f0fc806e5 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996208.516798:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e0840030200/0x4173739f0fc806e5 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996208.516808:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789996208.516830:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e087f82a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f78f7903-47ba-48a7-bb82-1f616cb85fc0+10:2363:x1876946927489152:12345-192.168.204.37@tcp:103: Request processed in 146us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996208.516846:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 20 00010000:00010000:1.0:1789996208.518216:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e08429c6600/0x4173739f0fc806ad lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e353b8 expref: 9 pid: 5840 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789996208.518238:0:8460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0847557100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8460:1876946942190848:192.168.204.37@tcp:104: 00010000:00010000:1.0:1789996208.518252:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e0840031800/0x4173739f0fc806a6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e353b1 expref: 8 pid: 5839 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789996208.518261:0:8460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0847557b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8460:1876946942190976:192.168.204.37@tcp:104: 00010000:00010000:1.0:1789996208.518309:0:8460:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8e0840030200/0x4173739f0fc806e5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996208.518319:0:8460:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8e0840030200/0x4173739f0fc806e5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996208.518325:0:8460:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e0840030200/0x4173739f0fc806e5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996208.518332:0:8460:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e0840030200/0x4173739f0fc806e5 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789996208.942396:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996208.942591:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927489280 00000100:00100000:0.0:1789996208.942601:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927489280 00000100:00100000:0.0:1789996208.942659:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 131 00000100:00100000:0.0:1789996208.942669:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852bea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f78f7903-47ba-48a7-bb82-1f616cb85fc0+8:5601:x1876946927489280:12345-192.168.204.37@tcp:101: 00010000:00010000:0.0:1789996208.942687:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789996208.942707:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e0840031c00/0x4173739f0fc806ec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b97003095e3541a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996208.942735:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e0840031c00/0x4173739f0fc806ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e3541a expref: 9 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996208.942746:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e0840031c00/0x4173739f0fc806ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e3541a expref: 9 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996208.942755:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e0840031c00, rc 0) 00000100:00100000:0.0:1789996208.942812:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852bea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f78f7903-47ba-48a7-bb82-1f616cb85fc0+9:5601:x1876946927489280:12345-192.168.204.37@tcp:101: Request processed in 144us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996208.942819:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 131 00000100:00100000:3.0:1789996208.952940:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996208.953101:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927489408 00000100:00100000:0.0:1789996208.953111:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927489408 00000100:00100000:0.0:1789996208.953167:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 132 00000100:00100000:0.0:1789996208.953184:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852be8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f78f7903-47ba-48a7-bb82-1f616cb85fc0+9:5601:x1876946927489408:12345-192.168.204.37@tcp:501: 00000100:00100000:0.0:1789996208.953502:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852be8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f78f7903-47ba-48a7-bb82-1f616cb85fc0+9:5601:x1876946927489408:12345-192.168.204.37@tcp:501: Request processed in 325us (570us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996208.953520:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 132 00000100:00100000:3.0:1789996208.959183:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996208.959335:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927489536 00000100:00100000:2.0:1789996208.959347:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927489536 00000100:00100000:2.0:1789996208.959405:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 133 00000100:00100000:2.0:1789996208.959415:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852be8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f78f7903-47ba-48a7-bb82-1f616cb85fc0+9:5601:x1876946927489536:12345-192.168.204.37@tcp:503: 00000100:00100000:2.0:1789996208.959704:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852be8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f78f7903-47ba-48a7-bb82-1f616cb85fc0+9:5601:x1876946927489536:12345-192.168.204.37@tcp:503: Request processed in 287us (539us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996208.959713:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 133 00000100:00100000:2.0:1789996208.974137:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1789996208.975684:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927489664 00000100:00100000:3.0:1789996208.975701:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927489664 00000100:00100000:2.0:1789996208.976008:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 134 00000100:00100000:2.0:1789996208.976022:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852ba5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f78f7903-47ba-48a7-bb82-1f616cb85fc0+9:6065:x1876946927489664:12345-192.168.204.37@tcp:502: 00000100:00100000:2.0:1789996208.977000:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852ba5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f78f7903-47ba-48a7-bb82-1f616cb85fc0+9:6065:x1876946927489664:12345-192.168.204.37@tcp:502: Request processed in 975us (2866us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996208.977025:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 134 00000100:00100000:3.0:1789996208.983092:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996208.984179:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927489792 00000100:00100000:0.0:1789996208.984191:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927489792 00000100:00100000:0.0:1789996208.984261:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 135 00000100:00100000:0.0:1789996208.984273:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852ba4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f78f7903-47ba-48a7-bb82-1f616cb85fc0+9:6065:x1876946927489792:12345-192.168.204.37@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789996208.984613:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852ba4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f78f7903-47ba-48a7-bb82-1f616cb85fc0+9:6065:x1876946927489792:12345-192.168.204.37@tcp:502:llog_process_th.0 Request processed in 340us (1533us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996208.984622:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 135 00000100:00100000:3.0:1789996208.987902:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996208.988521:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927489920 00000100:00100000:2.0:1789996208.988535:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927489920 00000100:00100000:2.0:1789996208.988683:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 136 00000100:00100000:2.0:1789996208.988695:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852ba7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f78f7903-47ba-48a7-bb82-1f616cb85fc0+9:5601:x1876946927489920:12345-192.168.204.37@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789996208.988730:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789996208.988752:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e0842de5000/0x4173739f0fc806f3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b97003095e35421 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996208.988795:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e0842de5000/0x4173739f0fc806f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35421 expref: 10 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996208.988808:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e0842de5000/0x4173739f0fc806f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35421 expref: 10 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996208.988818:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e0842de5000, rc 0) 00000100:00100000:2.0:1789996208.988989:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852ba7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f78f7903-47ba-48a7-bb82-1f616cb85fc0+10:5601:x1876946927489920:12345-192.168.204.37@tcp:101:ll_cfg_requeue.0 Request processed in 295us (1099us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996208.990795:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996208.990874:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 136 00000100:00100000:2.0:1789996208.991354:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927490048 00000100:00100000:2.0:1789996208.991366:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927490048 00000100:00100000:2.0:1789996208.991397:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 137 00000100:00100000:2.0:1789996208.991406:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852ba6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f78f7903-47ba-48a7-bb82-1f616cb85fc0+10:5601:x1876946927490048:12345-192.168.204.37@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789996208.991695:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852ba6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f78f7903-47ba-48a7-bb82-1f616cb85fc0+10:5601:x1876946927490048:12345-192.168.204.37@tcp:501:ll_cfg_requeue.0 Request processed in 289us (923us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789996208.991704:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 137 00010000:00010000:1.0:1789996209.513118:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789996210.152762:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789996210.152795:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0847557800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876946942192896:0@lo:13: 00000100:00100000:1.0:1789996210.152886:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996210.153150:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942192896 00000100:00100000:0.0:1789996210.153161:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942192896 00000100:00100000:0.0:1789996210.153229:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789996210.153239:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fa90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876946942192896:12345-0@lo:13: 00002000:00000024:0.0:1789996210.153279:0:6691:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789996210.153332:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fa90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876946942192896:12345-0@lo:13: Request processed in 94us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996210.153339:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:1.0:1789996210.153602:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789996210.153637:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e0847557800 x1876946942192896/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789996226 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789996210.153658:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0847557800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876946942192896:0@lo:13: 10000000:01000000:3.0:1789996210.294260:0:5843:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789996210.294270:0:5843:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8e0847d01800 from 39 10000000:01000000:3.0:1789996210.294276:0:5843:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789996210.294336:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.137@tcp lock: ffff8e0841525e00/0x4173739f0fc806fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996210.294350:0:5843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.137@tcp lock: ffff8e0841525e00/0x4173739f0fc806fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996210.294364:0:5843:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.137@tcp lock: ffff8e0841525e00/0x4173739f0fc806fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789996210.294392:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e087f829c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5843:1876946942193024:0@lo:101: 00000100:00100000:3.0:1789996210.294467:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789996210.294524:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0870487b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789996210.294658:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942193024 00000100:00100000:2.0:1789996210.294666:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942193024 00000100:00100000:0.0:1789996210.294883:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1789996210.294897:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852ba7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0c28cd8-555e-481f-bd03-c3b02aee51c5+12:5843:x1876946942193024:12345-0@lo:101: 00010000:00010000:0.0:1789996210.294915:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789996210.294940:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e0840031800/0x4173739f0fc80701 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4173739f0fc806fa expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996210.294969:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e0840031800/0x4173739f0fc80701 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4173739f0fc806fa expref: 13 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996210.294980:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e0840031800/0x4173739f0fc80701 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4173739f0fc806fa expref: 13 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996210.295001:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e0840031800, rc 0) 00000100:00100000:0.0:1789996210.295055:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852ba7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0c28cd8-555e-481f-bd03-c3b02aee51c5+13:5843:x1876946942193024:12345-0@lo:101: Request processed in 162us (588us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996210.295062:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1789996210.295167:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e087f829c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5843:1876946942193024:0@lo:101: 00010000:00010000:3.0:1789996210.295184:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.137@tcp lock: ffff8e0841525e00/0x4173739f0fc806fa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc80701 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996210.295192:0:5843:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.137@tcp lock: ffff8e0841525e00/0x4173739f0fc806fa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4173739f0fc80701 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789996210.295260:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e087f829c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5843:1876946942193152:0@lo:501: 00000100:00100000:3.0:1789996210.295287:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789996210.295575:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0870487b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789996210.295657:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942193152 00000100:00100000:2.0:1789996210.295662:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942193152 00000100:00100000:2.0:1789996210.295695:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1789996210.295703:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852ba7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0c28cd8-555e-481f-bd03-c3b02aee51c5+13:5843:x1876946942193152:12345-0@lo:501: 00000100:00100000:2.0:1789996210.296155:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852ba7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0c28cd8-555e-481f-bd03-c3b02aee51c5+13:5843:x1876946942193152:12345-0@lo:501: Request processed in 451us (865us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996210.296162:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1789996210.296231:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e087f829c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5843:1876946942193152:0@lo:501: 00000100:00100000:3.0:1789996210.296266:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e087f829c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5843:1876946942193280:0@lo:503: 00000100:00100000:3.0:1789996210.296305:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789996210.296368:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0870487b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789996210.308904:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942193280 00000100:00100000:2.0:1789996210.308977:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942193280 00000100:00100000:2.0:1789996210.309277:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1789996210.309291:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852ba5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+13:5843:x1876946942193280:12345-0@lo:503: 00000100:00100000:2.0:1789996210.309606:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852ba5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+13:5843:x1876946942193280:12345-0@lo:503: Request processed in 317us (13299us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996210.309615:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1789996210.309731:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e087f829c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5843:1876946942193280:0@lo:503: 00000100:00100000:3.0:1789996210.313747:0:8500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e087f82b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0c28cd8-555e-481f-bd03-c3b02aee51c5:8500:1876946942193408:0@lo:502: 00000100:00100000:3.0:1789996210.313863:0:8500:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789996210.313912:0:8500:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0870487840 going to sleep for 11 seconds 00000100:00100000:2.0:1789996210.314145:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942193408 00000100:00100000:2.0:1789996210.314153:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942193408 00000100:00100000:2.0:1789996210.314214:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1789996210.314223:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852ba6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+13:8500:x1876946942193408:12345-0@lo:502: 00000100:00100000:2.0:1789996210.314519:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852ba6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+13:8500:x1876946942193408:12345-0@lo:502: Request processed in 297us (656us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996210.314528:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1789996210.314723:0:8500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e087f82b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0c28cd8-555e-481f-bd03-c3b02aee51c5:8500:1876946942193408:0@lo:502: 00000100:00100000:3.0:1789996210.314787:0:8500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e087f82b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0c28cd8-555e-481f-bd03-c3b02aee51c5:8500:1876946942193536:0@lo:502: 00000100:00100000:3.0:1789996210.314979:0:8500:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789996210.315006:0:8500:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e085aa58a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789996210.315074:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942193536 00000100:00100000:2.0:1789996210.315080:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942193536 00000100:00100000:2.0:1789996210.315116:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1789996210.315124:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852ba4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+13:8500:x1876946942193536:12345-0@lo:502: 00000100:00100000:2.0:1789996210.315293:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852ba4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+13:8500:x1876946942193536:12345-0@lo:502: Request processed in 169us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996210.315303:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1789996210.315402:0:8500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e087f82b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0c28cd8-555e-481f-bd03-c3b02aee51c5:8500:1876946942193536:0@lo:502: 00000040:00080000:3.0:1789996210.315427:0:8500:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1789996210.315644:0:5843:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1789996210.315664:0:5843:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.137@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789996210.315676:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.137@tcp lock: ffff8e0841525e00/0x4173739f0fc806fa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc80701 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996210.315695:0:5843:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.137@tcp lock: ffff8e0841525e00/0x4173739f0fc806fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc80701 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789996210.315705:0:5843:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1789996210.315708:0:5843:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:2.0:1789996210.315712:0:5843:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1789996210.315804:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.137@tcp lock: ffff8e0842de5600/0x4173739f0fc80708 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996210.315886:0:5843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.137@tcp lock: ffff8e0842de5600/0x4173739f0fc80708 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996210.315897:0:5843:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.137@tcp lock: ffff8e0842de5600/0x4173739f0fc80708 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789996210.315913:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0846265500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5843:1876946942193664:0@lo:101: 00000100:00100000:2.0:1789996210.315959:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996210.315993:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e086fd99780 going to sleep for 11 seconds 00000100:00100000:3.0:1789996210.316055:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942193664 00000100:00100000:3.0:1789996210.316061:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942193664 00000100:00100000:3.0:1789996210.316097:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1789996210.316106:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852ba4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0c28cd8-555e-481f-bd03-c3b02aee51c5+13:5843:x1876946942193664:12345-0@lo:101: 00010000:00010000:3.0:1789996210.316117:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789996210.316133:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e0841524a00/0x4173739f0fc8070f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4173739f0fc80708 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996210.316171:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e0841524a00/0x4173739f0fc8070f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4173739f0fc80708 expref: 14 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996210.316183:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e0841524a00/0x4173739f0fc8070f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4173739f0fc80708 expref: 14 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996210.316193:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e0841524a00, rc 0) 00000100:00100000:3.0:1789996210.316227:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852ba4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0c28cd8-555e-481f-bd03-c3b02aee51c5+14:5843:x1876946942193664:12345-0@lo:101: Request processed in 122us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996210.316232:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1789996210.316310:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0846265500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5843:1876946942193664:0@lo:101: 00010000:00010000:2.0:1789996210.316326:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.137@tcp lock: ffff8e0842de5600/0x4173739f0fc80708 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc8070f expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996210.316338:0:5843:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.137@tcp lock: ffff8e0842de5600/0x4173739f0fc80708 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4173739f0fc8070f expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789996210.316395:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0846265500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5843:1876946942193792:0@lo:501: 00000100:00100000:2.0:1789996210.316421:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996210.316482:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e086fd99780 going to sleep for 11 seconds 00000100:00100000:3.0:1789996210.320041:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942193792 00000100:00100000:3.0:1789996210.320064:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942193792 00000100:00100000:3.0:1789996210.320131:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1789996210.320142:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852ba6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0c28cd8-555e-481f-bd03-c3b02aee51c5+14:5843:x1876946942193792:12345-0@lo:501: 00000100:00100000:3.0:1789996210.320520:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852ba6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0c28cd8-555e-481f-bd03-c3b02aee51c5+14:5843:x1876946942193792:12345-0@lo:501: Request processed in 378us (4095us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996210.320528:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1789996210.322081:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0846265500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5843:1876946942193792:0@lo:501: 00000100:00100000:3.0:1789996210.322144:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e087f82b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5843:1876946942193920:0@lo:503: 00000100:00100000:3.0:1789996210.322215:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789996210.322269:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e086d6ec540 going to sleep for 11 seconds 00000100:00100000:0.0:1789996210.322329:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942193920 00000100:00100000:0.0:1789996210.322336:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942193920 00000100:00100000:0.0:1789996210.322389:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1789996210.322398:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852ba6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0c28cd8-555e-481f-bd03-c3b02aee51c5+14:5843:x1876946942193920:12345-0@lo:503: 00000100:00100000:0.0:1789996210.322626:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852ba6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0c28cd8-555e-481f-bd03-c3b02aee51c5+14:5843:x1876946942193920:12345-0@lo:503: Request processed in 228us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996210.322634:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1789996210.324525:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e087f82b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5843:1876946942193920:0@lo:503: 00000100:00100000:3.0:1789996210.329358:0:8503:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e087f82b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0c28cd8-555e-481f-bd03-c3b02aee51c5:8503:1876946942194048:0@lo:502: 00000100:00100000:3.0:1789996210.329456:0:8503:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789996210.329510:0:8503:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0742b28480 going to sleep for 11 seconds 00000100:00100000:0.0:1789996210.329874:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942194048 00000100:00100000:0.0:1789996210.329882:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942194048 00000100:00100000:0.0:1789996210.329954:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1789996210.329965:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852ba4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0c28cd8-555e-481f-bd03-c3b02aee51c5+14:8503:x1876946942194048:12345-0@lo:502: 00000100:00100000:0.0:1789996210.330222:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852ba4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0c28cd8-555e-481f-bd03-c3b02aee51c5+14:8503:x1876946942194048:12345-0@lo:502: Request processed in 258us (766us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996210.330231:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1789996210.330777:0:8503:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e087f82b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0c28cd8-555e-481f-bd03-c3b02aee51c5:8503:1876946942194048:0@lo:502: 00000020:01000000:3.0:1789996210.330821:0:8503:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789996210.330833:0:8503:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789996210.330836:0:8503:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1789996210.330842:0:8503:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1789996210.330875:0:8503:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e087f82b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0c28cd8-555e-481f-bd03-c3b02aee51c5:8503:1876946942194176:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789996210.330936:0:8503:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789996210.330973:0:8503:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0742b28480 going to sleep for 11 seconds 00000100:00100000:0.0:1789996210.331095:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942194176 00000100:00100000:0.0:1789996210.331101:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942194176 00000100:00100000:0.0:1789996210.331129:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1789996210.331136:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852ba7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0c28cd8-555e-481f-bd03-c3b02aee51c5+14:8503:x1876946942194176:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789996210.331304:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852ba7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0c28cd8-555e-481f-bd03-c3b02aee51c5+14:8503:x1876946942194176:12345-0@lo:502:llog_process_th.0 Request processed in 167us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996210.331320:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1789996210.331607:0:8503:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e087f82b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0c28cd8-555e-481f-bd03-c3b02aee51c5:8503:1876946942194176:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789996210.331630:0:8503:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789996210.331635:0:8503:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789996210.331636:0:8503:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1789996210.331641:0:8503:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:0.0:1789996210.332045:0:5843:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:0.0:1789996210.332067:0:5843:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.137@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1789996210.332076:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.137@tcp lock: ffff8e0842de5600/0x4173739f0fc80708 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc8070f expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996210.332089:0:5843:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.137@tcp lock: ffff8e0842de5600/0x4173739f0fc80708 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc8070f expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789996210.332099:0:5843:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789996210.332102:0:5843:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8e0849c2f000 from 39 10000000:01000000:0.0:1789996210.332105:0:5843:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789996210.332135:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.137@tcp lock: ffff8e0840031a00/0x4173739f0fc80716 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996210.332143:0:5843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.137@tcp lock: ffff8e0840031a00/0x4173739f0fc80716 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996210.332154:0:5843:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.137@tcp lock: ffff8e0840031a00/0x4173739f0fc80716 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789996210.332171:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0847554e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5843:1876946942194304:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789996210.332207:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996210.332242:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e08475500c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789996210.332287:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942194304 00000100:00100000:3.0:1789996210.332294:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942194304 00000100:00100000:3.0:1789996210.332332:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1789996210.332340:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852ba5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0c28cd8-555e-481f-bd03-c3b02aee51c5+14:5843:x1876946942194304:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789996210.332350:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789996210.332364:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e0841524c00/0x4173739f0fc8071d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4173739f0fc80716 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996210.332386:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e0841524c00/0x4173739f0fc8071d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4173739f0fc80716 expref: 15 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996210.332398:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e0841524c00/0x4173739f0fc8071d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4173739f0fc80716 expref: 15 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996210.332407:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e0841524c00, rc 0) 00000100:00100000:3.0:1789996210.332451:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852ba5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0c28cd8-555e-481f-bd03-c3b02aee51c5+15:5843:x1876946942194304:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 112us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996210.332471:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1789996210.332583:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0847554e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5843:1876946942194304:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789996210.332596:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.137@tcp lock: ffff8e0840031a00/0x4173739f0fc80716 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc8071d expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996210.332606:0:5843:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.137@tcp lock: ffff8e0840031a00/0x4173739f0fc80716 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4173739f0fc8071d expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789996210.332654:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0846266d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5843:1876946942194432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789996210.332681:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996210.332700:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e086fd99a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789996210.332965:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942194432 00000100:00100000:3.0:1789996210.332970:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942194432 00000100:00100000:3.0:1789996210.332993:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1789996210.332999:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852ba5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+15:5843:x1876946942194432:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789996210.333230:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852ba5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+15:5843:x1876946942194432:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 230us (547us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996210.333236:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1789996210.333313:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0846266d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5843:1876946942194432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789996210.333345:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0846266d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5843:1876946942194560:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789996210.333383:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996210.333412:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e086fd99a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789996210.333475:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942194560 00000100:00100000:0.0:1789996210.333480:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942194560 00000100:00100000:0.0:1789996210.333511:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1789996210.333517:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852ba0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0c28cd8-555e-481f-bd03-c3b02aee51c5+15:5843:x1876946942194560:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789996210.333692:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852ba0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0c28cd8-555e-481f-bd03-c3b02aee51c5+15:5843:x1876946942194560:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 174us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996210.333707:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1789996210.334000:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0846266d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5843:1876946942194560:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789996210.343054:0:8504:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e087f82b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0c28cd8-555e-481f-bd03-c3b02aee51c5:8504:1876946942194688:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789996210.343427:0:8504:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789996210.343523:0:8504:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0742b28240 going to sleep for 11 seconds 00000100:00100000:0.0:1789996210.350690:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942194688 00000100:00100000:0.0:1789996210.350707:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942194688 00000100:00100000:0.0:1789996210.350879:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1789996210.350893:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852ba0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0c28cd8-555e-481f-bd03-c3b02aee51c5+15:8504:x1876946942194688:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789996210.351225:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852ba0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0c28cd8-555e-481f-bd03-c3b02aee51c5+15:8504:x1876946942194688:12345-0@lo:502:llog_process_th.0 Request processed in 335us (7798us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996210.351233:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1789996210.354643:0:8504:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e087f82b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0c28cd8-555e-481f-bd03-c3b02aee51c5:8504:1876946942194688:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789996210.354742:0:8504:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0846266d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0c28cd8-555e-481f-bd03-c3b02aee51c5:8504:1876946942194816:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789996210.354856:0:8504:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996210.354901:0:8504:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e086fd99cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789996210.356929:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942194816 00000100:00100000:3.0:1789996210.356947:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942194816 00000100:00100000:3.0:1789996210.357460:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1789996210.357472:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852ba2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+15:8504:x1876946942194816:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789996210.358341:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852ba2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+15:8504:x1876946942194816:12345-0@lo:502:llog_process_th.0 Request processed in 799us (3413us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996210.358353:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1789996210.358496:0:8504:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0846266d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0c28cd8-555e-481f-bd03-c3b02aee51c5:8504:1876946942194816:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1789996210.358577:0:8504:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1789996210.359883:0:5843:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1789996210.359911:0:5843:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.137@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789996210.359934:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.137@tcp lock: ffff8e0840031a00/0x4173739f0fc80716 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc8071d expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996210.359948:0:5843:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.137@tcp lock: ffff8e0840031a00/0x4173739f0fc80716 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc8071d expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789996210.359974:0:5843:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1789996210.359977:0:5843:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:3.0:1789996210.360062:0:5843:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1789996210.360098:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.137@tcp lock: ffff8e0841524000/0x4173739f0fc80724 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996210.360106:0:5843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.137@tcp lock: ffff8e0841524000/0x4173739f0fc80724 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996210.360116:0:5843:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.137@tcp lock: ffff8e0841524000/0x4173739f0fc80724 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789996210.360140:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e087f82bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5843:1876946942194944:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789996210.360345:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789996210.360392:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0742b286c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789996210.360507:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942194944 00000100:00100000:2.0:1789996210.360515:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942194944 00000100:00100000:1.0:1789996210.360941:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1789996210.360954:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852ba2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0c28cd8-555e-481f-bd03-c3b02aee51c5+15:5843:x1876946942194944:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789996210.360969:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789996210.360985:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e0876a23200/0x4173739f0fc8072b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x4173739f0fc80724 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996210.361011:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e0876a23200/0x4173739f0fc8072b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4173739f0fc80724 expref: 16 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996210.361023:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e0876a23200/0x4173739f0fc8072b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4173739f0fc80724 expref: 16 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996210.361032:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e0876a23200, rc 0) 00000100:00100000:1.0:1789996210.361078:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852ba2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0c28cd8-555e-481f-bd03-c3b02aee51c5+16:5843:x1876946942194944:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 128us (807us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996210.361084:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1789996210.361947:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e087f82bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5843:1876946942194944:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789996210.361972:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.137@tcp lock: ffff8e0841524000/0x4173739f0fc80724 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc8072b expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996210.362507:0:5843:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.137@tcp lock: ffff8e0841524000/0x4173739f0fc80724 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x4173739f0fc8072b expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789996210.362608:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e087f82bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5843:1876946942195072:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789996210.362662:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789996210.362697:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0742b286c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789996210.362719:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942195072 00000100:00100000:3.0:1789996210.362724:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942195072 00000100:00100000:3.0:1789996210.362764:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1789996210.362772:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852ba0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+16:5843:x1876946942195072:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789996210.363129:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852ba0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+16:5843:x1876946942195072:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 357us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996210.363137:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1789996210.363411:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e087f82bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5843:1876946942195072:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789996210.363459:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fa91500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5843:1876946942195200:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789996210.363501:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996210.363529:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0848997180 going to sleep for 11 seconds 00000100:00100000:3.0:1789996210.363588:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942195200 00000100:00100000:3.0:1789996210.363594:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942195200 00000100:00100000:3.0:1789996210.363619:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1789996210.363626:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852ba3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0c28cd8-555e-481f-bd03-c3b02aee51c5+16:5843:x1876946942195200:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789996210.363798:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852ba3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0c28cd8-555e-481f-bd03-c3b02aee51c5+16:5843:x1876946942195200:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 172us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996210.363805:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1789996210.363843:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fa91500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5843:1876946942195200:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789996210.364103:0:8510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e087f828380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0c28cd8-555e-481f-bd03-c3b02aee51c5:8510:1876946942195328:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789996210.364140:0:8510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789996210.364177:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942195328 00000100:00100000:3.0:1789996210.364181:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942195328 00000100:00100000:3.0:1789996210.364201:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1789996210.364207:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852ba1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0c28cd8-555e-481f-bd03-c3b02aee51c5+16:8510:x1876946942195328:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789996210.364373:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852ba1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0c28cd8-555e-481f-bd03-c3b02aee51c5+16:8510:x1876946942195328:12345-0@lo:502:llog_process_th.0 Request processed in 164us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996210.364380:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1789996210.364419:0:8510:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0742b286c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789996210.364432:0:8510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e087f828380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0c28cd8-555e-481f-bd03-c3b02aee51c5:8510:1876946942195328:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789996210.364460:0:8510:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789996210.364475:0:8510:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789996210.364477:0:8510:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1789996210.364484:0:8510:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1789996210.364507:0:8510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e087f828380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0c28cd8-555e-481f-bd03-c3b02aee51c5:8510:1876946942195456:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789996210.364539:0:8510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789996210.364585:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942195456 00000100:00100000:3.0:1789996210.364589:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942195456 00000100:00100000:3.0:1789996210.364609:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1789996210.364614:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852ba1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0c28cd8-555e-481f-bd03-c3b02aee51c5+16:8510:x1876946942195456:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789996210.364720:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852ba1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0c28cd8-555e-481f-bd03-c3b02aee51c5+16:8510:x1876946942195456:12345-0@lo:502:llog_process_th.0 Request processed in 104us (180us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996210.364727:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1789996210.364757:0:8510:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0742b286c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789996210.364769:0:8510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e087f828380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0c28cd8-555e-481f-bd03-c3b02aee51c5:8510:1876946942195456:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789996210.364786:0:8510:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789996210.364790:0:8510:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789996210.364791:0:8510:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1789996210.364795:0:8510:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:3.0:1789996210.364852:0:5843:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:3.0:1789996210.364866:0:5843:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.137@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1789996210.364875:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.137@tcp lock: ffff8e0841524000/0x4173739f0fc80724 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc8072b expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996210.364885:0:5843:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.137@tcp lock: ffff8e0841524000/0x4173739f0fc80724 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc8072b expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789996210.364896:0:5843:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789996210.364900:0:5843:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8e08709bf800 from 39 10000000:01000000:3.0:1789996210.364902:0:5843:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789996210.364943:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.137@tcp lock: ffff8e0841525200/0x4173739f0fc80732 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996210.364952:0:5843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.137@tcp lock: ffff8e0841525200/0x4173739f0fc80732 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996210.364960:0:5843:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.137@tcp lock: ffff8e0841525200/0x4173739f0fc80732 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789996210.364972:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e087f828380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5843:1876946942195584:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789996210.365076:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789996210.365091:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0742b286c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789996210.365104:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942195584 00000100:00100000:3.0:1789996210.365107:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942195584 00000100:00100000:3.0:1789996210.365128:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1789996210.365134:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852ba1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0c28cd8-555e-481f-bd03-c3b02aee51c5+16:5843:x1876946942195584:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789996210.365143:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789996210.365154:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e0841525000/0x4173739f0fc80739 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x4173739f0fc80732 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996210.365177:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e0841525000/0x4173739f0fc80739 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4173739f0fc80732 expref: 17 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996210.365187:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e0841525000/0x4173739f0fc80739 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4173739f0fc80732 expref: 17 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996210.365197:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e0841525000, rc 0) 00000100:00100000:3.0:1789996210.365224:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852ba1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0c28cd8-555e-481f-bd03-c3b02aee51c5+17:5843:x1876946942195584:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 90us (148us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996210.365230:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1789996210.365267:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e087f828380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5843:1876946942195584:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789996210.365281:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.137@tcp lock: ffff8e0841525200/0x4173739f0fc80732 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc80739 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996210.365290:0:5843:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.137@tcp lock: ffff8e0841525200/0x4173739f0fc80732 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x4173739f0fc80739 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789996210.365333:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e087f828380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5843:1876946942195712:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789996210.365356:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789996210.365370:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0742b286c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789996210.365382:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942195712 00000100:00100000:3.0:1789996210.365385:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942195712 00000100:00100000:3.0:1789996210.365405:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1789996210.365411:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852ba0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0c28cd8-555e-481f-bd03-c3b02aee51c5+17:5843:x1876946942195712:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789996210.365658:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852ba0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0c28cd8-555e-481f-bd03-c3b02aee51c5+17:5843:x1876946942195712:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 247us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996210.365665:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1789996210.365698:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e087f828380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5843:1876946942195712:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789996210.365725:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e087f828380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5843:1876946942195840:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789996210.365760:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789996210.365779:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0742b286c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789996210.365790:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942195840 00000100:00100000:3.0:1789996210.365794:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942195840 00000100:00100000:3.0:1789996210.365813:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1789996210.365819:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852ba3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0c28cd8-555e-481f-bd03-c3b02aee51c5+17:5843:x1876946942195840:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789996210.365951:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852ba3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0c28cd8-555e-481f-bd03-c3b02aee51c5+17:5843:x1876946942195840:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 131us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996210.365963:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1789996210.366246:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e087f828380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5843:1876946942195840:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789996210.369711:0:8511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0847554a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0c28cd8-555e-481f-bd03-c3b02aee51c5:8511:1876946942195968:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789996210.369946:0:8511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996210.370080:0:8511:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e084659e180 going to sleep for 11 seconds 00000100:00100000:3.0:1789996210.370120:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942195968 00000100:00100000:3.0:1789996210.370128:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942195968 00000100:00100000:3.0:1789996210.370278:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1789996210.370289:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852ba3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0c28cd8-555e-481f-bd03-c3b02aee51c5+17:8511:x1876946942195968:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789996210.370591:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852ba3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0c28cd8-555e-481f-bd03-c3b02aee51c5+17:8511:x1876946942195968:12345-0@lo:502:llog_process_th.0 Request processed in 303us (645us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996210.370599:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1789996210.370780:0:8511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0847554a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0c28cd8-555e-481f-bd03-c3b02aee51c5:8511:1876946942195968:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789996210.370831:0:8511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0847554a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0c28cd8-555e-481f-bd03-c3b02aee51c5:8511:1876946942196096:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789996210.370874:0:8511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996210.370899:0:8511:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e084659e180 going to sleep for 11 seconds 00000100:00100000:3.0:1789996210.371049:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942196096 00000100:00100000:3.0:1789996210.371055:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942196096 00000100:00100000:3.0:1789996210.371087:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1789996210.371095:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852ba2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0c28cd8-555e-481f-bd03-c3b02aee51c5+17:8511:x1876946942196096:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789996210.371477:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852ba2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0c28cd8-555e-481f-bd03-c3b02aee51c5+17:8511:x1876946942196096:12345-0@lo:502:llog_process_th.0 Request processed in 381us (600us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996210.371484:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1789996210.371651:0:8511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0847554a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0c28cd8-555e-481f-bd03-c3b02aee51c5:8511:1876946942196096:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1789996210.371678:0:8511:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1789996210.371930:0:5843:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1789996210.371954:0:5843:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.137@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789996210.371964:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.137@tcp lock: ffff8e0841525200/0x4173739f0fc80732 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc80739 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996210.372041:0:5843:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.137@tcp lock: ffff8e0841525200/0x4173739f0fc80732 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc80739 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789996210.372054:0:5843:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1789996210.372056:0:5843:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:3.0:1789996210.372066:0:5843:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1789996210.372103:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.137@tcp lock: ffff8e087f857a00/0x4173739f0fc80740 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996210.372110:0:5843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.137@tcp lock: ffff8e087f857a00/0x4173739f0fc80740 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996210.372119:0:5843:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.137@tcp lock: ffff8e087f857a00/0x4173739f0fc80740 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789996210.372133:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e087f828380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5843:1876946942196224:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789996210.372236:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789996210.372381:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e086d6ec540 going to sleep for 11 seconds 00000100:00100000:0.0:1789996210.372422:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942196224 00000100:00100000:0.0:1789996210.372428:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942196224 00000100:00100000:0.0:1789996210.372496:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1789996210.372504:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852ba3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+17:5843:x1876946942196224:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789996210.372515:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789996210.372528:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e0840030400/0x4173739f0fc80747 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x4173739f0fc80740 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996210.372582:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e0840030400/0x4173739f0fc80747 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4173739f0fc80740 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996210.372592:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e0840030400/0x4173739f0fc80747 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4173739f0fc80740 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996210.372601:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e0840030400, rc 0) 00000100:00100000:0.0:1789996210.372637:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852ba3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+18:5843:x1876946942196224:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 134us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996210.372643:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1789996210.372795:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e087f828380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5843:1876946942196224:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789996210.372809:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.137@tcp lock: ffff8e087f857a00/0x4173739f0fc80740 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc80747 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996210.372817:0:5843:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.137@tcp lock: ffff8e087f857a00/0x4173739f0fc80740 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x4173739f0fc80747 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789996210.372871:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0847554a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5843:1876946942196352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789996210.372898:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996210.372937:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e084659e840 going to sleep for 11 seconds 00000100:00100000:3.0:1789996210.373086:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942196352 00000100:00100000:3.0:1789996210.373092:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942196352 00000100:00100000:3.0:1789996210.374470:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1789996210.374493:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852ba1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0c28cd8-555e-481f-bd03-c3b02aee51c5+18:5843:x1876946942196352:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789996210.374829:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852ba1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0c28cd8-555e-481f-bd03-c3b02aee51c5+18:5843:x1876946942196352:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 346us (1929us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996210.374837:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1789996210.374930:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0847554a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5843:1876946942196352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789996210.374992:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0846266d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5843:1876946942196480:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789996210.375041:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996210.380031:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e086fd99cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789996210.380071:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942196480 00000100:00100000:0.0:1789996210.380082:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942196480 00000100:00100000:0.0:1789996210.380139:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1789996210.380160:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852ba2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0c28cd8-555e-481f-bd03-c3b02aee51c5+18:5843:x1876946942196480:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789996210.380438:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852ba2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0c28cd8-555e-481f-bd03-c3b02aee51c5+18:5843:x1876946942196480:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 275us (5392us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996210.380456:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1789996210.380463:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0846266d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5843:1876946942196480:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789996210.383609:0:8512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e087f82aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0c28cd8-555e-481f-bd03-c3b02aee51c5:8512:1876946942196608:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789996210.383708:0:8512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789996210.383762:0:8512:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0848e42000 going to sleep for 11 seconds 00000100:00100000:1.0:1789996210.384750:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942196608 00000100:00100000:1.0:1789996210.384761:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942196608 00000100:00100000:1.0:1789996210.384821:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1789996210.384831:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852b6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+18:8512:x1876946942196608:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789996210.385161:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852b6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+18:8512:x1876946942196608:12345-0@lo:502:llog_process_th.0 Request processed in 330us (1452us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996210.385175:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1789996210.385406:0:8512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e087f82aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0c28cd8-555e-481f-bd03-c3b02aee51c5:8512:1876946942196608:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789996210.385444:0:8512:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789996210.385454:0:8512:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789996210.385456:0:8512:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1789996210.385462:0:8512:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1789996210.385503:0:8512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0847556680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0c28cd8-555e-481f-bd03-c3b02aee51c5:8512:1876946942196736:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789996210.385561:0:8512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996210.385595:0:8512:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e084659ee40 going to sleep for 11 seconds 00000100:00100000:1.0:1789996210.385722:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942196736 00000100:00100000:1.0:1789996210.385727:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942196736 00000100:00100000:1.0:1789996210.385761:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1789996210.385769:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852b6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0c28cd8-555e-481f-bd03-c3b02aee51c5+18:8512:x1876946942196736:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789996210.385951:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852b6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0c28cd8-555e-481f-bd03-c3b02aee51c5+18:8512:x1876946942196736:12345-0@lo:502:llog_process_th.0 Request processed in 182us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996210.385959:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1789996210.386084:0:8512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0847556680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0c28cd8-555e-481f-bd03-c3b02aee51c5:8512:1876946942196736:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789996210.386106:0:8512:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789996210.386111:0:8512:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789996210.386112:0:8512:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1789996210.386116:0:8512:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:1.0:1789996210.386338:0:5843:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:1.0:1789996210.386359:0:5843:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.137@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1789996210.386372:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.137@tcp lock: ffff8e087f857a00/0x4173739f0fc80740 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc80747 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996210.386386:0:5843:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.137@tcp lock: ffff8e087f857a00/0x4173739f0fc80740 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc80747 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789996210.386397:0:5843:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1789996210.386401:0:5843:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8e08545d19c0 from 1 10000000:01000000:1.0:1789996210.386404:0:5843:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1789996210.386441:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.137@tcp lock: ffff8e0876a23600/0x4173739f0fc8074e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996210.386450:0:5843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.137@tcp lock: ffff8e0876a23600/0x4173739f0fc8074e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996210.386461:0:5843:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.137@tcp lock: ffff8e0876a23600/0x4173739f0fc8074e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789996210.386477:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fa91500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5843:1876946942196864:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789996210.386512:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996210.386535:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0848997240 going to sleep for 11 seconds 00000100:00100000:0.0:1789996210.386653:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942196864 00000100:00100000:0.0:1789996210.386658:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942196864 00000100:00100000:0.0:1789996210.386693:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1789996210.386701:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852b6e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0c28cd8-555e-481f-bd03-c3b02aee51c5+18:5843:x1876946942196864:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789996210.386711:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789996210.386725:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e0840030600/0x4173739f0fc80755 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x4173739f0fc8074e expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996210.386751:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e0840030600/0x4173739f0fc80755 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4173739f0fc8074e expref: 19 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996210.386762:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e0840030600/0x4173739f0fc80755 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4173739f0fc8074e expref: 19 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996210.386772:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e0840030600, rc 0) 00000100:00100000:0.0:1789996210.386800:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852b6e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0c28cd8-555e-481f-bd03-c3b02aee51c5+19:5843:x1876946942196864:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 101us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996210.386806:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1789996210.387971:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fa91500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5843:1876946942196864:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789996210.387998:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.137@tcp lock: ffff8e0876a23600/0x4173739f0fc8074e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc80755 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996210.388011:0:5843:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.137@tcp lock: ffff8e0876a23600/0x4173739f0fc8074e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x4173739f0fc80755 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789996210.388326:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e087f829180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5843:1876946942196992:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789996210.388377:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789996210.388409:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0848e42840 going to sleep for 11 seconds 00000100:00100000:1.0:1789996210.389471:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942196992 00000100:00100000:1.0:1789996210.389483:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942196992 00000100:00100000:1.0:1789996210.389553:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1789996210.389576:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852b6c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+19:5843:x1876946942196992:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789996210.389878:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852b6c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+19:5843:x1876946942196992:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 304us (1498us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789996210.389886:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1789996210.389952:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e087f829180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5843:1876946942196992:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1789996210.389995:0:5843:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.137@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1789996210.390004:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.137@tcp lock: ffff8e0876a23600/0x4173739f0fc8074e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc80755 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996210.390014:0:5843:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.137@tcp lock: ffff8e0876a23600/0x4173739f0fc8074e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc80755 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1789996210.451501:0:8518:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd611b0bb0 20000000:00000080:3.0:1789996210.451518:0:8518:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8e0876a0e400 uarg=0000000000000000 20000000:01000000:3.0:1789996210.451825:0:8518:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1789996210.451831:0:8518:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1789996210.451835:0:8518:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1789996210.453120:0:8519:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:3.0:1789996210.453677:0:8518:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:3.0:1789996210.459460:0:8518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:3.0:1789996210.459515:0:8518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:3.0:1789996210.459910:0:8518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:3.0:1789996210.459946:0:8518:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1789996210.460048:0:8518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e087f856400/0x4173739f0fc8075c lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996210.460070:0:8518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e08429c7e00/0x4173739f0fc804d1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4173739f0fc804ca expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996210.460079:0:8518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e0840031400/0x4173739f0fc80533 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4173739f0fc8052c expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996210.460086:0:8518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e08413f1600/0x4173739f0fc805fe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4173739f0fc805f7 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996210.460097:0:8518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e0840031e00/0x4173739f0fc806bb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e353e9 expref: 9 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996210.460106:0:8518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8e087f856400/0x4173739f0fc8075c lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996210.460169:0:8518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e0840031e00/0x4173739f0fc806bb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e353e9 expref: 9 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996210.460186:0:8518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e0840031e00/0x4173739f0fc806bb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e353e9 expref: 9 pid: 5839 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789996210.460201:0:8518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e087f82b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8518:1876946942197120:192.168.204.37@tcp:104: 00010000:00010000:3.0:1789996210.460386:0:8518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e08413f1600/0x4173739f0fc805fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4173739f0fc805f7 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996210.460396:0:8518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e08413f1600/0x4173739f0fc805fe lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4173739f0fc805f7 expref: 18 pid: 5839 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789996210.460406:0:8518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e087f829500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8518:1876946942197248:0@lo:104: 00000100:00100000:3.0:1789996210.460449:0:8518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789996210.460482:0:8518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e0840031400/0x4173739f0fc80533 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4173739f0fc8052c expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996210.460490:0:8518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e0840031400/0x4173739f0fc80533 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4173739f0fc8052c expref: 18 pid: 5841 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789996210.460498:0:8518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e087f829f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8518:1876946942197376:0@lo:104: 00000100:00100000:3.0:1789996210.460520:0:8518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789996210.460570:0:8518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e08429c7e00/0x4173739f0fc804d1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4173739f0fc804ca expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996210.460580:0:8518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e08429c7e00/0x4173739f0fc804d1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4173739f0fc804ca expref: 18 pid: 5840 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789996210.460602:0:8518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e087f828700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8518:1876946942197504:0@lo:104: 00000100:00100000:1.0:1789996210.461500:0:5830:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1789996210.461539:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996210.461583:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942197248 00000100:00100000:1.0:1789996210.461590:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942197248 00000100:00100000:1.0:1789996210.461624:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942197376 00000100:00100000:1.0:1789996210.461628:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942197376 00000100:00100000:1.0:1789996210.461637:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942197504 00000100:00100000:1.0:1789996210.461640:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942197504 00000100:00100000:1.0:1789996210.461652:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789996210.461660:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e087f82ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e0c28cd8-555e-481f-bd03-c3b02aee51c5+5:8518:x1876946942197248:12345-0@lo:104: 00010000:00010000:1.0:1789996210.461674:0:5830:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.137@tcp lock: ffff8e0842de5200/0x4173739f0fc805f7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4173739f0fc805fe expref: -99 pid: 7642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996210.461748:0:5830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789996210.461755:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e087f82ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e0c28cd8-555e-481f-bd03-c3b02aee51c5+5:8518:x1876946942197248:12345-0@lo:104: Request processed in 95us (1306us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996210.461762:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789996210.461782:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789996210.461789:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fad2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e0c28cd8-555e-481f-bd03-c3b02aee51c5+4:8518:x1876946942197376:12345-0@lo:104: 00010000:00010000:1.0:1789996210.461798:0:5830:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.137@tcp lock: ffff8e08429c7200/0x4173739f0fc8052c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4173739f0fc80533 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996210.461804:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789996210.461814:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.137@tcp lock: ffff8e0842de5200/0x4173739f0fc805f7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4173739f0fc805fe expref: -99 pid: 7642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996210.461825:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0842de5200 already unused, calling callback (ffffffffc1be0c20) 10000000:00010000:2.0:1789996210.461830:0:5835:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.137@tcp lock: ffff8e0842de5200/0x4173739f0fc805f7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x4173739f0fc805fe expref: -99 pid: 7642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996210.461838:0:5830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:2.0:1789996210.461839:0:5835:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.137@tcp lock: ffff8e0842de5200/0x4173739f0fc805f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x4173739f0fc805fe expref: -99 pid: 7642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789996210.461848:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fad2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e0c28cd8-555e-481f-bd03-c3b02aee51c5+4:8518:x1876946942197376:12345-0@lo:104: Request processed in 59us (1325us total) trans 0 rc 0/0 10000000:00010000:2.0:1789996210.461852:0:5835:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.137@tcp lock: ffff8e0842de5200/0x4173739f0fc805f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x4173739f0fc805fe expref: -99 pid: 7642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789996210.461859:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 10000000:01000000:2.0:1789996210.461864:0:5835:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:1.0:1789996210.461895:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00010000:00010000:2.0:1789996210.461904:0:5835:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.137@tcp lock: ffff8e0842de5200/0x4173739f0fc805f7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4173739f0fc805fe expref: -99 pid: 7642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789996210.461904:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fa93100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e0c28cd8-555e-481f-bd03-c3b02aee51c5+3:8518:x1876946942197504:12345-0@lo:104: 00010000:00010000:2.0:1789996210.461926:0:5835:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789996210.461928:0:5830:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.137@tcp lock: ffff8e0841524400/0x4173739f0fc804ca lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4173739f0fc804d1 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996210.461949:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.137@tcp lock: ffff8e0842de5200/0x4173739f0fc805f7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4173739f0fc805fe expref: -99 pid: 7642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996210.461959:0:5830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:2.0:1789996210.461971:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.137@tcp lock: ffff8e0842de5200/0x4173739f0fc805f7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4173739f0fc805fe expref: -99 pid: 7642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996210.461985:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789996210.461989:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.137@tcp lock: ffff8e08429c7200/0x4173739f0fc8052c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4173739f0fc80533 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996210.461994:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e08429c7200 already unused, calling callback (ffffffffc1be0c20) 10000000:00010000:2.0:1789996210.461997:0:5835:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.137@tcp lock: ffff8e08429c7200/0x4173739f0fc8052c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x4173739f0fc80533 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996210.462004:0:5835:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.137@tcp lock: ffff8e08429c7200/0x4173739f0fc8052c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x4173739f0fc80533 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789996210.462011:0:5835:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.137@tcp lock: ffff8e08429c7200/0x4173739f0fc8052c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x4173739f0fc80533 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789996210.462016:0:5835:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789996210.462030:0:5835:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.137@tcp lock: ffff8e08429c7200/0x4173739f0fc8052c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4173739f0fc80533 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996210.462035:0:5835:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789996210.462041:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.137@tcp lock: ffff8e08429c7200/0x4173739f0fc8052c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4173739f0fc80533 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996210.462048:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.137@tcp lock: ffff8e08429c7200/0x4173739f0fc8052c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4173739f0fc80533 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996210.462056:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789996210.462064:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.137@tcp lock: ffff8e0841524400/0x4173739f0fc804ca lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4173739f0fc804d1 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996210.462070:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0841524400 already unused, calling callback (ffffffffc1be0c20) 10000000:00010000:2.0:1789996210.462073:0:5835:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.137@tcp lock: ffff8e0841524400/0x4173739f0fc804ca lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4173739f0fc804d1 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996210.462080:0:5835:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.137@tcp lock: ffff8e0841524400/0x4173739f0fc804ca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4173739f0fc804d1 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789996210.462086:0:5835:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.137@tcp lock: ffff8e0841524400/0x4173739f0fc804ca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4173739f0fc804d1 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789996210.462091:0:5835:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789996210.462104:0:5835:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.137@tcp lock: ffff8e0841524400/0x4173739f0fc804ca lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4173739f0fc804d1 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996210.462110:0:5835:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789996210.462127:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.137@tcp lock: ffff8e0841524400/0x4173739f0fc804ca lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4173739f0fc804d1 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996210.462134:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.137@tcp lock: ffff8e0841524400/0x4173739f0fc804ca lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4173739f0fc804d1 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996210.462148:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789996210.462150:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789996210.462152:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789996210.462166:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0846265f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e0c28cd8-555e-481f-bd03-c3b02aee51c5:3313:1876946942197632:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789996210.462198:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789996210.462294:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789996210.462506:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fa93100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e0c28cd8-555e-481f-bd03-c3b02aee51c5+3:8518:x1876946942197504:12345-0@lo:104: Request processed in 76us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996210.462513:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789996210.462817:0:8518:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0848e42480 going to sleep for 11 seconds 00000100:00100000:3.0:1789996210.462947:0:8518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e087f829500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8518:1876946942197248:0@lo:104: 00000100:00100000:3.0:1789996210.462964:0:8518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e087f829f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8518:1876946942197376:0@lo:104: 00000100:00100000:3.0:1789996210.462972:0:8518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e087f828700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8518:1876946942197504:0@lo:104: 00000100:00100000:3.0:1789996210.463483:0:8518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e087f82b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8518:1876946942197120:192.168.204.37@tcp:104: 00010000:00010000:3.0:1789996210.463515:0:8518:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8e087f856400/0x4173739f0fc8075c lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789996210.463646:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0846267800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e0c28cd8-555e-481f-bd03-c3b02aee51c5:3315:1876946942197888:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789996210.463751:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996210.463824:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996210.463885:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789996210.463894:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0846264700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e0c28cd8-555e-481f-bd03-c3b02aee51c5:3313:1876946942197760:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789996210.463948:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996210.465005:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942197632 00000100:00100000:2.0:1789996210.465014:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942197632 00010000:00010000:2.0:1789996210.465054:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e08413f1600/0x4173739f0fc805fe lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4173739f0fc805f7 expref: 19 pid: 5839 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789996210.465075:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942197888 00000100:00100000:2.0:1789996210.465078:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942197888 00010000:00010000:2.0:1789996210.465090:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e08429c7e00/0x4173739f0fc804d1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4173739f0fc804ca expref: 20 pid: 5840 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789996210.465102:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927490176 00000100:00100000:2.0:1789996210.465104:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927490176 00010000:00010000:2.0:1789996210.465120:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e0840031e00/0x4173739f0fc806bb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e353e9 expref: 10 pid: 5839 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789996210.465129:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942197760 00000100:00100000:2.0:1789996210.465132:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942197760 00010000:00010000:2.0:1789996210.465154:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e0840031400/0x4173739f0fc80533 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4173739f0fc8052c expref: 21 pid: 5841 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789996210.465170:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789996210.465178:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0846264e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e0c28cd8-555e-481f-bd03-c3b02aee51c5+21:3313:x1876946942197632:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789996210.465192:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789996210.465198:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e08413f1600/0x4173739f0fc805fe lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4173739f0fc805f7 expref: 21 pid: 5839 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996210.465207:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e08413f1600/0x4173739f0fc805fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4173739f0fc805f7 expref: 21 pid: 5839 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996210.465225:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e08413f1600/0x4173739f0fc805fe lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4173739f0fc805f7 expref: 21 pid: 5839 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996210.465251:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789996210.465745:0:5833:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1789996210.465758:0:5833:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:2.0:1789996210.465777:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0846264e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e0c28cd8-555e-481f-bd03-c3b02aee51c5+20:3313:x1876946942197632:12345-0@lo:103:ldlm_bl.0 Request processed in 598us (3576us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996210.465954:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789996210.465977:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789996210.465985:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e087f82b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e0c28cd8-555e-481f-bd03-c3b02aee51c5+19:3315:x1876946942197888:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789996210.465994:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789996210.465999:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e08429c7e00/0x4173739f0fc804d1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4173739f0fc804ca expref: 19 pid: 5840 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996210.466009:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e08429c7e00/0x4173739f0fc804d1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4173739f0fc804ca expref: 19 pid: 5840 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996210.466021:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e08429c7e00/0x4173739f0fc804d1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4173739f0fc804ca expref: 19 pid: 5840 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996210.466031:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789996210.466069:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e087f82b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e0c28cd8-555e-481f-bd03-c3b02aee51c5+18:3315:x1876946942197888:12345-0@lo:103:ldlm_bl.0 Request processed in 86us (2319us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996210.466075:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789996210.466087:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 23 00000100:00100000:2.0:1789996210.466093:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fa92680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f78f7903-47ba-48a7-bb82-1f616cb85fc0+10:2363:x1876946927490176:12345-192.168.204.37@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789996210.466100:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789996210.466105:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e0840031e00/0x4173739f0fc806bb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e353e9 expref: 10 pid: 5839 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996210.466114:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e0840031e00/0x4173739f0fc806bb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e353e9 expref: 10 pid: 5839 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996210.466132:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e0840031e00/0x4173739f0fc806bb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e353e9 expref: 10 pid: 5839 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996210.466154:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789996210.466193:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fa92680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f78f7903-47ba-48a7-bb82-1f616cb85fc0+9:2363:x1876946927490176:12345-192.168.204.37@tcp:103:ldlm_bl.0 Request processed in 100us (2371us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996210.466199:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 23 00000100:00100000:2.0:1789996210.466211:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789996210.466217:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0846264a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e0c28cd8-555e-481f-bd03-c3b02aee51c5+17:3313:x1876946942197760:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789996210.466224:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789996210.466228:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e0840031400/0x4173739f0fc80533 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4173739f0fc8052c expref: 17 pid: 5841 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996210.466235:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e0840031400/0x4173739f0fc80533 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4173739f0fc8052c expref: 17 pid: 5841 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996210.466244:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e0840031400/0x4173739f0fc80533 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4173739f0fc8052c expref: 17 pid: 5841 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996210.466253:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8e087f856400/0x4173739f0fc8075c lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996210.466261:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e087f856400/0x4173739f0fc8075c lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996210.466275:0:5832:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e087f856400/0x4173739f0fc8075c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996210.466282:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e087f856400/0x4173739f0fc8075c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996210.466294:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e087f856400/0x4173739f0fc8075c lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996210.466301:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e087f856400/0x4173739f0fc8075c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996210.466307:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e087f856400 already unused, calling callback (ffffffffc1595910) 00010000:00010000:2.0:1789996210.466311:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e087f856400/0x4173739f0fc8075c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996210.466320:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e087f856400/0x4173739f0fc8075c lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996210.466332:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e087f856400/0x4173739f0fc8075c lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996210.466342:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789996210.466366:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0846264a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e0c28cd8-555e-481f-bd03-c3b02aee51c5+16:3313:x1876946942197760:12345-0@lo:103:ldlm_bl.0 Request processed in 149us (2418us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996210.466372:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789996210.466568:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0846265f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e0c28cd8-555e-481f-bd03-c3b02aee51c5:3313:1876946942197632:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789996210.466595:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0846264700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e0c28cd8-555e-481f-bd03-c3b02aee51c5:3313:1876946942197760:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789996210.469382:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0846267800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e0c28cd8-555e-481f-bd03-c3b02aee51c5:3315:1876946942197888:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789996210.469431:0:8518:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8e087f856400/0x4173739f0fc8075c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996210.469443:0:8518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e087f856400/0x4173739f0fc8075c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996210.469450:0:8518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e087f856400/0x4173739f0fc8075c lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789996210.477474:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1789996210.477519:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1789996210.477574:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1789996210.477604:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927490304 00000100:00100000:3.0:1789996210.477638:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927490304 00000100:00100000:3.0:1789996210.477795:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 26 00000100:00100000:3.0:1789996210.477808:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e087f829f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+6:2362:x1876946927490304:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:3.0:1789996210.477888:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e087f829f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+6:2362:x1876946927490304:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 82us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996210.477896:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 26 00000100:00080000:3.0:1789996210.477932:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789996210.478501:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927490432 00000100:00100000:0.0:1789996210.478508:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927490432 00000100:00100000:1.0:1789996210.478661:0:8222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927490560 00000100:00100000:1.0:1789996210.478666:0:8222:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927490560 00000100:00100000:0.0:1789996210.479168:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 11 00000100:00100000:0.0:1789996210.479179:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e087f828700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+5:2363:x1876946927490432:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:0.0:1789996210.479234:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e087f828700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+5:2363:x1876946927490432:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 57us (1775us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996210.479241:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 11 00000100:00080000:3.0:1789996210.481315:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789996210.482495:0:8222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 12 00000100:00100000:1.0:1789996210.482512:0:8222:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e087f829500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+5:2362:x1876946927490560:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:1.0:1789996210.482633:0:8222:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e087f829500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+5:2362:x1876946927490560:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 126us (5058us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996210.482642:0:8222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 12 00000100:00080000:3.0:1789996210.484605:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789996210.545995:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789996211.177484:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0846264000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876946942198272:0@lo:400:kworker.0 00000100:00100000:3.0:1789996211.179237:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0846266680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3316:1876946942198016:0@lo:400:kworker.0 00000100:00100000:3.0:1789996211.179303:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789996211.179367:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0846265c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876946942198528:0@lo:400:kworker.0 00000100:00100000:3.0:1789996211.179393:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789996211.179428:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789996211.179435:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0846266300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3316:1876946942198400:0@lo:400:kworker.0 00000100:00100000:3.0:1789996211.179458:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996211.179577:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996211.179608:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789996211.179615:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0846265880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3314:1876946942198144:0@lo:400:kworker.0 00000100:00100000:2.0:1789996211.179641:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996211.179671:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942198528 00000100:00100000:2.0:1789996211.179679:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942198528 00000100:00100000:2.0:1789996211.179731:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942198272 00000100:00100000:2.0:1789996211.179734:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942198272 00000100:00100000:2.0:1789996211.179777:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789996211.179788:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e087f828e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1876946942198528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789996211.179844:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e087f828e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1876946942198528:12345-0@lo:400:kworker.0 Request processed in 59us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996211.179852:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789996211.179871:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789996211.179877:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0846267100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1876946942198272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789996211.179931:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0846267100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1876946942198272:12345-0@lo:400:kworker.0 Request processed in 53us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996211.179939:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789996211.180343:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942198016 00000100:00100000:1.0:1789996211.180348:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942198016 00000100:00100000:1.0:1789996211.180372:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942198400 00000100:00100000:1.0:1789996211.180376:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942198400 00000100:00100000:1.0:1789996211.180391:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942198144 00000100:00100000:1.0:1789996211.180393:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942198144 00000100:00100000:1.0:1789996211.180407:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789996211.180414:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e087f82b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1876946942198016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789996211.180451:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e087f82b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1876946942198016:12345-0@lo:400:kworker.0 Request processed in 38us (1148us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996211.180458:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789996211.180471:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789996211.180476:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e087f828a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1876946942198400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789996211.180503:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e087f828a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1876946942198400:12345-0@lo:400:kworker.0 Request processed in 26us (1044us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996211.180509:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789996211.180519:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789996211.180525:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0846267b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876946942198144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789996211.180573:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0846267b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876946942198144:12345-0@lo:400:kworker.0 Request processed in 48us (930us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996211.180587:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:2.0:1789996211.181113:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789996211.181120:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789996211.181157:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0846266300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3316:1876946942198400:0@lo:400:kworker.0 00000100:00100000:2.0:1789996211.181170:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0846266680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3316:1876946942198016:0@lo:400:kworker.0 00010000:00080000:2.0:1789996211.181183:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e0846265c00 x1876946942198528/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789996227 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789996211.181192:0:3316:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1789996211.181207:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0846265c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876946942198528:0@lo:400:kworker.0 00000100:00100000:2.0:1789996211.181236:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0846265880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3314:1876946942198144:0@lo:400:kworker.0 00010000:00080000:2.0:1789996211.181246:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e0846264000 x1876946942198272/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789996227 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789996211.181254:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0846264000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876946942198272:0@lo:400:kworker.0 00010000:00010000:0.0:1789996211.562048:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789996211.688883:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789996211.688916:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0846264000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876946942198656:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789996211.689016:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996211.693260:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942198656 00000100:00100000:2.0:1789996211.693278:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942198656 00000100:00100000:2.0:1789996211.693349:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789996211.693362:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0846265880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876946942198656:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789996211.693404:0:6691:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789996211.693504:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0846265880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876946942198656:12345-0@lo:13:osp-pre-1-0.0 Request processed in 145us (4488us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996211.693511:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:0.0:1789996211.693707:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e0846264000 x1876946942198656/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789996227 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789996211.693731:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0846264000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876946942198656:0@lo:13:osp-pre-1-0.0 10000000:01000000:2.0:1789996211.881951:0:5843:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789996211.881959:0:5843:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e0847d01800 from 4 10000000:01000000:2.0:1789996211.881964:0:5843:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789996211.882011:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.137@tcp lock: ffff8e0842de4600/0x4173739f0fc80763 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996211.882023:0:5843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.137@tcp lock: ffff8e0842de4600/0x4173739f0fc80763 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996211.882036:0:5843:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.137@tcp lock: ffff8e0842de4600/0x4173739f0fc80763 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789996211.882199:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0846265c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5843:1876946942198784:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789996211.882276:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996211.882329:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e086fd99cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789996211.882400:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942198784 00000100:00100000:1.0:1789996211.882410:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942198784 00000100:00100000:1.0:1789996211.882469:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1789996211.882478:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852b6fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0c28cd8-555e-481f-bd03-c3b02aee51c5+16:5843:x1876946942198784:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789996211.882492:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789996211.882507:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e0876a23e00/0x4173739f0fc8076a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4173739f0fc80763 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996211.882704:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e0876a23e00/0x4173739f0fc8076a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4173739f0fc80763 expref: 17 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996211.882718:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e0876a23e00/0x4173739f0fc8076a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4173739f0fc80763 expref: 17 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996211.882728:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e0876a23e00, rc 0) 00000100:00100000:1.0:1789996211.882774:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852b6fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0c28cd8-555e-481f-bd03-c3b02aee51c5+17:5843:x1876946942198784:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 295us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996211.882781:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1789996211.883187:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0846265c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5843:1876946942198784:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789996211.883208:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.137@tcp lock: ffff8e0842de4600/0x4173739f0fc80763 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc8076a expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996211.883218:0:5843:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.137@tcp lock: ffff8e0842de4600/0x4173739f0fc80763 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4173739f0fc8076a expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789996211.883294:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0846265c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5843:1876946942198912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789996211.883326:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996211.883359:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e086fd99cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789996211.883585:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942198912 00000100:00100000:3.0:1789996211.883592:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942198912 00000100:00100000:3.0:1789996211.883623:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1789996211.883631:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852b6d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0c28cd8-555e-481f-bd03-c3b02aee51c5+17:5843:x1876946942198912:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789996211.883918:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852b6d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0c28cd8-555e-481f-bd03-c3b02aee51c5+17:5843:x1876946942198912:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 288us (591us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996211.883926:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1789996211.884687:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0846265c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5843:1876946942198912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789996211.884731:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fa91500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5843:1876946942199040:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789996211.884777:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996211.884809:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0848997900 going to sleep for 11 seconds 00000100:00100000:0.0:1789996211.886235:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942199040 00000100:00100000:0.0:1789996211.886246:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942199040 00000100:00100000:0.0:1789996211.886300:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1789996211.886309:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852b6d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+17:5843:x1876946942199040:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789996211.886558:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852b6d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+17:5843:x1876946942199040:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 234us (1764us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996211.886566:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1789996211.886669:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fa91500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5843:1876946942199040:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789996211.890279:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996211.890328:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927490688 00000100:00100000:2.0:1789996211.890341:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927490688 00000100:00100000:2.0:1789996211.890403:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 173 00000100:00100000:2.0:1789996211.890415:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852b6d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f78f7903-47ba-48a7-bb82-1f616cb85fc0+9:5601:x1876946927490688:12345-192.168.204.37@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789996211.890431:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789996211.890450:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e0842de5c00/0x4173739f0fc80771 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b97003095e35428 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996211.890853:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e0842de5c00/0x4173739f0fc80771 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35428 expref: 10 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996211.890871:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e0842de5c00/0x4173739f0fc80771 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35428 expref: 10 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996211.890881:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e0842de5c00, rc 0) 00000100:00100000:2.0:1789996211.890958:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852b6d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f78f7903-47ba-48a7-bb82-1f616cb85fc0+10:5601:x1876946927490688:12345-192.168.204.37@tcp:101:ll_cfg_requeue.0 Request processed in 544us (689us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996211.890974:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 173 00000100:00100000:2.0:1789996211.892824:0:8593:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0846266680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0c28cd8-555e-481f-bd03-c3b02aee51c5:8593:1876946942199168:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789996211.892923:0:8593:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996211.892973:0:8593:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e086fd99e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789996211.893109:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942199168 00000100:00100000:1.0:1789996211.893590:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942199168 00000100:00100000:1.0:1789996211.894202:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1789996211.894220:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852b6cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0c28cd8-555e-481f-bd03-c3b02aee51c5+17:8593:x1876946942199168:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789996211.894812:0:8593:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0846266680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0c28cd8-555e-481f-bd03-c3b02aee51c5:8593:1876946942199168:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789996211.894849:0:8593:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789996211.894861:0:8593:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789996211.894863:0:8593:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1789996211.894872:0:8593:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e0847d01800 00000020:00000080:2.0:1789996211.894875:0:8593:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789996211.894986:0:8593:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0846266680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0c28cd8-555e-481f-bd03-c3b02aee51c5:8593:1876946942199296:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789996211.895337:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852b6cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0c28cd8-555e-481f-bd03-c3b02aee51c5+17:8593:x1876946942199168:12345-0@lo:502:llog_process_th.0 Request processed in 1119us (2413us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996211.895347:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1789996211.895607:0:8593:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996211.895777:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942199296 00000100:00100000:1.0:1789996211.895784:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942199296 00000100:00100000:1.0:1789996211.895823:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1789996211.895832:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852b6f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0c28cd8-555e-481f-bd03-c3b02aee51c5+17:8593:x1876946942199296:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789996211.896021:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852b6f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0c28cd8-555e-481f-bd03-c3b02aee51c5+17:8593:x1876946942199296:12345-0@lo:502:llog_process_th.0 Request processed in 190us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996211.896028:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1789996211.896186:0:8593:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e086fd99e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789996211.896203:0:8593:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0846266680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0c28cd8-555e-481f-bd03-c3b02aee51c5:8593:1876946942199296:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789996211.896226:0:8593:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789996211.896232:0:8593:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789996211.896234:0:8593:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1789996211.896239:0:8593:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1789996211.897759:0:5843:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1789996211.897787:0:5843:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.137@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789996211.897799:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.137@tcp lock: ffff8e0842de4600/0x4173739f0fc80763 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc8076a expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996211.897813:0:5843:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.137@tcp lock: ffff8e0842de4600/0x4173739f0fc80763 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc8076a expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789996211.897823:0:5843:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789996211.897826:0:5843:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e0849c2f000 from 4 10000000:01000000:1.0:1789996211.897829:0:5843:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789996211.897863:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.137@tcp lock: ffff8e0876a23c00/0x4173739f0fc80778 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996211.897871:0:5843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.137@tcp lock: ffff8e0876a23c00/0x4173739f0fc80778 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996211.897882:0:5843:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.137@tcp lock: ffff8e0876a23c00/0x4173739f0fc80778 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789996211.897922:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fa91500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5843:1876946942199424:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789996211.897983:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996211.898016:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0848997900 going to sleep for 11 seconds 00000100:00100000:0.0:1789996211.898165:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942199424 00000100:00100000:0.0:1789996211.898173:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942199424 00000100:00100000:0.0:1789996211.898221:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1789996211.898230:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852b6f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0c28cd8-555e-481f-bd03-c3b02aee51c5+17:5843:x1876946942199424:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789996211.898248:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789996211.898263:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e0840030200/0x4173739f0fc8077f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4173739f0fc80778 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996211.898287:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e0840030200/0x4173739f0fc8077f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4173739f0fc80778 expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996211.898298:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e0840030200/0x4173739f0fc8077f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4173739f0fc80778 expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996211.898307:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e0840030200, rc 0) 00000100:00100000:0.0:1789996211.898350:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852b6f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0c28cd8-555e-481f-bd03-c3b02aee51c5+18:5843:x1876946942199424:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 121us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996211.898357:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1789996211.900337:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fa91500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5843:1876946942199424:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789996211.900363:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.137@tcp lock: ffff8e0876a23c00/0x4173739f0fc80778 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc8077f expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996211.900376:0:5843:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.137@tcp lock: ffff8e0876a23c00/0x4173739f0fc80778 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4173739f0fc8077f expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789996211.900445:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fa91500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5843:1876946942199552:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789996211.900498:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996211.900533:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0848997900 going to sleep for 11 seconds 00000100:00100000:1.0:1789996211.900578:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942199552 00000100:00100000:1.0:1789996211.900584:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942199552 00000100:00100000:1.0:1789996211.900623:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1789996211.900630:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852b6e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0c28cd8-555e-481f-bd03-c3b02aee51c5+18:5843:x1876946942199552:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789996211.900857:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852b6e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0c28cd8-555e-481f-bd03-c3b02aee51c5+18:5843:x1876946942199552:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 226us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996211.900871:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1789996211.900923:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fa91500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5843:1876946942199552:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789996211.900948:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fa91500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5843:1876946942199680:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789996211.900985:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996211.900999:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0848997900 going to sleep for 11 seconds 00000100:00100000:1.0:1789996211.901016:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942199680 00000100:00100000:1.0:1789996211.901019:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942199680 00000100:00100000:1.0:1789996211.901052:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1789996211.901059:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852b6f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0c28cd8-555e-481f-bd03-c3b02aee51c5+18:5843:x1876946942199680:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789996211.902528:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852b6f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0c28cd8-555e-481f-bd03-c3b02aee51c5+18:5843:x1876946942199680:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1463us (1536us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996211.902554:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1789996211.902610:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fa91500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5843:1876946942199680:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789996211.913416:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1789996211.913567:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927490816 00000100:00100000:1.0:1789996211.913577:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927490816 00000100:00100000:3.0:1789996211.913588:0:8597:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e087f82ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0c28cd8-555e-481f-bd03-c3b02aee51c5:8597:1876946942199808:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789996211.913631:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 179 00000100:00100000:3.0:1789996211.913653:0:8597:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996211.913657:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852b6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f78f7903-47ba-48a7-bb82-1f616cb85fc0+10:5601:x1876946927490816:12345-192.168.204.37@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789996211.913702:0:8597:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0848e42840 going to sleep for 11 seconds 00000100:00100000:1.0:1789996211.913924:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852b6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f78f7903-47ba-48a7-bb82-1f616cb85fc0+10:5601:x1876946927490816:12345-192.168.204.37@tcp:501:ll_cfg_requeue.0 Request processed in 283us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996211.913933:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 179 00000100:00100000:1.0:1789996211.913954:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942199808 00000100:00100000:1.0:1789996211.913958:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942199808 00000100:00100000:1.0:1789996211.913971:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1789996211.913976:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852b6e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+18:8597:x1876946942199808:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789996211.917872:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852b6e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+18:8597:x1876946942199808:12345-0@lo:502:llog_process_th.0 Request processed in 3888us (4212us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996211.917898:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1789996211.917970:0:8597:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e087f82ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0c28cd8-555e-481f-bd03-c3b02aee51c5:8597:1876946942199808:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789996211.918006:0:8597:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789996211.918015:0:8597:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789996211.918018:0:8597:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789996211.918026:0:8597:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e0849c2f000 00000020:00000080:1.0:1789996211.918512:0:8597:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789996211.918630:0:8597:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fa91500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0c28cd8-555e-481f-bd03-c3b02aee51c5:8597:1876946942199936:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789996211.918754:0:8597:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996211.919169:0:8597:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0848997240 going to sleep for 11 seconds 00000100:00100000:3.0:1789996211.919739:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942199936 00000100:00100000:3.0:1789996211.919746:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942199936 00000100:00100000:3.0:1789996211.919791:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1789996211.919799:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852b6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0c28cd8-555e-481f-bd03-c3b02aee51c5+18:8597:x1876946942199936:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789996211.920036:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852b6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0c28cd8-555e-481f-bd03-c3b02aee51c5+18:8597:x1876946942199936:12345-0@lo:502:llog_process_th.0 Request processed in 237us (1282us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996211.920044:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1789996211.920198:0:8597:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fa91500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0c28cd8-555e-481f-bd03-c3b02aee51c5:8597:1876946942199936:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789996211.920228:0:8597:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789996211.920235:0:8597:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789996211.920238:0:8597:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1789996211.920244:0:8597:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1789996211.920582:0:5843:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1789996211.920602:0:5843:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.137@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789996211.920614:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.137@tcp lock: ffff8e0876a23c00/0x4173739f0fc80778 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc8077f expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996211.920627:0:5843:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.137@tcp lock: ffff8e0876a23c00/0x4173739f0fc80778 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc8077f expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789996211.920639:0:5843:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789996211.920642:0:5843:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e08709bf800 from 4 10000000:01000000:0.0:1789996211.920645:0:5843:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789996211.920675:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.137@tcp lock: ffff8e0840031200/0x4173739f0fc80786 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996211.920692:0:5843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.137@tcp lock: ffff8e0840031200/0x4173739f0fc80786 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996211.920702:0:5843:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.137@tcp lock: ffff8e0840031200/0x4173739f0fc80786 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789996211.920721:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0847555880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5843:1876946942200064:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789996211.920759:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996211.920799:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0843e11b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789996211.921203:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942200064 00000100:00100000:1.0:1789996211.921209:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942200064 00000100:00100000:1.0:1789996211.921252:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1789996211.921356:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0870532050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+18:5843:x1876946942200064:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789996211.921367:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789996211.921382:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e0876a22200/0x4173739f0fc8078d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4173739f0fc80786 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996211.921407:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e0876a22200/0x4173739f0fc8078d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4173739f0fc80786 expref: 19 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996211.921418:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e0876a22200/0x4173739f0fc8078d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4173739f0fc80786 expref: 19 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996211.921427:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e0876a22200, rc 0) 00000100:00100000:1.0:1789996211.921474:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0870532050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+19:5843:x1876946942200064:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 121us (714us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996211.924204:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1789996211.924336:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1789996211.924371:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927490944 00000100:00100000:1.0:1789996211.924386:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927490944 00000100:00100000:1.0:1789996211.924438:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 183 00000100:00100000:1.0:1789996211.924448:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e08602c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f78f7903-47ba-48a7-bb82-1f616cb85fc0+10:5601:x1876946927490944:12345-192.168.204.37@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789996211.925628:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e08602c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f78f7903-47ba-48a7-bb82-1f616cb85fc0+10:5601:x1876946927490944:12345-192.168.204.37@tcp:503:ll_cfg_requeue.0 Request processed in 1178us (1291us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996211.925716:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 183 00000100:00100000:1.0:1789996211.925908:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0847555880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5843:1876946942200064:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789996211.925931:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.137@tcp lock: ffff8e0840031200/0x4173739f0fc80786 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc8078d expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996211.925945:0:5843:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.137@tcp lock: ffff8e0840031200/0x4173739f0fc80786 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4173739f0fc8078d expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789996211.926028:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fa91500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5843:1876946942200192:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789996211.926079:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996211.926110:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0848997180 going to sleep for 11 seconds 00000100:00100000:1.0:1789996211.926724:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942200192 00000100:00100000:1.0:1789996211.926731:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942200192 00000100:00100000:1.0:1789996211.926763:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1789996211.926770:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e08602ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+19:5843:x1876946942200192:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789996211.927006:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e08602ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+19:5843:x1876946942200192:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 235us (925us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996211.927013:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1789996211.927391:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fa91500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5843:1876946942200192:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789996211.927432:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fa91500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5843:1876946942200320:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789996211.927483:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996211.927519:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0848997180 going to sleep for 11 seconds 00000100:00100000:1.0:1789996211.927583:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942200320 00000100:00100000:1.0:1789996211.927588:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942200320 00000100:00100000:1.0:1789996211.927619:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1789996211.927626:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e08602cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0c28cd8-555e-481f-bd03-c3b02aee51c5+19:5843:x1876946942200320:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789996211.927923:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e08602cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0c28cd8-555e-481f-bd03-c3b02aee51c5+19:5843:x1876946942200320:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 296us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996211.927931:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1789996211.927995:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fa91500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5843:1876946942200320:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789996211.928583:0:8600:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fa91500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0c28cd8-555e-481f-bd03-c3b02aee51c5:8600:1876946942200448:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789996211.928631:0:8600:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996211.928744:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942200448 00000100:00100000:1.0:1789996211.928749:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942200448 00000100:00100000:1.0:1789996211.928778:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1789996211.928786:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e08602cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0c28cd8-555e-481f-bd03-c3b02aee51c5+19:8600:x1876946942200448:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789996211.929325:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e08602cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0c28cd8-555e-481f-bd03-c3b02aee51c5+19:8600:x1876946942200448:12345-0@lo:502:llog_process_th.0 Request processed in 538us (692us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996211.929332:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1789996211.929369:0:8600:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0848997f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789996211.929387:0:8600:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fa91500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0c28cd8-555e-481f-bd03-c3b02aee51c5:8600:1876946942200448:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789996211.929410:0:8600:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789996211.929420:0:8600:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789996211.929422:0:8600:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789996211.929430:0:8600:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e08709bf800 00000020:00000080:1.0:1789996211.929432:0:8600:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789996211.929508:0:8600:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fa91500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0c28cd8-555e-481f-bd03-c3b02aee51c5:8600:1876946942200576:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789996211.929562:0:8600:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996211.929591:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942200576 00000100:00100000:1.0:1789996211.929596:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942200576 00000100:00100000:1.0:1789996211.929619:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1789996211.929875:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e08602c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0c28cd8-555e-481f-bd03-c3b02aee51c5+19:8600:x1876946942200576:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789996211.931058:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e08602c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0c28cd8-555e-481f-bd03-c3b02aee51c5+19:8600:x1876946942200576:12345-0@lo:502:llog_process_th.0 Request processed in 1426us (1489us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996211.931068:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1789996211.931135:0:8600:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0848997f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789996211.931155:0:8600:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fa91500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0c28cd8-555e-481f-bd03-c3b02aee51c5:8600:1876946942200576:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789996211.931180:0:8600:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789996211.931188:0:8600:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789996211.931190:0:8600:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1789996211.931195:0:8600:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1789996211.931254:0:5843:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1789996211.931281:0:5843:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.137@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789996211.931292:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.137@tcp lock: ffff8e0840031200/0x4173739f0fc80786 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc8078d expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996211.931304:0:5843:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.137@tcp lock: ffff8e0840031200/0x4173739f0fc80786 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc8078d expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789996211.935073:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996211.938672:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927491072 00000100:00100000:2.0:1789996211.938689:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927491072 00000100:00100000:2.0:1789996211.938751:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 188 00000100:00100000:2.0:1789996211.938765:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e08602c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f78f7903-47ba-48a7-bb82-1f616cb85fc0+10:6128:x1876946927491072:12345-192.168.204.37@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789996211.940431:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e08602c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f78f7903-47ba-48a7-bb82-1f616cb85fc0+10:6128:x1876946927491072:12345-192.168.204.37@tcp:502:llog_process_th.0 Request processed in 1664us (5364us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996211.940443:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 188 00000100:00100000:0.0:1789996211.949354:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1789996211.949415:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927491200 00000100:00100000:3.0:1789996211.949425:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927491200 00000100:00100000:3.0:1789996211.949476:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 189 00000100:00100000:3.0:1789996211.949485:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e08602ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f78f7903-47ba-48a7-bb82-1f616cb85fc0+10:6128:x1876946927491200:12345-192.168.204.37@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789996211.949735:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e08602ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f78f7903-47ba-48a7-bb82-1f616cb85fc0+10:6128:x1876946927491200:12345-192.168.204.37@tcp:502:llog_process_th.0 Request processed in 250us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996211.949742:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 189 00010000:00010000:0.0:1789996212.584821:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789996213.610661:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789996214.632724:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789996215.277520:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0847554000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876946942200704:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789996215.277612:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996215.277700:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942200704 00000100:00100000:0.0:1789996215.277708:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942200704 00000100:00100000:0.0:1789996215.277779:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789996215.277790:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0847556300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876946942200704:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789996215.277838:0:6691:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789996215.278067:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0847556300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876946942200704:12345-0@lo:13:osp-pre-0-0.0 Request processed in 278us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996215.278075:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:0.0:1789996215.278098:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789996215.278131:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e0847554000 x1876946942200704/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789996231 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789996215.278150:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0847554000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876946942200704:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789996215.600233:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1789996215.600270:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1789996215.600298:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1789996215.600334:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1789996215.600366:0:8222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927491584 00000100:00100000:1.0:1789996215.600375:0:8222:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927491584 00000100:00100000:1.0:1789996215.600687:0:8222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927491712 00000100:00100000:1.0:1789996215.600692:0:8222:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927491712 00000100:00100000:1.0:1789996215.600723:0:8222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 15 00000100:00100000:1.0:1789996215.600735:0:8222:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fa91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+5:2365:x1876946927491584:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:0.0:1789996215.600752:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 16 00000100:00100000:0.0:1789996215.600766:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0876619f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+5:2365:x1876946927491712:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:2.0:1789996215.600771:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927491328 00000100:00100000:2.0:1789996215.600778:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927491328 00000100:00100000:2.0:1789996215.600811:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 190 00000100:00100000:2.0:1789996215.600830:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e08602c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f78f7903-47ba-48a7-bb82-1f616cb85fc0+10:2365:x1876946927491328:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:1.0:1789996215.600834:0:8222:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fa91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+5:2365:x1876946927491584:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 104us (563us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996215.600880:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0876619f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+5:2365:x1876946927491712:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 118us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996215.600889:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 16 00000100:00100000:1.0:1789996215.600930:0:8222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 15 00000100:00100000:1.0:1789996215.600956:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927491456 00000100:00100000:1.0:1789996215.600960:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927491456 00000100:00100000:1.0:1789996215.601000:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 30 00000100:00100000:1.0:1789996215.601007:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fa72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+6:2365:x1876946927491456:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:1.0:1789996215.601039:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fa72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+6:2365:x1876946927491456:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 32us (740us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996215.601044:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 30 00000100:00080000:1.0:1789996215.601063:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789996215.601068:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789996215.601069:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789996215.606857:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e08602c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f78f7903-47ba-48a7-bb82-1f616cb85fc0+10:2365:x1876946927491328:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 6026us (6620us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996215.606897:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 190 00010000:00010000:0.0:1789996215.657091:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789996216.298227:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0876618e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3316:1876946942200960:0@lo:400:kworker.0 00000100:00100000:0.0:1789996216.298258:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e087661a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e0c28cd8-555e-481f-bd03-c3b02aee51c5:3315:1876946942200832:0@lo:400:kworker.0 00000100:00100000:1.0:1789996216.302316:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996216.302409:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0741834700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876946942201472:0@lo:400:kworker.0 00000100:00100000:1.0:1789996216.302460:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996216.302522:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942200960 00000100:00100000:2.0:1789996216.302533:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942200960 00000100:00100000:2.0:1789996216.302612:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789996216.302622:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0741837800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1876946942200960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789996216.302680:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0741837800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1876946942200960:12345-0@lo:400:kworker.0 Request processed in 59us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996216.302687:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789996216.302779:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0876618e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3316:1876946942200960:0@lo:400:kworker.0 00000100:00100000:0.0:1789996216.303271:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996216.303317:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0876618a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1876946942201344:0@lo:400:kworker.0 00000100:00100000:0.0:1789996216.303346:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996216.303386:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0876618700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1876946942201088:0@lo:400:kworker.0 00000100:00100000:0.0:1789996216.303423:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996216.303446:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789996216.303453:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e087661b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876946942201216:0@lo:400:kworker.0 00000100:00100000:0.0:1789996216.303475:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996216.303508:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942201472 00000100:00100000:2.0:1789996216.303511:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942201344 00000100:00100000:0.0:1789996216.303513:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942201472 00000100:00100000:2.0:1789996216.303514:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942201344 00000100:00100000:2.0:1789996216.303560:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942201088 00000100:00100000:2.0:1789996216.303563:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942201088 00000100:00100000:1.0:1789996216.303575:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942200832 00000100:00100000:1.0:1789996216.303578:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942200832 00000100:00100000:1.0:1789996216.303611:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1789996216.303619:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e08602c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+19:3315:x1876946942200832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789996216.303657:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e08602c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+19:3315:x1876946942200832:12345-0@lo:400:kworker.0 Request processed in 38us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996216.303675:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1789996216.308332:0:8222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942201216 00000100:00100000:3.0:1789996216.308354:0:8222:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942201216 00000100:00100000:3.0:1789996216.308436:0:8222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789996216.308447:0:8222:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0847556680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1876946942201216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789996216.308617:0:8222:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0847556680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1876946942201216:12345-0@lo:400:kworker.0 Request processed in 171us (5140us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996216.308624:0:8222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789996216.308654:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789996216.309294:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0847554000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876946942201344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789996216.309349:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0847554000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876946942201344:12345-0@lo:400:kworker.0 Request processed in 686us (6001us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996216.309356:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789996216.309419:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e087661a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e0c28cd8-555e-481f-bd03-c3b02aee51c5:3315:1876946942200832:0@lo:400:kworker.0 00000100:00100000:3.0:1789996216.309436:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0876618a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1876946942201344:0@lo:400:kworker.0 00010000:00080000:0.0:1789996216.310024:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e087661b800 x1876946942201216/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789996232 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789996216.310037:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e087661b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876946942201216:0@lo:400:kworker.0 00000100:00100000:0.0:1789996216.310096:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789996216.310107:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0741834e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1876946942201472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789996216.310737:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0741834e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1876946942201472:12345-0@lo:400:kworker.0 Request processed in 632us (8274us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996216.310761:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:0.0:1789996216.310797:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e0741834700 x1876946942201472/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789996232 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789996216.310819:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0741834700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876946942201472:0@lo:400:kworker.0 00000100:00100000:2.0:1789996216.313299:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789996216.313315:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0847555880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876946942201088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789996216.313831:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0876618700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1876946942201088:0@lo:400:kworker.0 00000100:00080000:1.0:1789996216.313917:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789996216.313944:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789996216.314237:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0847555880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876946942201088:12345-0@lo:400:kworker.0 Request processed in 98us (9985us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996216.314248:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000001:02000400:3.0:1789996216.513516:0:8819:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg437-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:2.0:1789996216.680814:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789996216.809712:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789996216.809735:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0846266680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876946942201600:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789996216.809819:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996216.809940:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942201600 00000100:00100000:0.0:1789996216.809951:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942201600 00000100:00100000:0.0:1789996216.810011:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789996216.810023:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0846266300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876946942201600:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789996216.810063:0:6691:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789996216.810122:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0846266300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876946942201600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996216.810131:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:2.0:1789996216.810266:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e0846266680 x1876946942201600/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789996232 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789996216.810288:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0846266680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876946942201600:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789996217.704994:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789996218.730136:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789996219.752748:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789996220.393920:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e087f829180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876946942201728:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789996220.393986:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996220.394289:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942201728 00000100:00100000:0.0:1789996220.394298:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942201728 00000100:00100000:0.0:1789996220.394393:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789996220.394403:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0847554a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876946942201728:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789996220.394438:0:6691:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789996220.394487:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0847554a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876946942201728:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996220.394494:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:0.0:1789996220.394593:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e087f829180 x1876946942201728/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789996236 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789996220.394611:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e087f829180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876946942201728:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789996220.394850:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:0.0:1789996220.689769:0:9063:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg437-server.virtnet: executing yml_node 00000100:00100000:3.0:1789996220.717321:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1789996220.717365:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1789996220.717392:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1789996220.717417:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1789996220.717448:0:8222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927492096 00000100:00100000:3.0:1789996220.717457:0:8222:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927492096 00000100:00100000:3.0:1789996220.717510:0:8222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927492224 00000100:00100000:3.0:1789996220.717514:0:8222:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927492224 00000100:00100000:3.0:1789996220.717538:0:8222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 19 00000100:00100000:3.0:1789996220.717564:0:8222:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e087f82aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+5:2365:x1876946927492096:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:3.0:1789996220.717642:0:8222:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e087f82aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+5:2365:x1876946927492096:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 79us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996220.717650:0:8222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 19 00000100:00100000:3.0:1789996220.717674:0:8222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 20 00000100:00100000:3.0:1789996220.717680:0:8222:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e087f82bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+5:2365:x1876946927492224:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:3.0:1789996220.717706:0:8222:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e087f82bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+5:2365:x1876946927492224:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 26us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996220.717712:0:8222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 20 00000100:00100000:3.0:1789996220.717742:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927491968 00000100:00100000:3.0:1789996220.717746:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927491968 00000100:00100000:3.0:1789996220.717793:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 34 00000100:00100000:3.0:1789996220.717801:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e087f828380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+6:2365:x1876946927491968:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:3.0:1789996220.717830:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e087f828380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+6:2365:x1876946927491968:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 31us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996220.717836:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 34 00000100:00080000:3.0:1789996220.717856:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789996220.717860:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789996220.717862:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789996220.718035:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927491840 00000100:00100000:2.0:1789996220.718040:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927491840 00000100:00100000:2.0:1789996220.718085:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 192 00000100:00100000:2.0:1789996220.718093:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852bea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f78f7903-47ba-48a7-bb82-1f616cb85fc0+10:2365:x1876946927491840:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:2.0:1789996220.718126:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852bea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f78f7903-47ba-48a7-bb82-1f616cb85fc0+10:2365:x1876946927491840:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 33us (814us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996220.718132:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 192 00010000:00010000:1.0:1789996220.777686:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789996221.421606:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0846266680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e0c28cd8-555e-481f-bd03-c3b02aee51c5:3315:1876946942201856:0@lo:400:kworker.0 00000100:00100000:3.0:1789996221.421681:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996221.421682:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0846266a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1876946942202112:0@lo:400:kworker.0 00000100:00100000:2.0:1789996221.421741:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789996221.421754:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0846264000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1876946942202368:0@lo:400:kworker.0 00000100:00100000:3.0:1789996221.421782:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996221.421794:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789996221.421803:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789996221.421806:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0846265c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876946942202240:0@lo:400:kworker.0 00000100:00100000:3.0:1789996221.421812:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0846264380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876946942201984:0@lo:400:kworker.0 00000100:00100000:3.0:1789996221.421845:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996221.421851:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789996221.421865:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0846267800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876946942202496:0@lo:400:kworker.0 00000100:00100000:3.0:1789996221.421888:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996221.421919:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942202240 00000100:00100000:3.0:1789996221.421923:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942201856 00000100:00100000:2.0:1789996221.421928:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942202240 00000100:00100000:3.0:1789996221.421936:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942201856 00000100:00100000:3.0:1789996221.421982:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1789996221.421983:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942202496 00000100:00100000:2.0:1789996221.421989:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942202496 00000100:00100000:3.0:1789996221.421992:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852beb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0c28cd8-555e-481f-bd03-c3b02aee51c5+19:3315:x1876946942201856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789996221.422025:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789996221.422036:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0846265f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1876946942202240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789996221.422042:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852beb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0c28cd8-555e-481f-bd03-c3b02aee51c5+19:3315:x1876946942201856:12345-0@lo:400:kworker.0 Request processed in 52us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996221.422050:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:3.0:1789996221.422084:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942202368 00000100:00100000:3.0:1789996221.422089:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942202368 00000100:00100000:2.0:1789996221.422090:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0846265f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1876946942202240:12345-0@lo:400:kworker.0 Request processed in 54us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996221.422098:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789996221.422111:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942201984 00000100:00100000:1.0:1789996221.422112:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942202112 00000100:00100000:3.0:1789996221.422114:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942201984 00000100:00100000:2.0:1789996221.422119:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789996221.422122:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942202112 00000100:00100000:2.0:1789996221.422130:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e087f829180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1876946942202496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789996221.422136:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789996221.422145:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e087f82b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876946942202368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789996221.422165:0:5848:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1789996221.422170:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e087f829180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1876946942202496:12345-0@lo:400:kworker.0 Request processed in 42us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996221.422177:0:5848:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1789996221.422181:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789996221.422186:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e087f82b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876946942202368:12345-0@lo:400:kworker.0 Request processed in 40us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996221.422194:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789996221.422208:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789996221.422214:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e087f829c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876946942201984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789996221.422239:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e087f829c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876946942201984:12345-0@lo:400:kworker.0 Request processed in 25us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996221.422245:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789996221.422256:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789996221.422262:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0846264700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876946942202112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789996221.422284:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0846264700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876946942202112:12345-0@lo:400:kworker.0 Request processed in 22us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996221.422290:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:2.0:1789996221.422307:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e0846265c00 x1876946942202240/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789996237 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789996221.422320:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789996221.422325:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789996221.422338:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0846265c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876946942202240:0@lo:400:kworker.0 00000100:00100000:3.0:1789996221.422355:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0846264380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876946942201984:0@lo:400:kworker.0 00000100:00100000:2.0:1789996221.422361:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0846266a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1876946942202112:0@lo:400:kworker.0 00010000:00080000:3.0:1789996221.422372:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e0846267800 x1876946942202496/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789996237 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789996221.422382:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0846267800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876946942202496:0@lo:400:kworker.0 00000100:00100000:3.0:1789996221.422392:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0846264000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1876946942202368:0@lo:400:kworker.0 00000100:00100000:3.0:1789996221.422398:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0846266680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e0c28cd8-555e-481f-bd03-c3b02aee51c5:3315:1876946942201856:0@lo:400:kworker.0 00010000:00010000:2.0:1789996221.803037:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789996221.930117:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0846266a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876946942202624:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789996221.930274:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996221.931346:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942202624 00000100:00100000:0.0:1789996221.931355:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942202624 00000100:00100000:0.0:1789996221.931821:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789996221.931844:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0847554e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876946942202624:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789996221.931883:0:6691:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789996221.931950:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0847554e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876946942202624:12345-0@lo:13:osp-pre-1-0.0 Request processed in 120us (1678us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996221.931957:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:0.0:1789996221.932005:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e0846266a00 x1876946942202624/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789996237 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789996221.932027:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0846266a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876946942202624:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789996222.826432:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789996223.848735:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789996224.369463:0:9257:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.58.63 00010000:00010000:1.0:1789996224.873142:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789996225.513043:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789996225.513068:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e087f82ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876946942202752:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789996225.513137:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996225.513275:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942202752 00000100:00100000:1.0:1789996225.513283:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942202752 00000100:00100000:1.0:1789996225.513345:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789996225.513356:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0847557800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876946942202752:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789996225.513391:0:6691:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789996225.513441:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0847557800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876946942202752:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996225.513448:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:0.0:1789996225.513591:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e087f82ad80 x1876946942202752/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789996241 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789996225.513609:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e087f82ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876946942202752:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789996225.513688:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789996225.849526:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1789996225.849628:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1789996225.849687:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927492352 00000100:00100000:3.0:1789996225.849696:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1789996225.849697:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927492352 00000100:00100000:3.0:1789996225.849723:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927492608 00000100:00100000:3.0:1789996225.849727:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927492608 00000100:00100000:1.0:1789996225.849743:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 194 00000100:00100000:1.0:1789996225.849752:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852be9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f78f7903-47ba-48a7-bb82-1f616cb85fc0+10:2365:x1876946927492352:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:3.0:1789996225.849809:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 10 00000100:00100000:3.0:1789996225.849817:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fde9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+5:2361:x1876946927492608:12345-192.168.204.37@tcp:9:kworker.0 00000100:00100000:1.0:1789996225.849827:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852be9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f78f7903-47ba-48a7-bb82-1f616cb85fc0+10:2365:x1876946927492352:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 77us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996225.849834:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 194 00000020:00000080:3.0:1789996225.849842:0:6688:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4173739f0fc806c9 00000100:00080000:3.0:1789996225.849851:0:6688:0:(import.c:65:import_set_state_nolock()) ffff8e0876bb6800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789996225.849885:0:6688:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00080000:1.0:1789996225.849885:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789996225.849899:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789996225.850331:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fde9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+2:2361:x1876946927492608:12345-192.168.204.37@tcp:9:kworker.0 Request processed in 512us (631us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996225.850339:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 10 00000100:00100000:3.0:1789996225.850754:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996225.850831:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927492480 00000100:00100000:0.0:1789996225.850837:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927492480 00000100:00100000:2.0:1789996225.850868:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927492736 00000100:00100000:2.0:1789996225.850873:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927492736 00000100:00100000:0.0:1789996225.850893:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 38 00000100:00100000:2.0:1789996225.850896:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 11 00000100:00100000:0.0:1789996225.850901:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e087f82ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+6:2365:x1876946927492480:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:2.0:1789996225.850902:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fdeb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+5:2361:x1876946927492736:12345-192.168.204.37@tcp:9:kworker.0 00000020:00000080:2.0:1789996225.850924:0:6690:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4173739f0fc806d0 00000100:00080000:2.0:1789996225.850932:0:6690:0:(import.c:65:import_set_state_nolock()) ffff8e07427d9800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1789996225.850935:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e087f82ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+6:2365:x1876946927492480:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 35us (1319us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996225.850942:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 38 00000001:00000004:2.0:1789996225.850956:0:6690:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1789996225.851292:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fdeb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+2:2361:x1876946927492736:12345-192.168.204.37@tcp:9:kworker.0 Request processed in 388us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996225.851299:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 11 00000100:00080000:0.0:1789996225.851801:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789996225.851807:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789996225.852052:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789996225.897804:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789996226.536844:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0741834a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e0c28cd8-555e-481f-bd03-c3b02aee51c5:3315:1876946942202880:0@lo:400:kworker.0 00000100:00100000:0.0:1789996226.536922:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996226.537074:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942202880 00000100:00100000:2.0:1789996226.537083:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942202880 00000100:00100000:2.0:1789996226.537130:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1789996226.537139:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852bea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0c28cd8-555e-481f-bd03-c3b02aee51c5+19:3315:x1876946942202880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789996226.539594:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852bea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0c28cd8-555e-481f-bd03-c3b02aee51c5+19:3315:x1876946942202880:12345-0@lo:400:kworker.0 Request processed in 2447us (2662us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996226.539618:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1789996226.544790:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0741836680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3316:1876946942203008:0@lo:400:kworker.0 00000100:00100000:1.0:1789996226.544910:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996226.544954:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0741835c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876946942203520:0@lo:400:kworker.0 00000100:00100000:1.0:1789996226.544979:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996226.545003:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789996226.545007:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0741836300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3316:1876946942203392:0@lo:400:kworker.0 00000100:00100000:1.0:1789996226.545028:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996226.545061:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0741834000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876946942203264:0@lo:400:kworker.0 00000100:00100000:1.0:1789996226.545085:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996226.545104:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789996226.545110:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0741835880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3314:1876946942203136:0@lo:400:kworker.0 00000100:00100000:1.0:1789996226.545131:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996226.545162:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942203008 00000100:00100000:1.0:1789996226.545169:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942203008 00000100:00100000:1.0:1789996226.545217:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942203392 00000100:00100000:1.0:1789996226.545220:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942203392 00000100:00100000:1.0:1789996226.545246:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942203136 00000100:00100000:1.0:1789996226.545249:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942203136 00000100:00100000:1.0:1789996226.545264:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789996226.545272:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0741837100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1876946942203008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789996226.545323:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0741837100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1876946942203008:12345-0@lo:400:kworker.0 Request processed in 51us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996226.545331:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789996226.545348:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789996226.545354:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0741834380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1876946942203392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789996226.545380:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0741834380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1876946942203392:12345-0@lo:400:kworker.0 Request processed in 27us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996226.545386:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789996226.545397:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789996226.545417:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0741835180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876946942203136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789996226.545447:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0741835180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876946942203136:12345-0@lo:400:kworker.0 Request processed in 32us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996226.545453:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789996226.545470:0:8222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942203520 00000100:00100000:1.0:1789996226.545473:0:8222:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942203520 00000100:00100000:1.0:1789996226.545496:0:8222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942203264 00000100:00100000:0.0:1789996226.545727:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0741834a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e0c28cd8-555e-481f-bd03-c3b02aee51c5:3315:1876946942202880:0@lo:400:kworker.0 00000100:00100000:1.0:1789996226.545807:0:8222:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942203264 00000100:00100000:1.0:1789996226.545841:0:8222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789996226.545848:0:8222:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0741837b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3316:x1876946942203520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789996226.545881:0:8222:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0741837b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3316:x1876946942203520:12345-0@lo:400:kworker.0 Request processed in 34us (900us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996226.545887:0:8222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789996226.545898:0:8222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789996226.545904:0:8222:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0741836a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1876946942203264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789996226.545929:0:8222:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0741836a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1876946942203264:12345-0@lo:400:kworker.0 Request processed in 25us (843us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996226.545935:0:8222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:1.0:1789996226.545964:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789996226.545969:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789996226.545990:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0741835880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3314:1876946942203136:0@lo:400:kworker.0 00010000:00080000:1.0:1789996226.546001:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e0741834000 x1876946942203264/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789996242 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789996226.546011:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0741834000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876946942203264:0@lo:400:kworker.0 00000100:00100000:1.0:1789996226.546031:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0741836300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3316:1876946942203392:0@lo:400:kworker.0 00000100:00100000:1.0:1789996226.546049:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0741836680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3316:1876946942203008:0@lo:400:kworker.0 00010000:00080000:1.0:1789996226.546057:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e0741835c00 x1876946942203520/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789996242 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789996226.546066:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0741835c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876946942203520:0@lo:400:kworker.0 00000001:02000400:0.0:1789996226.654278:0:9354:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.58.63 00010000:00010000:3.0:1789996226.925295:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789996227.055158:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fdebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876946942203648:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789996227.055260:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789996227.055347:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942203648 00000100:00100000:3.0:1789996227.055371:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942203648 00000100:00100000:3.0:1789996227.055431:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789996227.055442:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fde8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876946942203648:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789996227.055479:0:6691:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789996227.055651:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fde8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876946942203648:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996227.055661:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:3.0:1789996227.055704:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e086fdebb80 x1876946942203648/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789996243 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789996227.055723:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fdebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876946942203648:0@lo:13:osp-pre-1-0.0 00000001:00100000:0.0:1789996227.133283:0:7659:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 189efa8a-c7eb-4b69-9afa-1dd36d6775f1 00000020:00000080:0.0:1789996227.133298:0:7659:0:(genops.c:885:class_export_put()) final put ffff8e07427dc800/189efa8a-c7eb-4b69-9afa-1dd36d6775f1 00000020:00000080:3.0:1789996227.133852:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8e07427dc800/189efa8a-c7eb-4b69-9afa-1dd36d6775f1 for lustre-OST0001 00000020:00000080:3.0:1789996227.133910:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e07427d9800 for lustre-OST0001 00000001:00100000:2.0:1789996227.145187:0:6715:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 189efa8a-c7eb-4b69-9afa-1dd36d6775f1 00000020:00000080:2.0:1789996227.145199:0:6715:0:(genops.c:885:class_export_put()) final put ffff8e0876bb0000/189efa8a-c7eb-4b69-9afa-1dd36d6775f1 00000020:00000080:0.0:1789996227.145272:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8e0876bb0000/189efa8a-c7eb-4b69-9afa-1dd36d6775f1 for lustre-OST0000 00000020:00000080:0.0:1789996227.145330:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e0876bb6800 for lustre-OST0000 00010000:00010000:1.0:1789996227.950474:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789996228.969053:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789996229.132913:0:9454:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.58.63 00010000:00010000:1.0:1789996229.992719:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789996230.632777:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789996230.637899:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0847557b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876946942203776:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789996230.637979:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789996230.638190:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942203776 00000100:00100000:3.0:1789996230.638199:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942203776 00000100:00100000:3.0:1789996230.638267:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789996230.638278:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0846265c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876946942203776:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789996230.638317:0:6691:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789996230.638365:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0846265c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876946942203776:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996230.638372:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:3.0:1789996230.638409:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e0847557b80 x1876946942203776/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789996246 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789996230.638428:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0847557b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876946942203776:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789996230.638497:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:2.0:1789996230.718059:0:9502:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Mon Sep 21 09:10:29 EDT 2026 00000100:00100000:2.0:1789996230.960755:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996230.960802:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1789996230.960992:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927492864 00000100:00100000:1.0:1789996230.961002:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927492864 00000100:00100000:1.0:1789996230.961062:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 196 00000100:00100000:1.0:1789996230.961074:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852be8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f78f7903-47ba-48a7-bb82-1f616cb85fc0+10:2363:x1876946927492864:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:1.0:1789996230.961145:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852be8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f78f7903-47ba-48a7-bb82-1f616cb85fc0+10:2363:x1876946927492864:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 74us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996230.961153:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 196 00000100:00100000:3.0:1789996230.962585:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927492992 00000100:00100000:3.0:1789996230.962597:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927492992 00000100:00100000:3.0:1789996230.962676:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 42 00000100:00100000:3.0:1789996230.962685:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0846266d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+6:2363:x1876946927492992:12345-192.168.204.37@tcp:400:kworker.0 00000100:00080000:0.0:1789996230.962699:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789996230.962745:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0846266d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+6:2363:x1876946927492992:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 61us (1943us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996230.962752:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 42 00010000:00010000:3.0:1789996231.017002:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789996231.656978:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0846266680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1876946942204160:0@lo:400:kworker.0 00000100:00100000:2.0:1789996231.657048:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996231.657104:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789996231.657110:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0846264000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876946942204288:0@lo:400:kworker.0 00000100:00100000:2.0:1789996231.657133:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996231.657179:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0846266a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3316:1876946942204032:0@lo:400:kworker.0 00000100:00100000:2.0:1789996231.657186:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942204160 00000100:00100000:2.0:1789996231.657193:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942204160 00000100:00100000:1.0:1789996231.657206:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996231.657222:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0846264380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876946942204544:0@lo:400:kworker.0 00000100:00100000:1.0:1789996231.657241:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996231.657246:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942204032 00000100:00100000:2.0:1789996231.657249:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942204032 00000100:00100000:1.0:1789996231.657262:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1789996231.657267:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0846265500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e0c28cd8-555e-481f-bd03-c3b02aee51c5:3316:1876946942203904:0@lo:400:kworker.0 00000100:00100000:2.0:1789996231.657270:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789996231.657279:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0849c74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876946942204160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789996231.657290:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996231.657307:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0846267800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3316:1876946942204416:0@lo:400:kworker.0 00000100:00100000:2.0:1789996231.657325:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0849c74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876946942204160:12345-0@lo:400:kworker.0 Request processed in 47us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996231.657325:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996231.657332:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789996231.657347:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942204416 00000100:00100000:2.0:1789996231.657350:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942204416 00000100:00100000:1.0:1789996231.657350:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789996231.657357:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0741835c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1876946942204032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789996231.657364:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789996231.657368:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0741836300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1876946942204416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789996231.657389:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0741836300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1876946942204416:12345-0@lo:400:kworker.0 Request processed in 20us (63us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996231.657389:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0741835c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1876946942204032:12345-0@lo:400:kworker.0 Request processed in 33us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996231.657396:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789996231.657414:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942204288 00000100:00100000:1.0:1789996231.657418:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942204288 00000100:00100000:1.0:1789996231.657458:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942204544 00000100:00100000:1.0:1789996231.657474:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942204544 00000100:00100000:1.0:1789996231.657498:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789996231.657514:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0849c75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1876946942204288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789996231.657563:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0849c75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1876946942204288:12345-0@lo:400:kworker.0 Request processed in 60us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996231.657569:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789996231.657595:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789996231.657602:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0741836680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1876946942204544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789996231.657706:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0741836680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1876946942204544:12345-0@lo:400:kworker.0 Request processed in 104us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996231.657713:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789996231.657731:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942203904 00000100:00100000:1.0:1789996231.657735:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942203904 00000100:00100000:2.0:1789996231.657755:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789996231.657764:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1789996231.657770:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852be8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+19:3316:x1876946942203904:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1789996231.657775:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789996231.657785:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789996231.657797:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852be8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+19:3316:x1876946942203904:12345-0@lo:400:kworker.0 Request processed in 28us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996231.657802:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00010000:00080000:2.0:1789996231.657814:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e0846264000 x1876946942204288/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789996247 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789996231.657828:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0846264000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876946942204288:0@lo:400:kworker.0 00000100:00100000:1.0:1789996231.657834:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0846265500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e0c28cd8-555e-481f-bd03-c3b02aee51c5:3316:1876946942203904:0@lo:400:kworker.0 00000100:00100000:2.0:1789996231.657838:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0846266680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1876946942204160:0@lo:400:kworker.0 00000100:00100000:1.0:1789996231.657850:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0846267800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3316:1876946942204416:0@lo:400:kworker.0 00000100:00100000:1.0:1789996231.657857:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0846266a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3316:1876946942204032:0@lo:400:kworker.0 00010000:00080000:1.0:1789996231.657865:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e0846264380 x1876946942204544/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789996247 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789996231.657874:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0846264380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876946942204544:0@lo:400:kworker.0 00010000:00010000:2.0:1789996232.042816:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789996232.168720:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fdebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876946942204672:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789996232.168806:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789996232.168935:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942204672 00000100:00100000:3.0:1789996232.168943:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942204672 00000100:00100000:3.0:1789996232.168992:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789996232.169001:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0741834000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876946942204672:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789996232.169034:0:6691:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789996232.172969:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0741834000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876946942204672:12345-0@lo:13:osp-pre-1-0.0 Request processed in 3959us (4153us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996232.172985:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:1.0:1789996232.175535:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e086fdebb80 x1876946942204672/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789996248 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789996232.175970:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fdebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876946942204672:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789996233.065025:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789996234.088799:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789996235.112782:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789996235.752977:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0847557100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876946942204800:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789996235.753055:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996235.753246:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942204800 00000100:00100000:2.0:1789996235.753255:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942204800 00000100:00100000:2.0:1789996235.753317:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789996235.753328:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fdeaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876946942204800:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789996235.753365:0:6692:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789996235.753524:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fdeaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876946942204800:12345-0@lo:13:osp-pre-0-0.0 Request processed in 198us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996235.753531:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:0.0:1789996235.753783:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789996235.757922:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e0847557100 x1876946942204800/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789996251 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789996235.757956:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0847557100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876946942204800:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789996236.080519:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996236.080600:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927493120 00000100:00100000:0.0:1789996236.080610:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927493120 00000100:00100000:2.0:1789996236.080655:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996236.080667:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 198 00000100:00100000:0.0:1789996236.080680:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852ba5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f78f7903-47ba-48a7-bb82-1f616cb85fc0+10:2365:x1876946927493120:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:2.0:1789996236.080687:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927493248 00000100:00100000:2.0:1789996236.080693:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927493248 00000100:00100000:2.0:1789996236.080739:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 46 00000100:00100000:2.0:1789996236.080748:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0849c74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+6:2365:x1876946927493248:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:0.0:1789996236.080756:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852ba5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f78f7903-47ba-48a7-bb82-1f616cb85fc0+10:2365:x1876946927493120:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 77us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996236.080765:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 198 00000100:00100000:2.0:1789996236.080783:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0849c74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+6:2365:x1876946927493248:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 37us (139us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996236.080790:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 46 00000100:00080000:2.0:1789996236.080810:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789996236.138081:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789996236.779460:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fdead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876946942205312:0@lo:400:kworker.0 00000100:00100000:2.0:1789996236.779701:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fde9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1876946942205184:0@lo:400:kworker.0 00000100:00100000:2.0:1789996236.779736:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996236.779838:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942205184 00000100:00100000:2.0:1789996236.779847:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942205184 00000100:00100000:2.0:1789996236.779909:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789996236.779919:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0849c75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876946942205184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789996236.779972:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0849c75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876946942205184:12345-0@lo:400:kworker.0 Request processed in 53us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996236.779979:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:2.0:1789996236.780001:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789996236.780033:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fde9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1876946942205184:0@lo:400:kworker.0 00000100:00100000:3.0:1789996236.780186:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996236.780268:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942205312 00000100:00100000:2.0:1789996236.780273:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942205312 00000100:00100000:2.0:1789996236.780336:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789996236.780344:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fdeb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1876946942205312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789996236.780383:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fdeb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1876946942205312:12345-0@lo:400:kworker.0 Request processed in 40us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996236.780389:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789996236.780482:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fde9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e0c28cd8-555e-481f-bd03-c3b02aee51c5:3315:1876946942204928:0@lo:400:kworker.0 00000100:00100000:0.0:1789996236.780518:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996236.780779:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fde9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1876946942205440:0@lo:400:kworker.0 00000100:00100000:0.0:1789996236.780805:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996236.780827:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1789996236.780835:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fdeb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876946942205056:0@lo:400:kworker.0 00000100:00100000:0.0:1789996236.780860:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996236.780878:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fde8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876946942205568:0@lo:400:kworker.0 00000100:00100000:0.0:1789996236.780898:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996236.780921:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942205440 00000100:00100000:0.0:1789996236.780925:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942205440 00000100:00100000:0.0:1789996236.780955:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942205056 00000100:00100000:0.0:1789996236.780958:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942205056 00000100:00100000:0.0:1789996236.780975:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789996236.780981:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0847554700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876946942205440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789996236.781015:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0847554700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876946942205440:12345-0@lo:400:kworker.0 Request processed in 34us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996236.781022:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789996236.781035:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789996236.781041:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0847555f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876946942205056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789996236.781067:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0847555f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876946942205056:12345-0@lo:400:kworker.0 Request processed in 27us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996236.781073:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789996236.781093:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942205568 00000100:00100000:0.0:1789996236.781096:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942205568 00000100:00100000:0.0:1789996236.781120:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789996236.781126:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0847556d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1876946942205568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789996236.781155:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0847556d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1876946942205568:12345-0@lo:400:kworker.0 Request processed in 28us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996236.781171:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:0.0:1789996236.781194:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789996236.781198:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789996236.781222:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fdeb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876946942205056:0@lo:400:kworker.0 00010000:00080000:0.0:1789996236.781235:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e086fde8700 x1876946942205568/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789996252 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789996236.781246:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fde8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876946942205568:0@lo:400:kworker.0 00000100:00100000:0.0:1789996236.781254:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fde9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1876946942205440:0@lo:400:kworker.0 00000100:00100000:2.0:1789996236.781983:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942204928 00000100:00100000:2.0:1789996236.781991:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942204928 00000100:00100000:2.0:1789996236.782032:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1789996236.782040:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852ba4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0c28cd8-555e-481f-bd03-c3b02aee51c5+19:3315:x1876946942204928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789996236.782086:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852ba4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0c28cd8-555e-481f-bd03-c3b02aee51c5+19:3315:x1876946942204928:12345-0@lo:400:kworker.0 Request processed in 48us (1567us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996236.782092:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00010000:00080000:3.0:1789996236.782196:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e086fdead80 x1876946942205312/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789996252 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789996236.782210:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fdead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876946942205312:0@lo:400:kworker.0 00000100:00100000:0.0:1789996236.782292:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fde9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e0c28cd8-555e-481f-bd03-c3b02aee51c5:3315:1876946942204928:0@lo:400:kworker.0 00010000:00010000:3.0:1789996237.161807:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789996237.292801:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789996237.292826:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0849c74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876946942205696:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789996237.292915:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996237.293001:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942205696 00000100:00100000:2.0:1789996237.293010:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942205696 00000100:00100000:2.0:1789996237.293054:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789996237.293073:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0849c77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876946942205696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789996237.293106:0:6692:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789996237.293148:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0849c77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876946942205696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996237.293154:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:2.0:1789996237.293190:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e0849c74a80 x1876946942205696/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789996253 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789996237.293207:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0849c74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876946942205696:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789996238.185348:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789996239.211559:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789996240.237683:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789996240.873018:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0741835880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876946942205824:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789996240.873090:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996240.873176:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942205824 00000100:00100000:2.0:1789996240.873184:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942205824 00000100:00100000:2.0:1789996240.873239:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789996240.873249:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0849c74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876946942205824:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789996240.873924:0:6692:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789996240.873987:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0849c74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876946942205824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 738us (895us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996240.873996:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:2.0:1789996240.874023:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789996240.874277:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e0741835880 x1876946942205824/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789996256 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789996240.874312:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0741835880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876946942205824:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789996241.210685:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996241.210766:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1789996241.210833:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927493504 00000100:00100000:3.0:1789996241.210844:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927493504 00000100:00100000:3.0:1789996241.210956:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 50 00000100:00100000:3.0:1789996241.210968:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0847555500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+6:2365:x1876946927493504:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:3.0:1789996241.211041:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0847555500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+6:2365:x1876946927493504:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 75us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996241.211048:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 50 00000100:00080000:0.0:1789996241.211512:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789996241.215249:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927493376 00000100:00100000:1.0:1789996241.215264:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927493376 00000100:00100000:1.0:1789996241.215378:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 200 00000100:00100000:1.0:1789996241.215389:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852ba7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f78f7903-47ba-48a7-bb82-1f616cb85fc0+10:2365:x1876946927493376:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:1.0:1789996241.215475:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852ba7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f78f7903-47ba-48a7-bb82-1f616cb85fc0+10:2365:x1876946927493376:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 89us (4800us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996241.215483:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 200 00010000:00010000:3.0:1789996241.258357:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789996241.899426:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0741837480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e0c28cd8-555e-481f-bd03-c3b02aee51c5:3315:1876946942205952:0@lo:400:kworker.0 00000100:00100000:2.0:1789996241.899959:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996241.900027:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0741835880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1876946942206464:0@lo:400:kworker.0 00000100:00100000:2.0:1789996241.900071:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996241.900100:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789996241.900214:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0741835500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876946942206080:0@lo:400:kworker.0 00000100:00100000:2.0:1789996241.900241:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996241.900261:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0741834a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876946942206592:0@lo:400:kworker.0 00000100:00100000:2.0:1789996241.900283:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996241.900324:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942205952 00000100:00100000:2.0:1789996241.900332:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942205952 00000100:00100000:2.0:1789996241.900372:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1789996241.900381:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852ba6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0c28cd8-555e-481f-bd03-c3b02aee51c5+19:3315:x1876946942205952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789996241.900428:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852ba6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0c28cd8-555e-481f-bd03-c3b02aee51c5+19:3315:x1876946942205952:12345-0@lo:400:kworker.0 Request processed in 48us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996241.900436:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1789996241.900480:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942206464 00000100:00100000:2.0:1789996241.900485:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942206464 00000100:00100000:2.0:1789996241.900521:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942206080 00000100:00100000:2.0:1789996241.900525:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942206080 00000100:00100000:2.0:1789996241.900567:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789996241.900575:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0849c74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876946942206464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789996241.900607:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0849c74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876946942206464:12345-0@lo:400:kworker.0 Request processed in 33us (535us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996241.900613:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789996241.900625:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789996241.900631:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0846264380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876946942206080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789996241.900673:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0846264380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876946942206080:12345-0@lo:400:kworker.0 Request processed in 42us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996241.900690:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789996241.900711:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942206592 00000100:00100000:2.0:1789996241.900715:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942206592 00000100:00100000:2.0:1789996241.900744:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789996241.900751:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0846266a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1876946942206592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789996241.900783:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0846266a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1876946942206592:12345-0@lo:400:kworker.0 Request processed in 33us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996241.900789:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:2.0:1789996241.900804:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789996241.900809:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789996241.900933:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0741835500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876946942206080:0@lo:400:kworker.0 00010000:00080000:2.0:1789996241.900949:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e0741834a80 x1876946942206592/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789996257 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789996241.900959:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0741834a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876946942206592:0@lo:400:kworker.0 00000100:00100000:2.0:1789996241.900967:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0741835880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1876946942206464:0@lo:400:kworker.0 00000100:00100000:2.0:1789996241.900974:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0741837480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e0c28cd8-555e-481f-bd03-c3b02aee51c5:3315:1876946942205952:0@lo:400:kworker.0 00000100:00100000:1.0:1789996241.901404:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0741836d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1876946942206208:0@lo:400:kworker.0 00000100:00100000:1.0:1789996241.901443:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996241.901537:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789996241.901563:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0741835f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876946942206336:0@lo:400:kworker.0 00000100:00100000:3.0:1789996241.901570:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942206208 00000100:00100000:3.0:1789996241.901575:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942206208 00000100:00100000:1.0:1789996241.901590:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789996241.901608:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789996241.901615:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0741834700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876946942206208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789996241.901621:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942206336 00000100:00100000:1.0:1789996241.901624:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942206336 00000100:00100000:3.0:1789996241.901653:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0741834700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876946942206208:12345-0@lo:400:kworker.0 Request processed in 39us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996241.901659:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:3.0:1789996241.901677:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789996241.901927:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789996241.901938:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0741837480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1876946942206336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789996241.901972:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0741837480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1876946942206336:12345-0@lo:400:kworker.0 Request processed in 36us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996241.901978:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:1.0:1789996241.902010:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e0741835f80 x1876946942206336/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789996257 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789996241.902022:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0741835f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876946942206336:0@lo:400:kworker.0 00000100:00100000:1.0:1789996241.902030:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0741836d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1876946942206208:0@lo:400:kworker.0 00010000:00010000:0.0:1789996242.280818:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789996242.424366:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fdead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876946942206720:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789996242.424437:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789996242.424678:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942206720 00000100:00100000:3.0:1789996242.424686:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942206720 00000100:00100000:3.0:1789996242.424750:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789996242.424762:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0847557480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876946942206720:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789996242.424796:0:6691:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789996242.429580:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0847557480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876946942206720:12345-0@lo:13:osp-pre-1-0.0 Request processed in 4810us (5132us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996242.429596:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:0.0:1789996242.430721:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e086fdead80 x1876946942206720/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789996258 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789996242.430750:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fdead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876946942206720:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789996243.304702:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789996244.331149:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789996245.352973:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789996245.997578:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0741836d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876946942206848:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789996245.997659:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996245.997972:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942206848 00000100:00100000:1.0:1789996245.997982:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942206848 00000100:00100000:1.0:1789996245.998042:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789996245.998052:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fde8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876946942206848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789996245.998089:0:6691:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789996245.998149:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fde8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876946942206848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996245.998157:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:3.0:1789996245.998279:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789996245.998327:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e0741836d80 x1876946942206848/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789996261 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789996245.998347:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0741836d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876946942206848:0@lo:13:osp-pre-0-0.0 00000001:02000400:2.0:1789996246.263604:0:10134:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 09:10:45 (1789996245) === 00000100:00100000:0.0:1789996246.317771:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996246.317822:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1789996246.317882:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927493632 00000100:00100000:1.0:1789996246.317894:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927493632 00000100:00100000:1.0:1789996246.317950:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 202 00000100:00100000:1.0:1789996246.317972:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852ba7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f78f7903-47ba-48a7-bb82-1f616cb85fc0+10:2364:x1876946927493632:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:1.0:1789996246.318044:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852ba7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f78f7903-47ba-48a7-bb82-1f616cb85fc0+10:2364:x1876946927493632:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 73us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996246.318052:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 202 00000100:00100000:3.0:1789996246.318427:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927493760 00000100:00100000:3.0:1789996246.318434:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927493760 00000100:00080000:0.0:1789996246.318481:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789996246.318504:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 54 00000100:00100000:3.0:1789996246.318514:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0847555180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+6:2364:x1876946927493760:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:3.0:1789996246.318647:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0847555180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+6:2364:x1876946927493760:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 61us (812us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996246.318655:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 54 00010000:00010000:2.0:1789996246.376749:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789996246.652138:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1789996246.652234:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927493888 00000100:00100000:3.0:1789996246.652244:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927493888 00000100:00100000:3.0:1789996246.652312:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 203 00000100:00100000:3.0:1789996246.652321:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852ba7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f78f7903-47ba-48a7-bb82-1f616cb85fc0+10:8125:x1876946927493888:12345-192.168.204.37@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789996246.652338:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789996246.652356:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e087f857400/0x4173739f0fc80794 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b97003095e3542f expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996246.652385:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e087f857400/0x4173739f0fc80794 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e3542f expref: 11 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996246.652397:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e087f857400/0x4173739f0fc80794 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e3542f expref: 11 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996246.652420:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e087f857400, rc 0) 00000100:00100000:3.0:1789996246.652491:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852ba7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f78f7903-47ba-48a7-bb82-1f616cb85fc0+11:8125:x1876946927493888:12345-192.168.204.37@tcp:101:mount.lustre.0 Request processed in 170us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996246.652498:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 203 00000100:00100000:0.0:1789996246.655519:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996246.655778:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927494016 00000100:00100000:2.0:1789996246.655789:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927494016 00000100:00100000:2.0:1789996246.655847:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 204 00000100:00100000:2.0:1789996246.655857:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852ba5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f78f7903-47ba-48a7-bb82-1f616cb85fc0+11:8125:x1876946927494016:12345-192.168.204.37@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789996246.656944:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852ba5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f78f7903-47ba-48a7-bb82-1f616cb85fc0+11:8125:x1876946927494016:12345-192.168.204.37@tcp:501:mount.lustre.0 Request processed in 1082us (1431us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996246.656967:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 204 00000100:00100000:1.0:1789996246.660468:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1789996246.660539:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927494144 00000100:00100000:3.0:1789996246.660644:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927494144 00000100:00100000:3.0:1789996246.660744:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 205 00000100:00100000:3.0:1789996246.660755:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852ba6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f78f7903-47ba-48a7-bb82-1f616cb85fc0+11:8125:x1876946927494144:12345-192.168.204.37@tcp:503:mount.lustre.0 00000100:00100000:3.0:1789996246.660987:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852ba6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f78f7903-47ba-48a7-bb82-1f616cb85fc0+11:8125:x1876946927494144:12345-192.168.204.37@tcp:503:mount.lustre.0 Request processed in 234us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996246.660995:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 205 00000100:00100000:0.0:1789996246.665721:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996246.669084:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927494272 00000100:00100000:2.0:1789996246.669102:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927494272 00000100:00100000:2.0:1789996246.669187:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 206 00000100:00100000:2.0:1789996246.669198:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852ba4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f78f7903-47ba-48a7-bb82-1f616cb85fc0+11:8129:x1876946927494272:12345-192.168.204.37@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789996246.669512:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852ba4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f78f7903-47ba-48a7-bb82-1f616cb85fc0+11:8129:x1876946927494272:12345-192.168.204.37@tcp:502:llog_process_th.0 Request processed in 315us (3801us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996246.669519:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 206 00000100:00100000:0.0:1789996246.695891:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1789996246.695977:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927494400 00000100:00100000:3.0:1789996246.695989:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927494400 00000100:00100000:3.0:1789996246.696044:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 207 00000100:00100000:3.0:1789996246.696056:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852ba4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f78f7903-47ba-48a7-bb82-1f616cb85fc0+11:8129:x1876946927494400:12345-192.168.204.37@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789996246.696647:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852ba4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f78f7903-47ba-48a7-bb82-1f616cb85fc0+11:8129:x1876946927494400:12345-192.168.204.37@tcp:502:llog_process_th.0 Request processed in 487us (660us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996246.696656:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 207 00000100:00100000:3.0:1789996246.704592:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1789996246.704754:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927494528 00000100:00100000:1.0:1789996246.704765:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927494528 00000100:00100000:1.0:1789996246.704824:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 208 00000100:00100000:1.0:1789996246.704835:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852ba6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f78f7903-47ba-48a7-bb82-1f616cb85fc0+11:8125:x1876946927494528:12345-192.168.204.37@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789996246.704852:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789996246.704870:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e0876a23000/0x4173739f0fc8079b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b97003095e35459 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996246.704899:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e0876a23000/0x4173739f0fc8079b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35459 expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996246.704911:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e0876a23000/0x4173739f0fc8079b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35459 expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996246.704921:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e0876a23000, rc 0) 00000100:00100000:1.0:1789996246.704969:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852ba6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f78f7903-47ba-48a7-bb82-1f616cb85fc0+12:8125:x1876946927494528:12345-192.168.204.37@tcp:101:mount.lustre.0 Request processed in 135us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996246.704976:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 208 00000100:00100000:0.0:1789996246.713980:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1789996246.714071:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927494656 00000100:00100000:3.0:1789996246.714083:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927494656 00000100:00100000:3.0:1789996246.714157:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 209 00000100:00100000:3.0:1789996246.714168:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852ba6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f78f7903-47ba-48a7-bb82-1f616cb85fc0+12:8125:x1876946927494656:12345-192.168.204.37@tcp:256:mount.lustre.0 20000000:01000000:3.0:1789996246.714195:0:5840:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1789996246.714238:0:5840:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1789996246.714242:0:5840:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1789996246.714246:0:5840:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1789996246.714248:0:5840:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:3.0:1789996246.715773:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852ba6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f78f7903-47ba-48a7-bb82-1f616cb85fc0+12:8125:x1876946927494656:12345-192.168.204.37@tcp:256:mount.lustre.0 Request processed in 1597us (1794us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996246.715786:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 209 00000100:00100000:0.0:1789996246.722808:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996246.722899:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927494784 00000100:00100000:2.0:1789996246.722910:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927494784 00000100:00100000:2.0:1789996246.722966:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 210 00000100:00100000:2.0:1789996246.722976:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852ba4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f78f7903-47ba-48a7-bb82-1f616cb85fc0+12:8125:x1876946927494784:12345-192.168.204.37@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789996246.722992:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789996246.723014:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e0842de5a00/0x4173739f0fc807a2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b97003095e35460 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996246.723044:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e0842de5a00/0x4173739f0fc807a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35460 expref: 13 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996246.723056:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e0842de5a00/0x4173739f0fc807a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35460 expref: 13 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996246.723064:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e0842de5a00, rc 0) 00000100:00100000:2.0:1789996246.723129:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852ba4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f78f7903-47ba-48a7-bb82-1f616cb85fc0+13:8125:x1876946927494784:12345-192.168.204.37@tcp:101:mount.lustre.0 Request processed in 155us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996246.723136:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 210 00000100:00100000:0.0:1789996246.725063:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1789996246.725150:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927494912 00000100:00100000:3.0:1789996246.725158:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927494912 00000100:00100000:3.0:1789996246.725205:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 211 00000100:00100000:3.0:1789996246.725224:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852ba7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f78f7903-47ba-48a7-bb82-1f616cb85fc0+13:8125:x1876946927494912:12345-192.168.204.37@tcp:501:mount.lustre.0 00000100:00100000:3.0:1789996246.725505:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852ba7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f78f7903-47ba-48a7-bb82-1f616cb85fc0+13:8125:x1876946927494912:12345-192.168.204.37@tcp:501:mount.lustre.0 Request processed in 282us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996246.725512:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 211 00000100:00100000:0.0:1789996246.730200:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1789996246.730371:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927495040 00000100:00100000:1.0:1789996246.730381:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927495040 00000100:00100000:1.0:1789996246.730437:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 212 00000100:00100000:1.0:1789996246.730447:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852ba5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f78f7903-47ba-48a7-bb82-1f616cb85fc0+13:8125:x1876946927495040:12345-192.168.204.37@tcp:503:mount.lustre.0 00000100:00100000:1.0:1789996246.730720:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852ba5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f78f7903-47ba-48a7-bb82-1f616cb85fc0+13:8125:x1876946927495040:12345-192.168.204.37@tcp:503:mount.lustre.0 Request processed in 274us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996246.730728:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 212 00000100:00100000:0.0:1789996246.734808:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996246.734905:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927495168 00000100:00100000:2.0:1789996246.734915:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927495168 00000100:00100000:2.0:1789996246.734973:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 213 00000100:00100000:2.0:1789996246.734982:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852ba5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f78f7903-47ba-48a7-bb82-1f616cb85fc0+13:8134:x1876946927495168:12345-192.168.204.37@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789996246.735249:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852ba5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f78f7903-47ba-48a7-bb82-1f616cb85fc0+13:8134:x1876946927495168:12345-192.168.204.37@tcp:502:llog_process_th.0 Request processed in 267us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996246.735261:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 213 00000100:00100000:0.0:1789996246.739892:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1789996246.740015:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927495296 00000100:00100000:3.0:1789996246.740025:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927495296 00000100:00100000:3.0:1789996246.740081:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 214 00000100:00100000:3.0:1789996246.740091:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852ba0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f78f7903-47ba-48a7-bb82-1f616cb85fc0+13:8134:x1876946927495296:12345-192.168.204.37@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789996246.740883:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852ba0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f78f7903-47ba-48a7-bb82-1f616cb85fc0+13:8134:x1876946927495296:12345-192.168.204.37@tcp:502:llog_process_th.0 Request processed in 790us (998us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996246.740892:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 214 00000100:00100000:0.0:1789996246.745701:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996246.745742:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1789996246.745860:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927495424 00000100:00100000:3.0:1789996246.745870:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927495424 00000100:00100000:3.0:1789996246.745913:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927495680 00000100:00100000:3.0:1789996246.745916:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927495680 00000100:00100000:3.0:1789996246.745949:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 55 00000100:00100000:3.0:1789996246.745959:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0847556a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+6:2365:x1876946927495680:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:3.0:1789996246.746036:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0847556a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+6:2365:x1876946927495680:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 78us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996246.746044:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 55 00000100:00100000:3.0:1789996246.746063:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 10 00000100:00100000:3.0:1789996246.746068:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0847554380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2361:x1876946927495424:12345-192.168.204.37@tcp:38:mount.lustre.0 00010000:00080000:3.0:1789996246.746091:0:5847:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from cfc759a1-09a6-40ba-80a8-7399de51b555@192.168.204.37@tcp t0 exp 0000000000000000 cur 288 last 0 00000020:00000080:3.0:1789996246.746129:0:5847:0:(genops.c:1384:class_connect()) connect: client cfc759a1-09a6-40ba-80a8-7399de51b555, cookie 0x4173739f0fc807a9 00000004:00100000:3.0:1789996246.746179:0:5847:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1789996246.746461:0:5847:0:(import.c:65:import_set_state_nolock()) ffff8e086fde4800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789996246.746493:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0847554380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cfc759a1-09a6-40ba-80a8-7399de51b555+6:2361:x1876946927495424:12345-192.168.204.37@tcp:38:mount.lustre.0 Request processed in 424us (806us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996246.746500:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 10 00000100:00100000:0.0:1789996246.751773:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1789996246.751994:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927495808 00000100:00100000:3.0:1789996246.752005:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927495808 00000100:00100000:3.0:1789996246.752417:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 11 00000100:00100000:3.0:1789996246.752428:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0847557100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cfc759a1-09a6-40ba-80a8-7399de51b555+6:8125:x1876946927495808:12345-192.168.204.37@tcp:41:mount.lustre.0 00000100:00080000:0.0:1789996246.752538:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000024:3.0:1789996246.752713:0:5847:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1789996246.752795:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0847557100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cfc759a1-09a6-40ba-80a8-7399de51b555+6:8125:x1876946927495808:12345-192.168.204.37@tcp:41:mount.lustre.0 Request processed in 369us (1032us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996246.752803:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 11 00000100:00100000:0.0:1789996246.760175:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1789996246.760270:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927495552 00000100:00100000:1.0:1789996246.760280:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927495552 00000100:00100000:1.0:1789996246.760334:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 12 00000100:00100000:1.0:1789996246.760344:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0847557b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cfc759a1-09a6-40ba-80a8-7399de51b555+6:2363:x1876946927495552:12345-192.168.204.37@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789996246.760375:0:5848:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1789996246.760687:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0847557b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cfc759a1-09a6-40ba-80a8-7399de51b555+6:2363:x1876946927495552:12345-192.168.204.37@tcp:41:mount.lustre.0 Request processed in 342us (520us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996246.760695:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 12 00000100:00100000:0.0:1789996246.761592:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1789996246.761660:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927495936 00000100:00100000:1.0:1789996246.761667:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927495936 00000100:00100000:1.0:1789996246.761711:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 13 00000100:00100000:1.0:1789996246.761721:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e087993ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cfc759a1-09a6-40ba-80a8-7399de51b555+6:8125:x1876946927495936:12345-192.168.204.37@tcp:40:mount.lustre.0 00000100:00100000:1.0:1789996246.761781:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e087993ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cfc759a1-09a6-40ba-80a8-7399de51b555+6:8125:x1876946927495936:12345-192.168.204.37@tcp:40:mount.lustre.0 Request processed in 62us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996246.761789:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 13 00000100:00100000:0.0:1789996246.770677:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996246.770748:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996246.771136:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927496064 00000100:00100000:2.0:1789996246.771156:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927496064 00000100:00100000:2.0:1789996246.771259:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927496192 00000100:00100000:2.0:1789996246.771263:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927496192 00000100:00100000:2.0:1789996246.771293:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 12 00000100:00100000:2.0:1789996246.771301:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0879939c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2361:x1876946927496064:12345-192.168.204.37@tcp:8:mount.lustre.0 00010000:00080000:2.0:1789996246.771331:0:6688:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from cfc759a1-09a6-40ba-80a8-7399de51b555@192.168.204.37@tcp t0 exp 0000000000000000 cur 288 last 0 00000020:00000080:2.0:1789996246.771359:0:6688:0:(genops.c:1384:class_connect()) connect: client cfc759a1-09a6-40ba-80a8-7399de51b555, cookie 0x4173739f0fc807b0 00002000:00100000:2.0:1789996246.771369:0:6688:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli cfc759a1-09a6-40ba-80a8-7399de51b555/ffff8e087f966000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a3f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789996246.771380:0:6688:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:3.0:1789996246.771580:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 13 00000100:00100000:3.0:1789996246.771586:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e08810a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2361:x1876946927496192:12345-192.168.204.37@tcp:8:mount.lustre.0 00010000:00080000:3.0:1789996246.771602:0:6689:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from cfc759a1-09a6-40ba-80a8-7399de51b555@192.168.204.37@tcp t0 exp 0000000000000000 cur 288 last 0 00000020:00000080:3.0:1789996246.771621:0:6689:0:(genops.c:1384:class_connect()) connect: client cfc759a1-09a6-40ba-80a8-7399de51b555, cookie 0x4173739f0fc807b7 00002000:00100000:3.0:1789996246.771636:0:6689:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli cfc759a1-09a6-40ba-80a8-7399de51b555/ffff8e086fde3800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a3f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789996246.771654:0:6689:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789996246.771793:0:6688:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00002000:00080000:3.0:1789996246.771795:0:6689:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1789996246.771820:0:6689:0:(import.c:65:import_set_state_nolock()) ffff8e086fde1800 : changing import state from RECOVER to FULL 00000100:00080000:2.0:1789996246.771820:0:6688:0:(import.c:65:import_set_state_nolock()) ffff8e087f961000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789996246.771883:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e08810a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cfc759a1-09a6-40ba-80a8-7399de51b555+6:2361:x1876946927496192:12345-192.168.204.37@tcp:8:mount.lustre.0 Request processed in 294us (1134us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996246.771891:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 13 00000100:00100000:2.0:1789996246.773257:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0879939c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cfc759a1-09a6-40ba-80a8-7399de51b555+6:2361:x1876946927496064:12345-192.168.204.37@tcp:8:mount.lustre.0 Request processed in 1946us (2581us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996246.773278:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 12 00000100:00100000:1.0:1789996246.774708:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1789996246.775134:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927496320 00000100:00100000:3.0:1789996246.775143:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927496320 00000100:00100000:3.0:1789996246.775198:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 1 00000100:00100000:3.0:1789996246.775219:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0741835f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cfc759a1-09a6-40ba-80a8-7399de51b555+6:8125:x1876946927496320:12345-192.168.204.37@tcp:33:mount.lustre.0 00000004:00200000:3.0:1789996246.775306:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1789996246.775377:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0741835f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cfc759a1-09a6-40ba-80a8-7399de51b555+6:8125:x1876946927496320:12345-192.168.204.37@tcp:33:mount.lustre.0 Request processed in 170us (674us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996246.775383:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 1 00000100:00100000:1.0:1789996247.017023:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0741836d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876946942207360:0@lo:400:kworker.0 00000100:00100000:0.0:1789996247.017042:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0741835500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1876946942207232:0@lo:400:kworker.0 00000100:00100000:2.0:1789996247.017236:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0741835880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e0c28cd8-555e-481f-bd03-c3b02aee51c5:3315:1876946942206976:0@lo:400:kworker.0 00000100:00100000:3.0:1789996247.017284:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0741834a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3316:1876946942207104:0@lo:400:kworker.0 00000100:00100000:0.0:1789996247.017351:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996247.017423:0:9163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942207232 00000100:00100000:0.0:1789996247.017431:0:9163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942207232 00000100:00100000:0.0:1789996247.017531:0:9163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789996247.017570:0:9163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e08810ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876946942207232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789996247.017616:0:9163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e08810ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876946942207232:12345-0@lo:400:kworker.0 Request processed in 78us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996247.017623:0:9163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:0.0:1789996247.017658:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789996247.017683:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0741835500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1876946942207232:0@lo:400:kworker.0 00000100:00100000:2.0:1789996247.019732:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996247.019805:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0876618700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1876946942207488:0@lo:400:kworker.0 00000100:00100000:2.0:1789996247.019863:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996247.020275:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942206976 00000100:00100000:0.0:1789996247.020284:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942206976 00000100:00100000:0.0:1789996247.020702:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:0.0:1789996247.020715:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852ba0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+19:3315:x1876946942206976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789996247.020842:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942207488 00000100:00100000:2.0:1789996247.020847:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942207488 00000100:00100000:0.0:1789996247.020974:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852ba0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+19:3315:x1876946942206976:12345-0@lo:400:kworker.0 Request processed in 262us (1252us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996247.020981:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1789996247.021273:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00080000:0.0:1789996247.021637:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789996247.021711:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0846267800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876946942207488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789996247.021824:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0846267800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876946942207488:12345-0@lo:400:kworker.0 Request processed in 543us (1960us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996247.021831:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789996247.021891:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0741835880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e0c28cd8-555e-481f-bd03-c3b02aee51c5:3315:1876946942206976:0@lo:400:kworker.0 00000100:00100000:0.0:1789996247.021912:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0876618700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1876946942207488:0@lo:400:kworker.0 00000100:00100000:1.0:1789996247.021963:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789996247.021972:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789996247.022005:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e087661b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876946942207616:0@lo:400:kworker.0 00000100:00100000:3.0:1789996247.022106:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996247.022228:0:9163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942207104 00000100:00100000:1.0:1789996247.022228:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942207360 00000100:00100000:2.0:1789996247.022234:0:9163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942207104 00000100:00100000:1.0:1789996247.022234:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942207360 00000100:00100000:2.0:1789996247.022262:0:9163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789996247.022265:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942207616 00000100:00100000:1.0:1789996247.022268:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942207616 00000100:00100000:2.0:1789996247.022269:0:9163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fde8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1876946942207104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789996247.022302:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789996247.022304:0:9163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fde8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1876946942207104:12345-0@lo:400:kworker.0 Request processed in 36us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996247.022309:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0876618a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1876946942207360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789996247.022311:0:9163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789996247.022415:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0876618a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1876946942207360:12345-0@lo:400:kworker.0 Request processed in 106us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996247.022423:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789996247.022439:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00080000:3.0:1789996247.022444:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789996247.022447:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fdea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1876946942207616:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1789996247.022449:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789996247.022475:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0741834a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3316:1876946942207104:0@lo:400:kworker.0 00000100:00100000:1.0:1789996247.028610:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fdea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1876946942207616:12345-0@lo:400:kworker.0 Request processed in 6155us (6493us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996247.028625:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:3.0:1789996247.029592:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e087661b800 x1876946942207616/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789996263 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789996247.029611:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e087661b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876946942207616:0@lo:400:kworker.0 00010000:00080000:0.0:1789996247.032536:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e0741836d80 x1876946942207360/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789996263 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789996247.032722:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0741836d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876946942207360:0@lo:400:kworker.0 00010000:00010000:3.0:1789996247.400909:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789996247.530069:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fde9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876946942207744:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789996247.530145:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996247.535560:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942207744 00000100:00100000:0.0:1789996247.535576:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942207744 00000100:00100000:0.0:1789996247.535651:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789996247.535662:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fde8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876946942207744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789996247.535692:0:6691:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789996247.535783:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fde8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876946942207744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 124us (5638us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996247.535790:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:3.0:1789996247.536772:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e086fde9880 x1876946942207744/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789996263 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789996247.536800:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fde9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876946942207744:0@lo:13:osp-pre-1-0.0 00000001:00100000:2.0:1789996247.562079:0:6715:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of cfc759a1-09a6-40ba-80a8-7399de51b555 00000001:00100000:0.0:1789996247.569213:0:7659:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of cfc759a1-09a6-40ba-80a8-7399de51b555 00000001:00100000:0.0:1789996248.128306:0:5868:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of cfc759a1-09a6-40ba-80a8-7399de51b555 00010000:00010000:2.0:1789996248.429236:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789996249.465777:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789996250.474347:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789996251.113967:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e08810abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876946942207872:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789996251.114032:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789996251.114264:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942207872 00000100:00100000:3.0:1789996251.114273:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942207872 00000100:00100000:3.0:1789996251.114348:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789996251.114359:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0846265500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876946942207872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789996251.114416:0:6691:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1789996251.114493:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789996251.117756:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0846265500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876946942207872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3391us (3715us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996251.117767:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:2.0:1789996251.117982:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e08810abb80 x1876946942207872/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789996267 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789996251.118007:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e08810abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876946942207872:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789996251.497128:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789996251.583638:0:10331:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg437-client.virtnet: executing check_config_client /mnt/lustre 00000100:00100000:1.0:1789996251.952776:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1789996251.952827:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1789996251.952860:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1789996251.952897:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1789996251.952922:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996251.953004:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927496704 00000100:00100000:2.0:1789996251.953024:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927496704 00000100:00100000:2.0:1789996251.953104:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927496576 00000100:00100000:2.0:1789996251.953120:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927496576 00000100:00100000:2.0:1789996251.953145:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 59 00000100:00100000:2.0:1789996251.953155:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e087661a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cfc759a1-09a6-40ba-80a8-7399de51b555+5:2364:x1876946927496704:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:2.0:1789996251.953231:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e087661a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cfc759a1-09a6-40ba-80a8-7399de51b555+5:2364:x1876946927496704:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 76us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996251.953239:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 59 00000100:00100000:2.0:1789996251.953257:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 60 00000100:00100000:2.0:1789996251.953264:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e087661b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+6:2364:x1876946927496576:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:2.0:1789996251.953302:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e087661b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+6:2364:x1876946927496576:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 39us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996251.953309:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 60 00000100:00080000:1.0:1789996251.953569:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789996251.953645:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927496960 00000100:00100000:0.0:1789996251.953650:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927496960 00000100:00100000:0.0:1789996251.953702:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927496832 00000100:00100000:0.0:1789996251.953706:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927496832 00000100:00100000:0.0:1789996251.953745:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 33 00000100:00100000:0.0:1789996251.953754:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0876618e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cfc759a1-09a6-40ba-80a8-7399de51b555+5:2364:x1876946927496960:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:0.0:1789996251.953785:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0876618e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cfc759a1-09a6-40ba-80a8-7399de51b555+5:2364:x1876946927496960:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 32us (924us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996251.953792:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 33 00000100:00100000:0.0:1789996251.953808:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 34 00000100:00100000:0.0:1789996251.953814:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0876618700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cfc759a1-09a6-40ba-80a8-7399de51b555+5:2364:x1876946927496832:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:0.0:1789996251.953838:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0876618700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cfc759a1-09a6-40ba-80a8-7399de51b555+5:2364:x1876946927496832:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 24us (917us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996251.953844:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 34 00000100:00080000:1.0:1789996251.954167:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789996251.954171:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789996251.954917:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927496448 00000100:00100000:3.0:1789996251.954925:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927496448 00000100:00100000:3.0:1789996251.954976:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 216 00000100:00100000:3.0:1789996251.954985:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852ba2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f78f7903-47ba-48a7-bb82-1f616cb85fc0+13:2364:x1876946927496448:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:3.0:1789996251.955051:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852ba2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f78f7903-47ba-48a7-bb82-1f616cb85fc0+13:2364:x1876946927496448:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 66us (2284us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996251.955058:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 216 00000100:00100000:3.0:1789996252.137927:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086f889c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876946942208384:0@lo:400:kworker.0 00000100:00100000:3.0:1789996252.138020:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996252.138309:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0846266680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e0c28cd8-555e-481f-bd03-c3b02aee51c5:3315:1876946942208000:0@lo:400:kworker.0 00000100:00100000:0.0:1789996252.138358:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996252.138393:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086f88b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1876946942208512:0@lo:400:kworker.0 00000100:00100000:0.0:1789996252.138421:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996252.138441:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1789996252.138447:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0846264000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876946942208128:0@lo:400:kworker.0 00000100:00100000:0.0:1789996252.138467:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996252.138485:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086f88bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876946942208640:0@lo:400:kworker.0 00000100:00100000:0.0:1789996252.138506:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996252.138536:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942208512 00000100:00100000:0.0:1789996252.138580:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942208512 00000100:00100000:0.0:1789996252.138634:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942208128 00000100:00100000:0.0:1789996252.138647:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942208128 00000100:00100000:0.0:1789996252.138673:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789996252.138682:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e08810a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876946942208512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789996252.139004:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e08810a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876946942208512:12345-0@lo:400:kworker.0 Request processed in 323us (582us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996252.139024:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789996252.139044:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789996252.139051:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e08810aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876946942208128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789996252.139237:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942208000 00000100:00100000:3.0:1789996252.139242:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942208000 00000100:00100000:3.0:1789996252.139279:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1789996252.139285:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852ba2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+19:3315:x1876946942208000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789996252.139318:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852ba2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+19:3315:x1876946942208000:12345-0@lo:400:kworker.0 Request processed in 33us (959us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996252.139325:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1789996252.139395:0:8222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942208384 00000100:00100000:3.0:1789996252.139399:0:8222:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942208384 00000100:00100000:3.0:1789996252.139422:0:8222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942208640 00000100:00100000:3.0:1789996252.139425:0:8222:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942208640 00000100:00100000:3.0:1789996252.139448:0:8222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789996252.139456:0:8222:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fde9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1876946942208384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789996252.139517:0:8222:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fde9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1876946942208384:12345-0@lo:400:kworker.0 Request processed in 62us (1510us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996252.139524:0:8222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789996252.139537:0:8222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789996252.139564:0:8222:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e08810a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1876946942208640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789996252.139594:0:8222:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e08810a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1876946942208640:12345-0@lo:400:kworker.0 Request processed in 51us (1086us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996252.139600:0:8222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789996252.139929:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e08810aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876946942208128:12345-0@lo:400:kworker.0 Request processed in 878us (1460us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996252.139935:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:0.0:1789996252.139962:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789996252.139966:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789996252.139996:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0846264000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876946942208128:0@lo:400:kworker.0 00010000:00080000:0.0:1789996252.140023:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e086f88bb80 x1876946942208640/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789996268 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789996252.140033:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086f88bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876946942208640:0@lo:400:kworker.0 00000100:00100000:0.0:1789996252.140043:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0846266680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e0c28cd8-555e-481f-bd03-c3b02aee51c5:3315:1876946942208000:0@lo:400:kworker.0 00000100:00100000:0.0:1789996252.140053:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086f88b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1876946942208512:0@lo:400:kworker.0 00010000:00080000:0.0:1789996252.140145:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e086f889c00 x1876946942208384/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789996268 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789996252.140302:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086f88a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1876946942208256:0@lo:400:kworker.0 00000100:00100000:2.0:1789996252.140532:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996252.141255:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942208256 00000100:00100000:1.0:1789996252.141264:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942208256 00000100:00100000:1.0:1789996252.141323:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789996252.141341:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086f888380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876946942208256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789996252.141396:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086f888380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876946942208256:12345-0@lo:400:kworker.0 Request processed in 65us (863us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996252.141402:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:2.0:1789996252.141612:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789996252.141645:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086f88a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1876946942208256:0@lo:400:kworker.0 00000100:00100000:0.0:1789996252.141920:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086f889c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876946942208384:0@lo:400:kworker.0 00010000:00010000:2.0:1789996252.521808:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789996252.649702:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789996252.649724:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fdea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876946942208768:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789996252.649794:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789996252.649861:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942208768 00000100:00100000:3.0:1789996252.649868:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942208768 00000100:00100000:3.0:1789996252.649930:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789996252.649941:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fdead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876946942208768:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789996252.649981:0:6691:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789996252.650051:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fdead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876946942208768:12345-0@lo:13:osp-pre-1-0.0 Request processed in 112us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996252.650058:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:3.0:1789996252.650116:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e086fdea300 x1876946942208768/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789996268 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789996252.650134:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fdea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876946942208768:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789996253.552270:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789996254.572048:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789996255.594521:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789996256.232837:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789996256.232862:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e08810ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876946942208896:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789996256.232932:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996256.233117:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942208896 00000100:00100000:0.0:1789996256.233133:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942208896 00000100:00100000:0.0:1789996256.233205:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789996256.233217:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086f88a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876946942208896:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789996256.233256:0:6691:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789996256.233305:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086f88a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876946942208896:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996256.233314:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:2.0:1789996256.233507:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789996256.233536:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e08810ab480 x1876946942208896/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789996272 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789996256.233584:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e08810ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876946942208896:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789996256.621835:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789996257.071915:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996257.071963:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996257.072020:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996257.072050:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996257.072079:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996257.072107:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927497088 00000100:00100000:0.0:1789996257.072116:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927497088 00000100:00100000:0.0:1789996257.072163:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 218 00000100:00100000:0.0:1789996257.072174:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852ba0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f78f7903-47ba-48a7-bb82-1f616cb85fc0+13:2363:x1876946927497088:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:0.0:1789996257.072264:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852ba0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f78f7903-47ba-48a7-bb82-1f616cb85fc0+13:2363:x1876946927497088:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 92us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996257.072272:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 218 00000100:00100000:0.0:1789996257.072308:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927497216 00000100:00100000:0.0:1789996257.072312:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927497216 00000100:00100000:0.0:1789996257.072346:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927497344 00000100:00100000:0.0:1789996257.072349:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927497344 00000100:00100000:0.0:1789996257.072374:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 64 00000100:00100000:0.0:1789996257.072383:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e08810a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+6:2363:x1876946927497216:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:0.0:1789996257.072416:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e08810a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+6:2363:x1876946927497216:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 35us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996257.072433:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 64 00000100:00100000:0.0:1789996257.072451:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 65 00000100:00100000:0.0:1789996257.072458:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e08810a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cfc759a1-09a6-40ba-80a8-7399de51b555+5:2363:x1876946927497344:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:0.0:1789996257.072489:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e08810a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cfc759a1-09a6-40ba-80a8-7399de51b555+5:2363:x1876946927497344:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 31us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996257.072496:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 65 00000100:00100000:0.0:1789996257.072517:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927497472 00000100:00100000:0.0:1789996257.072521:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927497472 00000100:00100000:0.0:1789996257.072570:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927497600 00000100:00100000:0.0:1789996257.072573:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927497600 00000100:00100000:0.0:1789996257.072594:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 37 00000100:00100000:0.0:1789996257.072602:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e08810aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cfc759a1-09a6-40ba-80a8-7399de51b555+5:2363:x1876946927497472:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:0.0:1789996257.072627:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e08810aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cfc759a1-09a6-40ba-80a8-7399de51b555+5:2363:x1876946927497472:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 27us (664us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996257.072633:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 37 00000100:00100000:0.0:1789996257.072644:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 38 00000100:00100000:0.0:1789996257.072650:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e08810a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cfc759a1-09a6-40ba-80a8-7399de51b555+5:2363:x1876946927497600:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:0.0:1789996257.072671:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e08810a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cfc759a1-09a6-40ba-80a8-7399de51b555+5:2363:x1876946927497600:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 21us (593us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996257.072677:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 38 00000100:00080000:0.0:1789996257.072803:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789996257.072806:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789996257.072809:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789996257.257356:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e08810a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1876946942209280:0@lo:400:kworker.0 00000100:00100000:0.0:1789996257.257439:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996257.257501:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789996257.257507:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e08810aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876946942209408:0@lo:400:kworker.0 00000100:00100000:0.0:1789996257.257533:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996257.257610:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942209280 00000100:00100000:0.0:1789996257.257619:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942209280 00000100:00100000:0.0:1789996257.257675:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789996257.257685:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e08810aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876946942209280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789996257.257734:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e08810aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876946942209280:12345-0@lo:400:kworker.0 Request processed in 50us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996257.257742:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789996257.257767:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942209408 00000100:00100000:0.0:1789996257.257770:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942209408 00000100:00100000:0.0:1789996257.257790:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789996257.257795:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e08810ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1876946942209408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789996257.257819:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e08810ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1876946942209408:12345-0@lo:400:kworker.0 Request processed in 25us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996257.257824:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:0.0:1789996257.257837:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1789996257.257866:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e08810aa680 x1876946942209408/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789996273 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789996257.257879:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e08810aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876946942209408:0@lo:400:kworker.0 00000100:00100000:0.0:1789996257.257889:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e08810a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1876946942209280:0@lo:400:kworker.0 00000100:00100000:1.0:1789996257.258068:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e08810ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e0c28cd8-555e-481f-bd03-c3b02aee51c5:3315:1876946942209024:0@lo:400:kworker.0 00000100:00100000:1.0:1789996257.258106:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996257.258142:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e08810a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1876946942209536:0@lo:400:kworker.0 00000100:00100000:1.0:1789996257.258180:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996257.258199:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789996257.258205:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e08810a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876946942209152:0@lo:400:kworker.0 00000100:00100000:1.0:1789996257.258226:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996257.258243:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e08810a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876946942209664:0@lo:400:kworker.0 00000100:00100000:1.0:1789996257.258262:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996257.258284:0:9163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942209536 00000100:00100000:1.0:1789996257.258288:0:9163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942209536 00000100:00100000:1.0:1789996257.258313:0:9163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942209152 00000100:00100000:1.0:1789996257.258316:0:9163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942209152 00000100:00100000:1.0:1789996257.258334:0:9163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789996257.258339:0:9163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e087f83bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876946942209536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789996257.258370:0:9163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e087f83bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876946942209536:12345-0@lo:400:kworker.0 Request processed in 31us (190us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996257.258376:0:9163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789996257.258389:0:9163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789996257.258395:0:9163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e087f838380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876946942209152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789996257.258421:0:9163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e087f838380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876946942209152:12345-0@lo:400:kworker.0 Request processed in 27us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996257.258427:0:9163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789996257.258450:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e08810a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876946942209152:0@lo:400:kworker.0 00000100:00100000:1.0:1789996257.258459:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e08810a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1876946942209536:0@lo:400:kworker.0 00000100:00100000:0.0:1789996257.258668:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942209024 00000100:00100000:0.0:1789996257.258673:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942209024 00000100:00100000:0.0:1789996257.258705:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1789996257.258718:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852ba3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0c28cd8-555e-481f-bd03-c3b02aee51c5+19:3315:x1876946942209024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789996257.258750:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852ba3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0c28cd8-555e-481f-bd03-c3b02aee51c5+19:3315:x1876946942209024:12345-0@lo:400:kworker.0 Request processed in 33us (643us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996257.258755:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1789996257.258784:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942209664 00000100:00100000:0.0:1789996257.258788:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942209664 00000100:00100000:0.0:1789996257.258814:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789996257.258820:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e087f83aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1876946942209664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789996257.258847:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e087f83aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1876946942209664:12345-0@lo:400:kworker.0 Request processed in 28us (584us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996257.258853:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:0.0:1789996257.258873:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789996257.258877:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789996257.260080:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e08810a8000 x1876946942209664/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789996273 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789996257.260097:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e08810a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876946942209664:0@lo:400:kworker.0 00000100:00100000:1.0:1789996257.260109:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e08810ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e0c28cd8-555e-481f-bd03-c3b02aee51c5:3315:1876946942209024:0@lo:400:kworker.0 00010000:00010000:1.0:1789996257.642778:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789996257.768848:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789996257.768870:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086f88aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876946942209792:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789996257.768935:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789996257.776162:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942209792 00000100:00100000:3.0:1789996257.776184:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942209792 00000100:00100000:3.0:1789996257.776587:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789996257.776599:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086f889180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876946942209792:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789996257.776638:0:6691:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789996257.776714:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086f889180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876946942209792:12345-0@lo:13:osp-pre-1-0.0 Request processed in 117us (7778us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996257.776720:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:3.0:1789996257.784006:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e086f88aa00 x1876946942209792/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789996273 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789996257.784036:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086f88aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876946942209792:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789996258.665441:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789996259.691026:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789996260.713729:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789996261.353254:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086f88b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876946942209920:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789996261.353324:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996261.353806:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942209920 00000100:00100000:0.0:1789996261.353816:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942209920 00000100:00100000:0.0:1789996261.353943:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789996261.353954:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fdea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876946942209920:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789996261.354003:0:6691:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789996261.354065:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fdea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876946942209920:12345-0@lo:13:osp-pre-0-0.0 Request processed in 113us (740us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996261.354072:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:1.0:1789996261.354212:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e086f88b480 x1876946942209920/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789996277 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789996261.354231:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086f88b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876946942209920:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789996261.354321:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789996261.738750:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789996262.198878:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996262.199154:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996262.199189:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996262.199209:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996262.199235:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996262.199270:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927498240 00000100:00100000:2.0:1789996262.199282:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927498240 00000100:00100000:2.0:1789996262.199337:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927498112 00000100:00100000:2.0:1789996262.199340:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927498112 00000100:00100000:2.0:1789996262.199365:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 41 00000100:00100000:2.0:1789996262.199374:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086f88ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cfc759a1-09a6-40ba-80a8-7399de51b555+5:2365:x1876946927498240:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:2.0:1789996262.199449:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086f88ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cfc759a1-09a6-40ba-80a8-7399de51b555+5:2365:x1876946927498240:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 75us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996262.199456:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 41 00000100:00100000:2.0:1789996262.199473:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 42 00000100:00100000:2.0:1789996262.199479:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e08810ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cfc759a1-09a6-40ba-80a8-7399de51b555+5:2365:x1876946927498112:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:2.0:1789996262.199499:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e08810ef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cfc759a1-09a6-40ba-80a8-7399de51b555+5:2365:x1876946927498112:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 21us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996262.199504:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 42 00000100:00100000:0.0:1789996262.199691:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927497728 00000100:00100000:0.0:1789996262.199697:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927497728 00000100:00100000:0.0:1789996262.199727:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 220 00000100:00100000:0.0:1789996262.199734:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852ba1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f78f7903-47ba-48a7-bb82-1f616cb85fc0+13:2365:x1876946927497728:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:0.0:1789996262.199776:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852ba1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f78f7903-47ba-48a7-bb82-1f616cb85fc0+13:2365:x1876946927497728:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 42us (974us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996262.199782:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 220 00000100:00100000:2.0:1789996262.201239:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927497984 00000100:00100000:2.0:1789996262.201251:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927497984 00000100:00100000:2.0:1789996262.201303:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927497856 00000100:00100000:2.0:1789996262.201307:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927497856 00000100:00100000:2.0:1789996262.201329:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 69 00000100:00100000:2.0:1789996262.201337:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086f889500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cfc759a1-09a6-40ba-80a8-7399de51b555+5:2365:x1876946927497984:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:2.0:1789996262.201383:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086f889500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cfc759a1-09a6-40ba-80a8-7399de51b555+5:2365:x1876946927497984:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 47us (2230us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996262.201389:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 69 00000100:00100000:2.0:1789996262.201404:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 70 00000100:00100000:2.0:1789996262.201410:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086f889f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+6:2365:x1876946927497856:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:2.0:1789996262.201433:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086f889f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+6:2365:x1876946927497856:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 22us (2223us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996262.201438:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 70 00000100:00080000:2.0:1789996262.201458:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789996262.201462:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789996262.201465:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789996262.377023:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e08810a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e0c28cd8-555e-481f-bd03-c3b02aee51c5:3315:1876946942210048:0@lo:400:kworker.0 00000100:00100000:1.0:1789996262.377107:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996262.377260:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e08810abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1876946942210304:0@lo:400:kworker.0 00000100:00100000:0.0:1789996262.377291:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996262.377344:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789996262.377349:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e08810a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876946942210432:0@lo:400:kworker.0 00000100:00100000:0.0:1789996262.377373:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996262.377423:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942210304 00000100:00100000:0.0:1789996262.377431:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942210304 00000100:00100000:0.0:1789996262.377483:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789996262.377492:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e08810a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876946942210304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789996262.377539:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e08810a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876946942210304:12345-0@lo:400:kworker.0 Request processed in 48us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996262.377590:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789996262.377616:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e08810aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3316:1876946942210176:0@lo:400:kworker.0 00000100:00100000:0.0:1789996262.377639:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996262.377656:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e08810aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876946942210688:0@lo:400:kworker.0 00000100:00100000:0.0:1789996262.377674:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996262.377695:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789996262.377700:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e08810a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3316:1876946942210560:0@lo:400:kworker.0 00000100:00100000:0.0:1789996262.377717:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996262.377755:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e08810abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1876946942210304:0@lo:400:kworker.0 00000100:00100000:0.0:1789996262.377780:0:9163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942210176 00000100:00100000:0.0:1789996262.377783:0:9163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942210176 00000100:00100000:0.0:1789996262.377830:0:9163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942210560 00000100:00100000:0.0:1789996262.377833:0:9163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942210560 00000100:00100000:0.0:1789996262.377847:0:9163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789996262.377852:0:9163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e08810ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1876946942210176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789996262.377883:0:9163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e08810ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1876946942210176:12345-0@lo:400:kworker.0 Request processed in 31us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996262.377889:0:9163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789996262.377898:0:9163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789996262.377917:0:9163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e08810a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1876946942210560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789996262.377940:0:9163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e08810a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1876946942210560:12345-0@lo:400:kworker.0 Request processed in 37us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996262.377946:0:9163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789996262.377969:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e08810a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3316:1876946942210560:0@lo:400:kworker.0 00000100:00100000:0.0:1789996262.377978:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e08810aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3316:1876946942210176:0@lo:400:kworker.0 00000100:00080000:0.0:1789996262.378010:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789996262.378021:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942210432 00000100:00100000:0.0:1789996262.378025:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942210432 00000100:00100000:0.0:1789996262.378047:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942210688 00000100:00100000:0.0:1789996262.378049:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942210688 00000100:00100000:0.0:1789996262.378071:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789996262.378077:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e08810ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1876946942210432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789996262.378111:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e08810ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1876946942210432:12345-0@lo:400:kworker.0 Request processed in 34us (737us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996262.378117:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789996262.378127:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789996262.378133:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e08810a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1876946942210688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789996262.378171:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e08810a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1876946942210688:12345-0@lo:400:kworker.0 Request processed in 38us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996262.378177:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:0.0:1789996262.378191:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1789996262.378208:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e08810aad80 x1876946942210688/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789996278 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789996262.378219:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e08810aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876946942210688:0@lo:400:kworker.0 00010000:00080000:0.0:1789996262.378241:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e08810a9c00 x1876946942210432/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789996278 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789996262.378249:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e08810a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876946942210432:0@lo:400:kworker.0 00000100:00100000:2.0:1789996262.381795:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942210048 00000100:00100000:2.0:1789996262.381823:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942210048 00000100:00100000:2.0:1789996262.381874:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1789996262.381882:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852ba1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0c28cd8-555e-481f-bd03-c3b02aee51c5+19:3315:x1876946942210048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789996262.382061:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852ba1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0c28cd8-555e-481f-bd03-c3b02aee51c5+19:3315:x1876946942210048:12345-0@lo:400:kworker.0 Request processed in 178us (4953us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996262.382068:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1789996262.384331:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e08810a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e0c28cd8-555e-481f-bd03-c3b02aee51c5:3315:1876946942210048:0@lo:400:kworker.0 00010000:00010000:0.0:1789996262.760874:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789996262.890497:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086f88ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876946942210816:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789996262.892097:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789996262.892198:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942210816 00000100:00100000:3.0:1789996262.892207:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942210816 00000100:00100000:3.0:1789996262.892257:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789996262.892267:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e08810a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876946942210816:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789996262.892303:0:6691:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789996262.892352:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e08810a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876946942210816:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996262.892373:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:0.0:1789996262.896520:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e086f88ad80 x1876946942210816/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789996278 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789996262.896569:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086f88ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876946942210816:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789996263.784814:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789996264.808792:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789996265.833809:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789996266.472819:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789996266.472853:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086f888700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876946942210944:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789996266.472948:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996266.473064:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942210944 00000100:00100000:2.0:1789996266.473072:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942210944 00000100:00100000:2.0:1789996266.473142:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789996266.473151:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e087f839180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876946942210944:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789996266.473187:0:6691:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789996266.473251:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e087f839180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876946942210944:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996266.473258:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:1.0:1789996266.473352:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e086f888700 x1876946942210944/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789996282 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789996266.473363:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789996266.473370:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086f888700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876946942210944:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789996266.856932:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789996267.313063:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996267.313107:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996267.313142:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1789996267.313218:0:9163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927498496 00000100:00100000:1.0:1789996267.313228:0:9163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927498496 00000100:00100000:1.0:1789996267.313291:0:9163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927498624 00000100:00100000:3.0:1789996267.313305:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 74 00000100:00100000:1.0:1789996267.313310:0:9163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927498624 00000100:00100000:3.0:1789996267.313320:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e08810aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+6:2362:x1876946927498496:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:1.0:1789996267.313340:0:9163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 75 00000100:00100000:1.0:1789996267.313351:0:9163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e08810aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cfc759a1-09a6-40ba-80a8-7399de51b555+5:2362:x1876946927498624:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:3.0:1789996267.313391:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e08810aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+6:2362:x1876946927498496:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 74us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996267.313399:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 74 00000100:00100000:1.0:1789996267.313407:0:9163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e08810aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cfc759a1-09a6-40ba-80a8-7399de51b555+5:2362:x1876946927498624:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 55us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996267.313416:0:9163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 75 00000100:00100000:2.0:1789996267.313570:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927498368 00000100:00080000:0.0:1789996267.313570:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789996267.313576:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927498368 00000100:00100000:2.0:1789996267.313611:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 222 00000100:00100000:2.0:1789996267.313620:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852ba1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f78f7903-47ba-48a7-bb82-1f616cb85fc0+13:2362:x1876946927498368:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:2.0:1789996267.313664:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852ba1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f78f7903-47ba-48a7-bb82-1f616cb85fc0+13:2362:x1876946927498368:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 45us (611us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996267.313671:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 222 00000100:00100000:2.0:1789996267.316464:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996267.316581:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1789996267.316725:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927498752 00000100:00100000:3.0:1789996267.316735:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927498752 00000100:00100000:0.0:1789996267.316788:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927498880 00000100:00100000:0.0:1789996267.316794:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927498880 00000100:00100000:3.0:1789996267.316880:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 14 00000100:00100000:3.0:1789996267.316891:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086f88b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cfc759a1-09a6-40ba-80a8-7399de51b555+5:2361:x1876946927498752:12345-192.168.204.37@tcp:9:kworker.0 00000020:00000080:3.0:1789996267.316922:0:6688:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4173739f0fc807b0 00000100:00080000:3.0:1789996267.316932:0:6688:0:(import.c:65:import_set_state_nolock()) ffff8e087f961000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789996267.316979:0:6688:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1789996267.317337:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086f88b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cfc759a1-09a6-40ba-80a8-7399de51b555+2:2361:x1876946927498752:12345-192.168.204.37@tcp:9:kworker.0 Request processed in 447us (882us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996267.317346:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 14 00010000:00010000:3.0:1789996267.317367:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789996267.320077:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789996267.320088:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789996267.322516:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 15 00000100:00100000:0.0:1789996267.322700:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086f888e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cfc759a1-09a6-40ba-80a8-7399de51b555+5:2361:x1876946927498880:12345-192.168.204.37@tcp:9:kworker.0 00000020:00000080:0.0:1789996267.322738:0:6689:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4173739f0fc807b7 00000100:00080000:0.0:1789996267.322749:0:6689:0:(import.c:65:import_set_state_nolock()) ffff8e086fde1800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789996267.322787:0:6689:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00010000:00010000:1.0:1789996267.322804:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789996267.323169:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086f888e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cfc759a1-09a6-40ba-80a8-7399de51b555+2:2361:x1876946927498880:12345-192.168.204.37@tcp:9:kworker.0 Request processed in 476us (6624us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996267.329680:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 15 00000100:00100000:3.0:1789996267.498182:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086f889880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1876946942211328:0@lo:400:kworker.0 00000100:00100000:3.0:1789996267.498255:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789996267.498320:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789996267.498327:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086f888000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876946942211456:0@lo:400:kworker.0 00000100:00100000:3.0:1789996267.498354:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789996267.498385:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942211328 00000100:00100000:3.0:1789996267.498393:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942211328 00000100:00100000:3.0:1789996267.498450:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789996267.498474:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fde9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876946942211328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789996267.498526:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fde9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876946942211328:12345-0@lo:400:kworker.0 Request processed in 57us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996267.498534:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789996267.498602:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086f889880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1876946942211328:0@lo:400:kworker.0 00000100:00100000:0.0:1789996267.499143:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086f888a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e0c28cd8-555e-481f-bd03-c3b02aee51c5:3315:1876946942211072:0@lo:400:kworker.0 00000100:00100000:0.0:1789996267.499184:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996267.499216:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086f888700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1876946942211584:0@lo:400:kworker.0 00000100:00100000:0.0:1789996267.499239:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996267.499259:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1789996267.499265:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086f88a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876946942211200:0@lo:400:kworker.0 00000100:00100000:0.0:1789996267.499285:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996267.499300:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086f88ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876946942211712:0@lo:400:kworker.0 00000100:00100000:0.0:1789996267.499321:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996267.499359:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942211072 00000100:00100000:0.0:1789996267.499364:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942211072 00000100:00100000:0.0:1789996267.499393:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1789996267.499401:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852ba0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+19:3315:x1876946942211072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789996267.499439:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852ba0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+19:3315:x1876946942211072:12345-0@lo:400:kworker.0 Request processed in 39us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996267.499446:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1789996267.499474:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942211584 00000100:00100000:0.0:1789996267.499477:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942211584 00000100:00100000:0.0:1789996267.499522:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942211200 00000100:00100000:0.0:1789996267.499525:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942211200 00000100:00100000:0.0:1789996267.499538:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1789996267.499574:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e08810a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876946942211584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789996267.499605:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e08810a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876946942211584:12345-0@lo:400:kworker.0 Request processed in 61us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996267.499611:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1789996267.499623:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1789996267.499777:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e08810abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876946942211200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789996267.499818:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e08810abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876946942211200:12345-0@lo:400:kworker.0 Request processed in 32us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996267.499824:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1789996267.500844:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942211456 00000100:00100000:2.0:1789996267.500862:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942211456 00000100:00100000:2.0:1789996267.500899:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942211712 00000100:00100000:2.0:1789996267.500902:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942211712 00000100:00100000:2.0:1789996267.500926:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789996267.500934:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fde9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1876946942211456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789996267.501068:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086f88a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876946942211200:0@lo:400:kworker.0 00000100:00080000:3.0:1789996267.501128:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789996267.501132:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789996267.501147:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789996267.501157:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e08810a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1876946942211712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789996267.507654:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fde9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1876946942211456:12345-0@lo:400:kworker.0 Request processed in 6708us (9286us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996267.507668:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:1.0:1789996267.508060:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e086f888000 x1876946942211456/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789996283 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789996267.508075:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086f888000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876946942211456:0@lo:400:kworker.0 00000100:00100000:0.0:1789996267.521866:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086f888a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e0c28cd8-555e-481f-bd03-c3b02aee51c5:3315:1876946942211072:0@lo:400:kworker.0 00000100:00100000:0.0:1789996267.521891:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086f888700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1876946942211584:0@lo:400:kworker.0 00000100:00100000:3.0:1789996267.530732:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e08810a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1876946942211712:12345-0@lo:400:kworker.0 Request processed in 29569us (31401us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996267.530746:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:0.0:1789996267.530974:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e086f88ad80 x1876946942211712/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789996283 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789996267.530989:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086f88ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876946942211712:0@lo:400:kworker.0 00010000:00010000:0.0:1789996267.880896:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789996267.933640:0:11031:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:2.0:1789996268.009441:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086f88b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876946942211840:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789996268.009516:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996268.009638:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942211840 00000100:00100000:2.0:1789996268.009646:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942211840 00000100:00100000:2.0:1789996268.009688:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789996268.009697:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086f88aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876946942211840:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789996268.009741:0:6692:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789996268.009787:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086f88aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876946942211840:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996268.009806:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:2.0:1789996268.009850:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e086f88b480 x1876946942211840/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789996284 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789996268.009887:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086f88b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876946942211840:0@lo:13:osp-pre-1-0.0 00000001:00100000:2.0:1789996268.109489:0:6715:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of cfc759a1-09a6-40ba-80a8-7399de51b555 00000020:00000080:2.0:1789996268.109500:0:6715:0:(genops.c:885:class_export_put()) final put ffff8e087f966000/cfc759a1-09a6-40ba-80a8-7399de51b555 00000020:00000080:0.0:1789996268.110628:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8e087f966000/cfc759a1-09a6-40ba-80a8-7399de51b555 for lustre-OST0000 00000020:00000080:0.0:1789996268.110703:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e087f961000 for lustre-OST0000 00000001:00100000:1.0:1789996268.111102:0:7659:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of cfc759a1-09a6-40ba-80a8-7399de51b555 00000020:00000080:1.0:1789996268.111108:0:7659:0:(genops.c:885:class_export_put()) final put ffff8e086fde3800/cfc759a1-09a6-40ba-80a8-7399de51b555 00000020:00000080:1.0:1789996268.111133:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8e086fde3800/cfc759a1-09a6-40ba-80a8-7399de51b555 for lustre-OST0001 00000020:00000080:1.0:1789996268.111162:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e086fde1800 for lustre-OST0001 00010000:00010000:1.0:1789996268.907438:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789996269.943327:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789996270.953286:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789996271.354253:0:11180:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc134aaba0 20000000:00000080:3.0:1789996271.354271:0:11180:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8e0848cd3c00 uarg=0000000000000000 20000000:01000000:3.0:1789996271.354366:0:11180:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1789996271.354372:0:11180:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1789996271.354451:0:11180:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1789996271.356177:0:11181:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:2.0:1789996271.356343:0:11180:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1789996271.364456:0:11180:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1789996271.364487:0:11180:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e0842de5e00/0x4173739f0fc807be lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996271.364505:0:11180:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e0876a23e00/0x4173739f0fc8076a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4173739f0fc80763 expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996271.364516:0:11180:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e0842de5c00/0x4173739f0fc80771 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35428 expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996271.364522:0:11180:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e0840030200/0x4173739f0fc8077f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4173739f0fc80778 expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996271.364528:0:11180:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e0876a22200/0x4173739f0fc8078d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4173739f0fc80786 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996271.364533:0:11180:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e0842de5a00/0x4173739f0fc807a2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35460 expref: 12 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996271.364583:0:11180:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8e0842de5e00/0x4173739f0fc807be lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996271.364624:0:11180:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e0842de5a00/0x4173739f0fc807a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35460 expref: 12 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996271.364638:0:11180:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e0842de5a00/0x4173739f0fc807a2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35460 expref: 12 pid: 5841 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789996271.364653:0:11180:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086f88b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11180:1876946942211968:192.168.204.37@tcp:104: 00010000:00010000:2.0:1789996271.364782:0:11180:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e0876a22200/0x4173739f0fc8078d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4173739f0fc80786 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996271.364791:0:11180:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e0876a22200/0x4173739f0fc8078d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4173739f0fc80786 expref: 18 pid: 5839 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789996271.364800:0:11180:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086f889c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11180:1876946942212096:0@lo:104: 00000100:00100000:2.0:1789996271.364838:0:11180:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789996271.364875:0:11180:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e0840030200/0x4173739f0fc8077f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4173739f0fc80778 expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996271.364883:0:11180:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e0840030200/0x4173739f0fc8077f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4173739f0fc80778 expref: 18 pid: 5841 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789996271.364892:0:11180:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086f88bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11180:1876946942212224:0@lo:104: 00000100:00100000:2.0:1789996271.364912:0:11180:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789996271.364935:0:11180:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e0842de5c00/0x4173739f0fc80771 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35428 expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996271.364955:0:11180:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e0842de5c00/0x4173739f0fc80771 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35428 expref: 12 pid: 5840 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789996271.364963:0:11180:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086f888700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11180:1876946942212352:192.168.204.37@tcp:104: 00010000:00010000:2.0:1789996271.364992:0:11180:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e0876a23e00/0x4173739f0fc8076a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4173739f0fc80763 expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996271.365000:0:11180:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e0876a23e00/0x4173739f0fc8076a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4173739f0fc80763 expref: 18 pid: 5841 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789996271.365008:0:11180:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086f888a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11180:1876946942212480:0@lo:104: 00000100:00100000:2.0:1789996271.365028:0:11180:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996271.365038:0:11180:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0848997cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789996271.365415:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942212096 00000100:00100000:1.0:1789996271.365426:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942212096 00000100:00100000:1.0:1789996271.365466:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942212224 00000100:00100000:1.0:1789996271.365470:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942212224 00000100:00100000:1.0:1789996271.365479:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942212480 00000100:00100000:1.0:1789996271.365482:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942212480 00000100:00100000:1.0:1789996271.365494:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789996271.365503:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086f88b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+5:11180:x1876946942212096:12345-0@lo:104: 00010000:00010000:1.0:1789996271.365526:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.137@tcp lock: ffff8e0840031200/0x4173739f0fc80786 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4173739f0fc8078d expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996271.365633:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789996271.365640:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086f88b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+5:11180:x1876946942212096:12345-0@lo:104: Request processed in 138us (801us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996271.365647:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789996271.365665:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789996271.365671:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086f88ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+4:11180:x1876946942212224:12345-0@lo:104: 00010000:00010000:1.0:1789996271.365679:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.137@tcp lock: ffff8e0876a23c00/0x4173739f0fc80778 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4173739f0fc8077f expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996271.365709:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789996271.365715:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086f88ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+4:11180:x1876946942212224:12345-0@lo:104: Request processed in 44us (802us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996271.365720:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789996271.365746:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789996271.365753:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086f88a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+3:11180:x1876946942212480:12345-0@lo:104: 00010000:00010000:1.0:1789996271.365760:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.137@tcp lock: ffff8e0842de4600/0x4173739f0fc80763 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4173739f0fc8076a expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996271.365796:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1789996271.365801:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086f88a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+3:11180:x1876946942212480:12345-0@lo:104: Request processed in 50us (773us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996271.365807:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:1.0:1789996271.365827:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789996271.365834:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.137@tcp lock: ffff8e0840031200/0x4173739f0fc80786 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4173739f0fc8078d expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996271.365847:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0840031200 already unused, calling callback (ffffffffc1be0c20) 10000000:00010000:1.0:1789996271.365851:0:5835:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.137@tcp lock: ffff8e0840031200/0x4173739f0fc80786 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x4173739f0fc8078d expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996271.365861:0:5835:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.137@tcp lock: ffff8e0840031200/0x4173739f0fc80786 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x4173739f0fc8078d expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789996271.365867:0:5835:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.137@tcp lock: ffff8e0840031200/0x4173739f0fc80786 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x4173739f0fc8078d expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789996271.365873:0:5835:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789996271.365900:0:5835:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.137@tcp lock: ffff8e0840031200/0x4173739f0fc80786 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4173739f0fc8078d expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996271.365906:0:5835:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789996271.365930:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.137@tcp lock: ffff8e0840031200/0x4173739f0fc80786 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4173739f0fc8078d expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996271.365937:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.137@tcp lock: ffff8e0840031200/0x4173739f0fc80786 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4173739f0fc8078d expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996271.365950:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789996271.365953:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.137@tcp lock: ffff8e0876a23c00/0x4173739f0fc80778 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4173739f0fc8077f expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996271.365959:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0876a23c00 already unused, calling callback (ffffffffc1be0c20) 10000000:00010000:1.0:1789996271.365962:0:5835:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.137@tcp lock: ffff8e0876a23c00/0x4173739f0fc80778 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x4173739f0fc8077f expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996271.365978:0:5835:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.137@tcp lock: ffff8e0876a23c00/0x4173739f0fc80778 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x4173739f0fc8077f expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789996271.365985:0:5835:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.137@tcp lock: ffff8e0876a23c00/0x4173739f0fc80778 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x4173739f0fc8077f expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789996271.365990:0:5835:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789996271.366004:0:5835:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.137@tcp lock: ffff8e0876a23c00/0x4173739f0fc80778 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4173739f0fc8077f expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996271.366009:0:5835:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789996271.366026:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.137@tcp lock: ffff8e0876a23c00/0x4173739f0fc80778 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4173739f0fc8077f expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996271.366032:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.137@tcp lock: ffff8e0876a23c00/0x4173739f0fc80778 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4173739f0fc8077f expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996271.366041:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789996271.366044:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.137@tcp lock: ffff8e0842de4600/0x4173739f0fc80763 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4173739f0fc8076a expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996271.366049:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0842de4600 already unused, calling callback (ffffffffc1be0c20) 10000000:00010000:1.0:1789996271.366053:0:5835:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.137@tcp lock: ffff8e0842de4600/0x4173739f0fc80763 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4173739f0fc8076a expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996271.366060:0:5835:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.137@tcp lock: ffff8e0842de4600/0x4173739f0fc80763 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4173739f0fc8076a expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789996271.366066:0:5835:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.137@tcp lock: ffff8e0842de4600/0x4173739f0fc80763 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4173739f0fc8076a expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789996271.366077:0:5835:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789996271.366092:0:5835:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.137@tcp lock: ffff8e0842de4600/0x4173739f0fc80763 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4173739f0fc8076a expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996271.366098:0:5835:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789996271.366105:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.137@tcp lock: ffff8e0842de4600/0x4173739f0fc80763 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4173739f0fc8076a expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996271.366111:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.137@tcp lock: ffff8e0842de4600/0x4173739f0fc80763 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4173739f0fc8076a expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996271.366124:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789996271.366126:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789996271.366128:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789996271.366135:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789996271.366154:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e087f83b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e0c28cd8-555e-481f-bd03-c3b02aee51c5:3314:1876946942212608:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789996271.366189:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996271.366244:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e087f839500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e0c28cd8-555e-481f-bd03-c3b02aee51c5:3315:1876946942212736:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789996271.366269:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996271.366287:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789996271.366292:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e087f83ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e0c28cd8-555e-481f-bd03-c3b02aee51c5:3315:1876946942212864:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789996271.366309:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996271.366335:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942212608 00000100:00100000:1.0:1789996271.366339:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942212608 00010000:00010000:1.0:1789996271.366360:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e0876a22200/0x4173739f0fc8078d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4173739f0fc80786 expref: 19 pid: 5839 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789996271.366380:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942212736 00000100:00100000:1.0:1789996271.366388:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942212736 00010000:00010000:1.0:1789996271.366402:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e0840030200/0x4173739f0fc8077f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4173739f0fc80778 expref: 20 pid: 5841 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789996271.366413:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942212864 00000100:00100000:1.0:1789996271.366416:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942212864 00010000:00010000:1.0:1789996271.366426:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e0876a23e00/0x4173739f0fc8076a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4173739f0fc80763 expref: 21 pid: 5841 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789996271.366439:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789996271.366445:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0848c1e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+21:3314:x1876946942212608:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789996271.366454:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789996271.366458:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e0876a22200/0x4173739f0fc8078d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4173739f0fc80786 expref: 21 pid: 5839 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996271.366466:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e0876a22200/0x4173739f0fc8078d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4173739f0fc80786 expref: 21 pid: 5839 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996271.366482:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789996271.366514:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0848c1e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+21:3314:x1876946942212608:12345-0@lo:103:ldlm_bl.0 Request processed in 70us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996271.366520:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789996271.367984:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789996271.368497:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e087f839f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e0c28cd8-555e-481f-bd03-c3b02aee51c5+20:3315:x1876946942212736:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789996271.368514:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789996271.368534:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e0840030200/0x4173739f0fc8077f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4173739f0fc80778 expref: 20 pid: 5841 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996271.368569:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e0840030200/0x4173739f0fc8077f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4173739f0fc80778 expref: 20 pid: 5841 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996271.368590:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789996271.368655:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e087f839f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e0c28cd8-555e-481f-bd03-c3b02aee51c5+20:3315:x1876946942212736:12345-0@lo:103:ldlm_bl.0 Request processed in 168us (2384us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996271.373917:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789996271.373939:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e087f838700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e0c28cd8-555e-481f-bd03-c3b02aee51c5+20:3315:x1876946942212864:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789996271.373960:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789996271.373969:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e0876a23e00/0x4173739f0fc8076a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4173739f0fc80763 expref: 20 pid: 5841 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996271.373983:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e0876a23e00/0x4173739f0fc8076a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4173739f0fc80763 expref: 20 pid: 5841 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996271.374022:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789996271.375093:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789996271.375197:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e087f83b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e0c28cd8-555e-481f-bd03-c3b02aee51c5:3314:1876946942212608:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789996271.375238:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e087f839500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e0c28cd8-555e-481f-bd03-c3b02aee51c5:3315:1876946942212736:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789996271.375537:0:11180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e0876a22200/0x4173739f0fc8078d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4173739f0fc80786 expref: 19 pid: 5839 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789996271.375564:0:11180:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086f889c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11180:1876946942212096:0@lo:104: 00010000:00010000:2.0:1789996271.375574:0:11180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e0840030200/0x4173739f0fc8077f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4173739f0fc80778 expref: 18 pid: 5841 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789996271.375583:0:11180:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086f88bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11180:1876946942212224:0@lo:104: 00010000:00010000:2.0:1789996271.375591:0:11180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e0876a23e00/0x4173739f0fc8076a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4173739f0fc80763 expref: 17 pid: 5841 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789996271.375599:0:11180:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086f888a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11180:1876946942212480:0@lo:104: 00000100:00100000:1.0:1789996271.375859:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996271.375867:0:11180:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086f88b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11180:1876946942211968:192.168.204.37@tcp:104: 00000100:00100000:2.0:1789996271.375879:0:11180:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086f888700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11180:1876946942212352:192.168.204.37@tcp:104: 00010000:00010000:2.0:1789996271.375916:0:11180:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8e0842de5e00/0x4173739f0fc807be lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789996271.375948:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1789996271.376046:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927499008 00000100:00100000:1.0:1789996271.376055:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927499008 00010000:00010000:1.0:1789996271.376084:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e0842de5a00/0x4173739f0fc807a2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35460 expref: 13 pid: 5841 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789996271.376108:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927499136 00000100:00100000:1.0:1789996271.376112:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927499136 00010000:00010000:1.0:1789996271.376133:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e0842de5c00/0x4173739f0fc80771 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35428 expref: 14 pid: 5840 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789996271.376156:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 28 00000100:00100000:1.0:1789996271.376165:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 29 00000100:00100000:2.0:1789996271.376168:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e087f83b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f78f7903-47ba-48a7-bb82-1f616cb85fc0+14:2362:x1876946927499008:12345-192.168.204.37@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1789996271.376179:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e087f838e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f78f7903-47ba-48a7-bb82-1f616cb85fc0+14:2362:x1876946927499136:12345-192.168.204.37@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789996271.376182:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789996271.376190:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e0842de5a00/0x4173739f0fc807a2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35460 expref: 14 pid: 5841 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996271.376191:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789996271.376202:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e0842de5c00/0x4173739f0fc80771 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35428 expref: 14 pid: 5840 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996271.376210:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e0842de5a00/0x4173739f0fc807a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35460 expref: 14 pid: 5841 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996271.376224:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e0842de5c00/0x4173739f0fc80771 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35428 expref: 14 pid: 5840 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996271.376480:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e0842de5a00/0x4173739f0fc807a2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35460 expref: 14 pid: 5841 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996271.376486:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e0842de5c00/0x4173739f0fc80771 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35428 expref: 14 pid: 5840 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996271.376495:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8e0842de5e00/0x4173739f0fc807be lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996271.376507:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e0842de5e00/0x4173739f0fc807be lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996271.376515:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789996271.376522:0:5831:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e0842de5e00/0x4173739f0fc807be lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789996271.376528:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e087f838700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e0c28cd8-555e-481f-bd03-c3b02aee51c5+16:3315:x1876946942212864:12345-0@lo:103:ldlm_bl.0 Request processed in 2596us (10213us total) trans 0 rc 0/0 00010000:00010000:2.0:1789996271.376533:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e0842de5e00/0x4173739f0fc807be lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789996271.376562:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:2.0:1789996271.376570:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e0842de5e00/0x4173739f0fc807be lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996271.376578:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e0842de5e00/0x4173739f0fc807be lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789996271.376584:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e087f838e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f78f7903-47ba-48a7-bb82-1f616cb85fc0+12:2362:x1876946927499136:12345-192.168.204.37@tcp:103:ldlm_bl.0 Request processed in 408us (635us total) trans 0 rc 0/0 00010000:00010000:2.0:1789996271.376601:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0842de5e00 already unused, calling callback (ffffffffc1595910) 00000100:00100000:1.0:1789996271.376601:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 29 00010000:00010000:2.0:1789996271.376608:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e0842de5e00/0x4173739f0fc807be lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996271.376619:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e0842de5e00/0x4173739f0fc807be lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996271.376640:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e0842de5e00/0x4173739f0fc807be lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996271.376651:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789996271.376676:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e087f83b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f78f7903-47ba-48a7-bb82-1f616cb85fc0+11:2362:x1876946927499008:12345-192.168.204.37@tcp:103:ldlm_bl.0 Request processed in 512us (821us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996271.376684:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 28 00010000:00010000:3.0:1789996271.377745:0:11180:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8e0842de5e00/0x4173739f0fc807be lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996271.377758:0:11180:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e0842de5e00/0x4173739f0fc807be lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996271.377765:0:11180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e0842de5e00/0x4173739f0fc807be lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789996271.379280:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e087f83ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e0c28cd8-555e-481f-bd03-c3b02aee51c5:3315:1876946942212864:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789996271.592804:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086f888700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876946942212992:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789996271.592877:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789996271.593077:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942212992 00000100:00100000:3.0:1789996271.593086:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942212992 00000100:00100000:3.0:1789996271.593157:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789996271.593167:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e087f838a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876946942212992:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789996271.593203:0:6692:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1789996271.593287:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789996271.593510:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e087f838a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876946942212992:12345-0@lo:13:osp-pre-0-0.0 Request processed in 344us (632us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996271.593519:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:1.0:1789996271.593924:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e086f888700 x1876946942212992/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789996287 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789996271.593945:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086f888700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876946942212992:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789996271.980648:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789996272.431843:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996272.431894:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996272.431924:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927499392 00000100:00100000:2.0:1789996272.431936:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927499392 00000100:00100000:2.0:1789996272.431999:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 79 00000100:00100000:2.0:1789996272.432010:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086f88b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+6:2365:x1876946927499392:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:2.0:1789996272.432087:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086f88b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+6:2365:x1876946927499392:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 79us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996272.432095:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 79 00000100:00100000:2.0:1789996272.433798:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927499264 00000100:00100000:2.0:1789996272.433812:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927499264 00000100:00100000:2.0:1789996272.433874:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 224 00000100:00100000:2.0:1789996272.433884:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852ba3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f78f7903-47ba-48a7-bb82-1f616cb85fc0+11:2365:x1876946927499264:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:2.0:1789996272.433955:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852ba3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f78f7903-47ba-48a7-bb82-1f616cb85fc0+11:2365:x1876946927499264:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 72us (2060us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996272.433962:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 224 00000100:00080000:2.0:1789996272.434001:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789996272.436432:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996272.437103:0:9163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927499520 00000100:00100000:0.0:1789996272.437113:0:9163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927499520 00000100:00100000:0.0:1789996272.437196:0:9163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 80 00000100:00100000:0.0:1789996272.437208:0:9163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086f888a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cfc759a1-09a6-40ba-80a8-7399de51b555+5:2365:x1876946927499520:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:0.0:1789996272.437279:0:9163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086f888a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cfc759a1-09a6-40ba-80a8-7399de51b555+5:2365:x1876946927499520:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 73us (856us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996272.437287:0:9163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 80 00000100:00080000:2.0:1789996272.437450:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789996272.619034:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086f889880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876946942213504:0@lo:400:kworker.0 00000100:00100000:2.0:1789996272.619107:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996272.619172:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789996272.619179:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086f88bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e0c28cd8-555e-481f-bd03-c3b02aee51c5:3313:1876946942213120:0@lo:400:kworker.0 00000100:00100000:2.0:1789996272.619212:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996272.619235:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086f888700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3313:1876946942213632:0@lo:400:kworker.0 00000100:00100000:2.0:1789996272.619269:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996272.619292:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086f888000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3316:1876946942213376:0@lo:400:kworker.0 00000100:00100000:2.0:1789996272.619312:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996272.619329:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1789996272.619335:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086f889c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3316:1876946942213248:0@lo:400:kworker.0 00000100:00100000:2.0:1789996272.619353:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996272.619384:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fa70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876946942213760:0@lo:400:kworker.0 00000100:00100000:2.0:1789996272.619404:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996272.619430:0:8222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942213504 00000100:00100000:2.0:1789996272.619438:0:8222:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942213504 00000100:00100000:2.0:1789996272.619478:0:8222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942213760 00000100:00100000:2.0:1789996272.619481:0:8222:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942213760 00000100:00100000:2.0:1789996272.619509:0:8222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789996272.619517:0:8222:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fa71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1876946942213504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789996272.619593:0:8222:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fa71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1876946942213504:12345-0@lo:400:kworker.0 Request processed in 76us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996272.619600:0:8222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789996272.619617:0:8222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789996272.619623:0:8222:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fa92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3316:x1876946942213760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789996272.619652:0:8222:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fa92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3316:x1876946942213760:12345-0@lo:400:kworker.0 Request processed in 30us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996272.619658:0:8222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789996272.619675:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942213120 00000100:00100000:2.0:1789996272.619678:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942213120 00000100:00100000:2.0:1789996272.619700:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1789996272.619718:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852ba3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0c28cd8-555e-481f-bd03-c3b02aee51c5+16:3313:x1876946942213120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789996272.619747:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852ba3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0c28cd8-555e-481f-bd03-c3b02aee51c5+16:3313:x1876946942213120:12345-0@lo:400:kworker.0 Request processed in 42us (534us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996272.619766:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1789996272.619791:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942213632 00000100:00100000:2.0:1789996272.619795:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942213632 00000100:00100000:2.0:1789996272.619820:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942213376 00000100:00100000:2.0:1789996272.619824:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942213376 00000100:00100000:2.0:1789996272.619836:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942213248 00000100:00100000:2.0:1789996272.619838:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942213248 00000100:00100000:2.0:1789996272.619850:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1789996272.619856:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fa92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876946942213632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789996272.619886:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fa92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876946942213632:12345-0@lo:400:kworker.0 Request processed in 30us (616us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996272.619892:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1789996272.619903:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789996272.619916:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fa91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1876946942213376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789996272.619945:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fa91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1876946942213376:12345-0@lo:400:kworker.0 Request processed in 29us (631us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996272.619951:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789996272.619962:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1789996272.619967:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fa92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1876946942213248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789996272.619991:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fa92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1876946942213248:12345-0@lo:400:kworker.0 Request processed in 24us (638us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996272.619997:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:2.0:1789996272.620025:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789996272.620029:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789996272.620061:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086f889c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3316:1876946942213248:0@lo:400:kworker.0 00010000:00080000:2.0:1789996272.620074:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e086fa70000 x1876946942213760/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789996288 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789996272.620083:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fa70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876946942213760:0@lo:400:kworker.0 00000100:00100000:2.0:1789996272.620092:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086f888000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3316:1876946942213376:0@lo:400:kworker.0 00000100:00100000:2.0:1789996272.620117:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086f88bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e0c28cd8-555e-481f-bd03-c3b02aee51c5:3313:1876946942213120:0@lo:400:kworker.0 00000100:00100000:2.0:1789996272.620126:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086f888700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3313:1876946942213632:0@lo:400:kworker.0 00010000:00080000:2.0:1789996272.620135:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e086f889880 x1876946942213504/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789996288 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789996272.620142:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086f889880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876946942213504:0@lo:400:kworker.0 00000100:00100000:3.0:1789996272.875766:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996272.875895:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927499648 00000100:00100000:0.0:1789996272.875905:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927499648 00000100:00100000:0.0:1789996272.875972:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 226 00000100:00100000:0.0:1789996272.875983:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852ba2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f78f7903-47ba-48a7-bb82-1f616cb85fc0+11:5601:x1876946927499648:12345-192.168.204.37@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789996272.876000:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789996272.876032:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e0840031e00/0x4173739f0fc807c5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b97003095e3548a expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996272.876060:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e0840031e00/0x4173739f0fc807c5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e3548a expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996272.876073:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e0840031e00/0x4173739f0fc807c5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e3548a expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996272.876082:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e0840031e00, rc 0) 00000100:00100000:0.0:1789996272.876147:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852ba2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f78f7903-47ba-48a7-bb82-1f616cb85fc0+12:5601:x1876946927499648:12345-192.168.204.37@tcp:101:ll_cfg_requeue.0 Request processed in 166us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996272.876156:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 226 10000000:01000000:2.0:1789996272.877299:0:5843:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789996272.877304:0:5843:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e0847d01800 from 7 10000000:01000000:2.0:1789996272.877321:0:5843:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789996272.877430:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.137@tcp lock: ffff8e0842de4c00/0x4173739f0fc807cc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996272.877442:0:5843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.137@tcp lock: ffff8e0842de4c00/0x4173739f0fc807cc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996272.877452:0:5843:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.137@tcp lock: ffff8e0842de4c00/0x4173739f0fc807cc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789996272.877476:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fa91500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5843:1876946942213888:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789996272.877530:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996272.878166:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0848997b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789996272.880772:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996272.888249:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942213888 00000100:00100000:1.0:1789996272.888304:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927499776 00000100:00100000:1.0:1789996272.888314:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927499776 00000100:00100000:0.0:1789996272.888331:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942213888 00000100:00100000:0.0:1789996272.888379:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1789996272.888389:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852ba3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0c28cd8-555e-481f-bd03-c3b02aee51c5+16:5843:x1876946942213888:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789996272.888407:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789996272.888427:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e0840031400/0x4173739f0fc807d3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4173739f0fc807cc expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996272.888454:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e0840031400/0x4173739f0fc807d3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4173739f0fc807cc expref: 17 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789996272.888456:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 228 00010000:00010000:0.0:1789996272.888465:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e0840031400/0x4173739f0fc807d3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4173739f0fc807cc expref: 17 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789996272.888466:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852ba1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f78f7903-47ba-48a7-bb82-1f616cb85fc0+12:5601:x1876946927499776:12345-192.168.204.37@tcp:501:ll_cfg_requeue.0 00010000:00010000:0.0:1789996272.888561:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e0840031400, rc 0) 00000100:00100000:0.0:1789996272.888638:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852ba3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0c28cd8-555e-481f-bd03-c3b02aee51c5+17:5843:x1876946942213888:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 251us (11107us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996272.888650:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1789996272.888721:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fa91500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5843:1876946942213888:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789996272.888740:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.137@tcp lock: ffff8e0842de4c00/0x4173739f0fc807cc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc807d3 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996272.888751:0:5843:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.137@tcp lock: ffff8e0842de4c00/0x4173739f0fc807cc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4173739f0fc807d3 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789996272.888826:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e08810a8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5843:1876946942214016:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789996272.888857:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789996272.888867:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852ba1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f78f7903-47ba-48a7-bb82-1f616cb85fc0+12:5601:x1876946927499776:12345-192.168.204.37@tcp:501:ll_cfg_requeue.0 Request processed in 402us (8104us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996272.888884:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 228 00000100:00100000:3.0:1789996272.888903:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942214016 00000100:00100000:3.0:1789996272.888907:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942214016 00000100:00100000:3.0:1789996272.888922:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1789996272.888998:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852ba2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0c28cd8-555e-481f-bd03-c3b02aee51c5+17:5843:x1876946942214016:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789996272.889196:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852ba2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0c28cd8-555e-481f-bd03-c3b02aee51c5+17:5843:x1876946942214016:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 267us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996272.889202:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1789996272.889392:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0852b626c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789996272.889408:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e08810a8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5843:1876946942214016:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789996272.889437:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e08810a8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5843:1876946942214144:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789996272.889487:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996272.889504:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0852b626c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789996272.889520:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942214144 00000100:00100000:0.0:1789996272.889524:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942214144 00000100:00100000:0.0:1789996272.889564:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1789996272.889571:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852b6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0c28cd8-555e-481f-bd03-c3b02aee51c5+17:5843:x1876946942214144:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789996272.889731:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852b6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0c28cd8-555e-481f-bd03-c3b02aee51c5+17:5843:x1876946942214144:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 160us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996272.889738:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1789996272.889776:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e08810a8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5843:1876946942214144:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789996272.890868:0:11212:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1789996272.891003:0:5843:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1789996272.891022:0:5843:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.137@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789996272.891031:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.137@tcp lock: ffff8e0842de4c00/0x4173739f0fc807cc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc807d3 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996272.891043:0:5843:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.137@tcp lock: ffff8e0842de4c00/0x4173739f0fc807cc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc807d3 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789996272.891053:0:5843:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789996272.891055:0:5843:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e0849c2f000 from 7 10000000:01000000:1.0:1789996272.891058:0:5843:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789996272.891088:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.137@tcp lock: ffff8e0876a22400/0x4173739f0fc807da lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996272.891095:0:5843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.137@tcp lock: ffff8e0876a22400/0x4173739f0fc807da lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996272.891104:0:5843:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.137@tcp lock: ffff8e0876a22400/0x4173739f0fc807da lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789996272.891195:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e087f83a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5843:1876946942214272:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789996272.891238:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996272.891271:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0847518600 going to sleep for 11 seconds 00000100:00100000:3.0:1789996272.891318:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942214272 00000100:00100000:3.0:1789996272.891323:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942214272 00000100:00100000:3.0:1789996272.893289:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1789996272.893311:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852b6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0c28cd8-555e-481f-bd03-c3b02aee51c5+17:5843:x1876946942214272:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789996272.893329:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789996272.893348:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e087f856400/0x4173739f0fc807e1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4173739f0fc807da expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996272.893377:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e087f856400/0x4173739f0fc807e1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4173739f0fc807da expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996272.893389:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e087f856400/0x4173739f0fc807e1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4173739f0fc807da expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996272.893398:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e087f856400, rc 0) 00000100:00100000:3.0:1789996272.893479:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852b6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0c28cd8-555e-481f-bd03-c3b02aee51c5+18:5843:x1876946942214272:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 176us (2240us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996272.893486:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1789996272.893613:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e087f83a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5843:1876946942214272:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789996272.893631:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.137@tcp lock: ffff8e0876a22400/0x4173739f0fc807da lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc807e1 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996272.893640:0:5843:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.137@tcp lock: ffff8e0876a22400/0x4173739f0fc807da lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4173739f0fc807e1 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789996272.893720:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e08810a8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5843:1876946942214400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789996272.893753:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996272.894449:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0852b62840 going to sleep for 11 seconds 00000100:00100000:1.0:1789996272.894599:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942214400 00000100:00100000:1.0:1789996272.894607:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942214400 00000100:00100000:1.0:1789996272.894639:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1789996272.894647:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852b6e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+18:5843:x1876946942214400:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789996272.894658:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996272.894782:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927499904 00000100:00100000:2.0:1789996272.894787:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927499904 00000100:00100000:2.0:1789996272.894806:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 233 00000100:00100000:2.0:1789996272.894811:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852b6c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f78f7903-47ba-48a7-bb82-1f616cb85fc0+12:5601:x1876946927499904:12345-192.168.204.37@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789996272.895069:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852b6c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f78f7903-47ba-48a7-bb82-1f616cb85fc0+12:5601:x1876946927499904:12345-192.168.204.37@tcp:503:ll_cfg_requeue.0 Request processed in 256us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996272.895076:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852b6e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+18:5843:x1876946942214400:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 430us (1323us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996272.895077:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 233 00000100:00100000:1.0:1789996272.895082:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1789996272.895312:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e08810a8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5843:1876946942214400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789996272.895354:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e08810a8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5843:1876946942214528:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789996272.895388:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996272.895416:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0852b62840 going to sleep for 11 seconds 00000100:00100000:2.0:1789996272.896388:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942214528 00000100:00100000:2.0:1789996272.896398:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942214528 00000100:00100000:2.0:1789996272.896456:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1789996272.896466:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852b6fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0c28cd8-555e-481f-bd03-c3b02aee51c5+18:5843:x1876946942214528:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789996272.896679:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852b6fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0c28cd8-555e-481f-bd03-c3b02aee51c5+18:5843:x1876946942214528:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 214us (1290us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996272.896687:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1789996272.896900:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e08810a8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5843:1876946942214528:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789996272.898064:0:11213:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1789996272.898853:0:5843:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1789996272.898872:0:5843:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.137@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789996272.898884:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.137@tcp lock: ffff8e0876a22400/0x4173739f0fc807da lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc807e1 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996272.898897:0:5843:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.137@tcp lock: ffff8e0876a22400/0x4173739f0fc807da lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc807e1 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789996272.899220:0:5843:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789996272.899238:0:5843:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e08709bf800 from 7 10000000:01000000:2.0:1789996272.899241:0:5843:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789996272.899363:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.137@tcp lock: ffff8e0842de5200/0x4173739f0fc807e8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996272.899372:0:5843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.137@tcp lock: ffff8e0842de5200/0x4173739f0fc807e8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996272.899382:0:5843:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.137@tcp lock: ffff8e0842de5200/0x4173739f0fc807e8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789996272.899408:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fa91500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5843:1876946942214656:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789996272.899561:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996272.899602:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0848997b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789996272.899649:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942214656 00000100:00100000:3.0:1789996272.899661:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942214656 00000100:00100000:3.0:1789996272.899698:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1789996272.899721:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852b6d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0c28cd8-555e-481f-bd03-c3b02aee51c5+18:5843:x1876946942214656:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789996272.899734:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789996272.899755:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e087f857800/0x4173739f0fc807ef lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4173739f0fc807e8 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996272.899779:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e087f857800/0x4173739f0fc807ef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4173739f0fc807e8 expref: 19 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996272.899788:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e087f857800/0x4173739f0fc807ef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4173739f0fc807e8 expref: 19 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996272.899796:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e087f857800, rc 0) 00000100:00100000:3.0:1789996272.899839:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852b6d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0c28cd8-555e-481f-bd03-c3b02aee51c5+19:5843:x1876946942214656:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 120us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996272.899846:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1789996272.899985:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fa91500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5843:1876946942214656:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789996272.899998:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.137@tcp lock: ffff8e0842de5200/0x4173739f0fc807e8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc807ef expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996272.900007:0:5843:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.137@tcp lock: ffff8e0842de5200/0x4173739f0fc807e8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4173739f0fc807ef expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789996272.900129:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fa91500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5843:1876946942214784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789996272.900157:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996272.900181:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0848997b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789996272.900687:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942214784 00000100:00100000:3.0:1789996272.900695:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942214784 00000100:00100000:3.0:1789996272.900738:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1789996272.900745:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852b6d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0c28cd8-555e-481f-bd03-c3b02aee51c5+19:5843:x1876946942214784:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789996272.901013:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852b6d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0c28cd8-555e-481f-bd03-c3b02aee51c5+19:5843:x1876946942214784:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 268us (854us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996272.901020:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1789996272.901215:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fa91500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5843:1876946942214784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789996272.901255:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e08810a8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5843:1876946942214912:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789996272.901299:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996272.901325:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0852b62600 going to sleep for 11 seconds 00000100:00100000:1.0:1789996272.901370:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942214912 00000100:00100000:1.0:1789996272.901375:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942214912 00000100:00100000:1.0:1789996272.901405:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1789996272.901412:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852b6d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+19:5843:x1876946942214912:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789996272.901584:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852b6d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+19:5843:x1876946942214912:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 172us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996272.901591:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1789996272.901820:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e08810a8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5843:1876946942214912:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789996272.903027:0:11214:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1789996272.903221:0:5843:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1789996272.903241:0:5843:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.137@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789996272.903252:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.137@tcp lock: ffff8e0842de5200/0x4173739f0fc807e8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc807ef expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996272.903264:0:5843:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.137@tcp lock: ffff8e0842de5200/0x4173739f0fc807e8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc807ef expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789996272.905887:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996272.906583:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927500032 00000100:00100000:0.0:1789996272.906816:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927500032 00000100:00100000:0.0:1789996272.906872:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 238 00000100:00100000:0.0:1789996272.906892:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852b6cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f78f7903-47ba-48a7-bb82-1f616cb85fc0+12:5601:x1876946927500032:12345-192.168.204.37@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789996272.906909:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789996272.907051:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e0840031000/0x4173739f0fc807f6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b97003095e35491 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996272.907083:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e0840031000/0x4173739f0fc807f6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35491 expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996272.907094:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e0840031000/0x4173739f0fc807f6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35491 expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996272.907104:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e0840031000, rc 0) 00000100:00100000:0.0:1789996272.907235:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852b6cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f78f7903-47ba-48a7-bb82-1f616cb85fc0+13:5601:x1876946927500032:12345-192.168.204.37@tcp:101:ll_cfg_requeue.0 Request processed in 345us (1357us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996272.907242:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 238 00000100:00100000:0.0:1789996272.909443:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1789996272.909535:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927500160 00000100:00100000:3.0:1789996272.909604:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927500160 00000100:00100000:3.0:1789996272.909656:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 239 00000100:00100000:3.0:1789996272.909665:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852b6f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f78f7903-47ba-48a7-bb82-1f616cb85fc0+13:5601:x1876946927500160:12345-192.168.204.37@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789996272.910258:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852b6f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f78f7903-47ba-48a7-bb82-1f616cb85fc0+13:5601:x1876946927500160:12345-192.168.204.37@tcp:501:ll_cfg_requeue.0 Request processed in 592us (822us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996272.910267:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 239 00000100:00100000:3.0:1789996272.913297:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996272.913404:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927500288 00000100:00100000:0.0:1789996272.913413:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927500288 00000100:00100000:0.0:1789996272.913469:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 240 00000100:00100000:0.0:1789996272.913479:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852b6f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f78f7903-47ba-48a7-bb82-1f616cb85fc0+13:5601:x1876946927500288:12345-192.168.204.37@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789996272.914302:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852b6f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f78f7903-47ba-48a7-bb82-1f616cb85fc0+13:5601:x1876946927500288:12345-192.168.204.37@tcp:503:ll_cfg_requeue.0 Request processed in 819us (1011us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996272.914312:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 240 00010000:00010000:1.0:1789996273.002934:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789996273.131237:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e087f839880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876946942215040:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789996273.134436:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996273.135389:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942215040 00000100:00100000:1.0:1789996273.135400:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942215040 00000100:00100000:1.0:1789996273.135449:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789996273.135472:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e087f838000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1876946942215040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789996273.135511:0:6691:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789996273.136022:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e087f838000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1876946942215040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 551us (1593us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996273.136030:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:1.0:1789996273.136264:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e087f839880 x1876946942215040/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789996289 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789996273.136288:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e087f839880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876946942215040:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789996274.026459:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789996275.048746:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789996275.711265:0:11378:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg437-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1789996276.072763:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789996276.713724:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fa91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876946942215168:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789996276.713794:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996276.713997:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942215168 00000100:00100000:1.0:1789996276.714005:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942215168 00000100:00100000:1.0:1789996276.714074:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789996276.714083:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e08810a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876946942215168:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789996276.714118:0:6691:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789996276.714172:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e08810a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876946942215168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996276.714179:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:0.0:1789996276.714264:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e086fa91500 x1876946942215168/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789996292 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789996276.714304:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fa91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876946942215168:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789996276.714334:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789996277.103027:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789996277.551365:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996277.551416:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996277.551449:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996277.551534:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927500672 00000100:00100000:2.0:1789996277.551577:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927500672 00000100:00100000:2.0:1789996277.551656:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927500544 00000100:00100000:2.0:1789996277.551661:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927500544 00000100:00100000:2.0:1789996277.551687:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 84 00000100:00100000:2.0:1789996277.551699:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0846264e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cfc759a1-09a6-40ba-80a8-7399de51b555+5:2365:x1876946927500672:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:0.0:1789996277.551734:0:9163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 85 00000100:00100000:0.0:1789996277.551745:0:9163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0846264a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+6:2365:x1876946927500544:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:1.0:1789996277.551812:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927500416 00000100:00100000:0.0:1789996277.551813:0:9163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0846264a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+6:2365:x1876946927500544:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 69us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996277.551819:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0846264e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cfc759a1-09a6-40ba-80a8-7399de51b555+5:2365:x1876946927500672:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 120us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996277.551819:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927500416 00000100:00100000:0.0:1789996277.551828:0:9163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 85 00000100:00100000:2.0:1789996277.551847:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 84 00000100:00100000:1.0:1789996277.551861:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 241 00000100:00100000:1.0:1789996277.551871:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852b6e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f78f7903-47ba-48a7-bb82-1f616cb85fc0+13:2365:x1876946927500416:12345-192.168.204.37@tcp:400:kworker.0 00000100:00080000:2.0:1789996277.551877:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789996277.551903:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852b6e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f78f7903-47ba-48a7-bb82-1f616cb85fc0+13:2365:x1876946927500416:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 33us (548us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996277.551923:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 241 00000100:00100000:1.0:1789996277.737435:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fa91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e0c28cd8-555e-481f-bd03-c3b02aee51c5:3314:1876946942215296:0@lo:400:kworker.0 00000100:00100000:1.0:1789996277.737500:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996277.737534:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942215296 00000100:00100000:2.0:1789996277.737555:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942215296 00000100:00100000:1.0:1789996277.737566:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086f88bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3314:1876946942215808:0@lo:400:kworker.0 00000100:00100000:1.0:1789996277.737594:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996277.737598:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1789996277.737620:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852b6f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+19:3314:x1876946942215296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789996277.737635:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789996277.737643:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086f888700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876946942215680:0@lo:400:kworker.0 00000100:00100000:2.0:1789996277.737673:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852b6f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+19:3314:x1876946942215296:12345-0@lo:400:kworker.0 Request processed in 68us (173us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996277.737679:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996277.737685:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1789996277.737728:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fa91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e0c28cd8-555e-481f-bd03-c3b02aee51c5:3314:1876946942215296:0@lo:400:kworker.0 00000100:00100000:1.0:1789996277.737752:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fa70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876946942215424:0@lo:400:kworker.0 00000100:00100000:1.0:1789996277.737772:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996277.737794:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086f888000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876946942215936:0@lo:400:kworker.0 00000100:00100000:1.0:1789996277.737809:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996277.737824:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789996277.737829:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086f889880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1876946942215552:0@lo:400:kworker.0 00000100:00100000:1.0:1789996277.737855:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996277.737881:0:9163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942215808 00000100:00100000:1.0:1789996277.737885:0:9163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942215808 00000100:00100000:1.0:1789996277.737912:0:9163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942215424 00000100:00100000:1.0:1789996277.737914:0:9163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942215424 00000100:00100000:1.0:1789996277.737923:0:9163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942215552 00000100:00100000:1.0:1789996277.737924:0:9163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942215552 00000100:00100000:1.0:1789996277.737935:0:9163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1789996277.737941:0:9163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e087f839880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876946942215808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789996277.737983:0:9163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e087f839880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876946942215808:12345-0@lo:400:kworker.0 Request processed in 42us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996277.737996:0:9163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1789996277.738008:0:9163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1789996277.738013:0:9163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e087f839c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876946942215424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789996277.738038:0:9163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e087f839c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876946942215424:12345-0@lo:400:kworker.0 Request processed in 25us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996277.738043:0:9163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1789996277.738051:0:9163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1789996277.738056:0:9163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e087f83a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876946942215552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789996277.738074:0:9163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e087f83a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876946942215552:12345-0@lo:400:kworker.0 Request processed in 19us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996277.738079:0:9163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1789996277.738093:0:8222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942215680 00000100:00100000:1.0:1789996277.738096:0:8222:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942215680 00000100:00100000:1.0:1789996277.738113:0:8222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942215936 00000100:00100000:1.0:1789996277.738115:0:8222:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942215936 00000100:00100000:1.0:1789996277.738130:0:8222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789996277.738135:0:8222:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e087f83a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1876946942215680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789996277.738157:0:8222:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e087f83a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1876946942215680:12345-0@lo:400:kworker.0 Request processed in 22us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996277.738162:0:8222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789996277.738182:0:8222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789996277.738187:0:8222:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e087f83b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1876946942215936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789996277.738208:0:8222:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e087f83b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1876946942215936:12345-0@lo:400:kworker.0 Request processed in 22us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996277.738213:0:8222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:1.0:1789996277.738237:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789996277.738241:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789996277.738264:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086f889880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1876946942215552:0@lo:400:kworker.0 00000100:00100000:1.0:1789996277.738271:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fa70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876946942215424:0@lo:400:kworker.0 00010000:00080000:1.0:1789996277.738280:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e086f888000 x1876946942215936/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789996293 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789996277.738290:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086f888000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876946942215936:0@lo:400:kworker.0 00010000:00080000:1.0:1789996277.738310:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e086f888700 x1876946942215680/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789996293 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789996277.738318:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086f888700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876946942215680:0@lo:400:kworker.0 00000100:00100000:1.0:1789996277.738325:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086f88bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3314:1876946942215808:0@lo:400:kworker.0 00010000:00010000:1.0:1789996278.121935:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789996278.250392:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789996278.250423:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e087f83ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876946942216064:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789996278.250504:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996278.250624:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942216064 00000100:00100000:0.0:1789996278.250635:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942216064 00000100:00100000:0.0:1789996278.250700:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789996278.250709:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0846265180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876946942216064:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789996278.251522:0:6691:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789996278.251630:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0846265180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876946942216064:12345-0@lo:13:osp-pre-1-0.0 Request processed in 920us (1124us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996278.251639:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:0.0:1789996278.253794:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e087f83ad80 x1876946942216064/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789996294 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789996278.253820:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e087f83ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876946942216064:0@lo:13:osp-pre-1-0.0 00000001:02000400:2.0:1789996278.920444:0:11478:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 09:11:18 (1789996278) === 00010000:00010000:0.0:1789996279.145931:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789996279.216378:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1789996279.216428:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996279.216536:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927500928 00000100:00100000:2.0:1789996279.216598:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927500928 00000100:00100000:2.0:1789996279.216651:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 0 00000100:00100000:2.0:1789996279.216662:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fdeb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+6:9679:x1876946927500928:12345-192.168.204.37@tcp:700:mkdir.0 00000100:00100000:2.0:1789996279.216736:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fdeb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+6:9679:x1876946927500928:12345-192.168.204.37@tcp:700:mkdir.0 Request processed in 76us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996279.216744:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 0 00000100:00100000:1.0:1789996279.216855:0:9163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927500800 00000100:00100000:1.0:1789996279.216859:0:9163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927500800 00000100:00100000:1.0:1789996279.216892:0:9163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 14 00000100:00100000:1.0:1789996279.216898:0:9163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fde8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+6:2364:x1876946927500800:12345-192.168.204.37@tcp:41:mkdir.0 00000004:00000024:1.0:1789996279.216927:0:9163:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1789996279.216972:0:9163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fde8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+6:2364:x1876946927500800:12345-192.168.204.37@tcp:41:mkdir.0 Request processed in 74us (604us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996279.216978:0:9163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 14 00000100:00080000:3.0:1789996279.217144:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789996279.219238:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1789996279.219329:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927501184 00000100:00100000:1.0:1789996279.219339:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927501184 00000100:00100000:1.0:1789996279.219390:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 15 00000100:00100000:1.0:1789996279.219399:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fde9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+6:9679:x1876946927501184:12345-192.168.204.37@tcp:36:mkdir.0 00010000:00010000:1.0:1789996279.219452:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789996279.219514:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0841524e00/0x4173739f0fc806de lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35413 expref: 6 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996279.219535:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e0846583100) 00010000:00010000:1.0:1789996279.219728:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789996279.220009:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23800/0x4173739f0fc807fd lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996279.220023:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23800/0x4173739f0fc807fd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996279.220044:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23800/0x4173739f0fc807fd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996279.220070:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23400/0x4173739f0fc80804 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996279.220078:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23400/0x4173739f0fc80804 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996279.220084:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23400/0x4173739f0fc80804 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789996279.221157:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1789996279.221170:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23800/0x4173739f0fc807fd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996279.221190:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23800/0x4173739f0fc807fd lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996279.221197:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23800/0x4173739f0fc807fd lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996279.221203:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0876a23800 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:1.0:1789996279.221207:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23800/0x4173739f0fc807fd lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996279.221215:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23800/0x4173739f0fc807fd lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996279.221227:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e0861fcf800) 00010000:00010000:1.0:1789996279.221230:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789996279.221234:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23800/0x4173739f0fc807fd lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996279.221241:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23800/0x4173739f0fc807fd lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789996279.221258:0:5847:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000674dc154 reply state 000000009941e83c transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23400/0x4173739f0fc80804 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789996279.221267:0:5847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789996279.221355:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fde9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+7:9679:x1876946927501184:12345-192.168.204.37@tcp:36:mkdir.0 Request processed in 1954us (2122us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1789996279.221363:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 15 00010000:00010000:3.0:1789996279.224963:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23400/0x4173739f0fc80804 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996279.224982:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23400/0x4173739f0fc80804 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996279.224991:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23400/0x4173739f0fc80804 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996279.224997:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0876a23400 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:3.0:1789996279.225002:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23400/0x4173739f0fc80804 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996279.225010:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23400/0x4173739f0fc80804 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996279.225038:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8e0861fcf000) 00010000:00010000:3.0:1789996279.225042:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789996279.225047:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23400/0x4173739f0fc80804 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996279.225055:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23400/0x4173739f0fc80804 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789996279.232802:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1789996279.233294:0:9163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927501312 00000100:00100000:1.0:1789996279.233305:0:9163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927501312 00000100:00100000:1.0:1789996279.233501:0:9163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 16 00000100:00100000:1.0:1789996279.233513:0:9163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fdebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+6:9680:x1876946927501312:12345-192.168.204.37@tcp:101:chmod.0 00010000:00010000:1.0:1789996279.233535:0:9163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789996279.233609:0:9163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22200/0x4173739f0fc8080b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b97003095e35498 expref: -99 pid: 9163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996279.233685:0:9163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23e00/0x4173739f0fc80812 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996279.233699:0:9163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23e00/0x4173739f0fc80812 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996279.233711:0:9163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23e00/0x4173739f0fc80812 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789996279.233743:0:9163:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789996279.233752:0:9163:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789996279.233789:0:9163:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23e00/0x4173739f0fc80812 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996279.233827:0:9163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22200/0x4173739f0fc8080b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35498 expref: 8 pid: 9163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996279.233845:0:9163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23e00/0x4173739f0fc80812 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35498 expref: 7 pid: 9163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996279.233853:0:9163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e0861fcf100) 00010000:00010000:1.0:1789996279.233855:0:9163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789996279.233859:0:9163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e0876a23e00, rc 0) 00000100:00100000:1.0:1789996279.233950:0:9163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fdebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+7:9680:x1876946927501312:12345-192.168.204.37@tcp:101:chmod.0 Request processed in 440us (1154us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996279.233966:0:9163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 16 00000100:00100000:0.0:1789996279.237084:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996279.237144:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927501568 00000100:00100000:2.0:1789996279.237154:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927501568 00000100:00100000:2.0:1789996279.237209:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 17 00000100:00100000:2.0:1789996279.237230:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0846267100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+7:9680:x1876946927501568:12345-192.168.204.37@tcp:36:chmod.0 00010000:00010000:2.0:1789996279.237291:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789996279.237317:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23e00/0x4173739f0fc80812 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35498 expref: 7 pid: 9163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996279.237335:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e0861fcf100) 00010000:00010000:2.0:1789996279.237346:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789996279.237368:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4200/0x4173739f0fc80819 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996279.237381:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4200/0x4173739f0fc80819 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996279.237397:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4200/0x4173739f0fc80819 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789996279.237749:0:5846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000737feba8 reply state 000000008f23b678 transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4200/0x4173739f0fc80819 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789996279.237758:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789996279.237765:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1789996279.237858:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0846267100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+8:9680:x1876946927501568:12345-192.168.204.37@tcp:36:chmod.0 Request processed in 629us (784us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1789996279.237866:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 17 00010000:00010000:1.0:1789996279.240386:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4200/0x4173739f0fc80819 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996279.240402:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4200/0x4173739f0fc80819 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996279.240410:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4200/0x4173739f0fc80819 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996279.240417:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0842de4200 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:1.0:1789996279.240435:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4200/0x4173739f0fc80819 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996279.240443:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4200/0x4173739f0fc80819 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996279.240458:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e084601bf00) 00010000:00010000:1.0:1789996279.240461:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789996279.240467:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4200/0x4173739f0fc80819 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996279.240473:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4200/0x4173739f0fc80819 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789996279.283279:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996279.283786:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927501696 00000100:00100000:2.0:1789996279.283796:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927501696 00000100:00100000:2.0:1789996279.283857:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 18 00000100:00100000:2.0:1789996279.283867:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0846265f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+7:9681:x1876946927501696:12345-192.168.204.37@tcp:101:chown.0 00010000:00010000:2.0:1789996279.283889:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789996279.283923:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5800/0x4173739f0fc80820 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b97003095e3549f expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996279.284197:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5400/0x4173739f0fc80827 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996279.284211:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5400/0x4173739f0fc80827 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996279.284224:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5400/0x4173739f0fc80827 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789996279.284256:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789996279.284260:0:5848:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789996279.284298:0:5848:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5400/0x4173739f0fc80827 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996279.284324:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5800/0x4173739f0fc80820 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e3549f expref: 9 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996279.284341:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5400/0x4173739f0fc80827 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e3549f expref: 8 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996279.284349:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e084601bc00) 00010000:00010000:2.0:1789996279.284351:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789996279.284355:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e0842de5400, rc 0) 00000100:00100000:2.0:1789996279.284458:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0846265f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+8:9681:x1876946927501696:12345-192.168.204.37@tcp:101:chown.0 Request processed in 591us (1527us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996279.284465:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 18 00000100:00100000:3.0:1789996279.289211:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1789996279.289585:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927501824 00000100:00100000:1.0:1789996279.289596:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927501824 00000100:00100000:1.0:1789996279.289673:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 19 00000100:00100000:1.0:1789996279.289683:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fde9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+8:9681:x1876946927501824:12345-192.168.204.37@tcp:101:chown.0 00010000:00010000:1.0:1789996279.289704:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789996279.289738:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23800/0x4173739f0fc8082e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b97003095e354a6 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996279.289804:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23c00/0x4173739f0fc80835 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996279.289819:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23c00/0x4173739f0fc80835 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996279.289830:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23c00/0x4173739f0fc80835 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996279.289846:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23a00/0x4173739f0fc8083c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996279.289854:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23a00/0x4173739f0fc8083c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996279.289860:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23a00/0x4173739f0fc8083c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996279.290393:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22a00/0x4173739f0fc80843 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996279.290403:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22a00/0x4173739f0fc80843 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996279.290411:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22a00/0x4173739f0fc80843 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789996279.290438:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789996279.290443:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789996279.290462:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22a00/0x4173739f0fc80843 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996279.291035:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23c00/0x4173739f0fc80835 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996279.291043:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23c00/0x4173739f0fc80835 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996279.291052:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23c00/0x4173739f0fc80835 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996279.291059:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0876a23c00 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:1.0:1789996279.291063:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23c00/0x4173739f0fc80835 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996279.291071:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23c00/0x4173739f0fc80835 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996279.291086:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e084601bc00) 00010000:00010000:1.0:1789996279.291089:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789996279.291094:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23c00/0x4173739f0fc80835 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996279.291101:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23c00/0x4173739f0fc80835 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996279.291116:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23a00/0x4173739f0fc8083c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996279.291123:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23a00/0x4173739f0fc8083c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996279.291129:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23a00/0x4173739f0fc8083c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996279.291143:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0876a23a00 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:1.0:1789996279.291146:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23a00/0x4173739f0fc8083c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996279.291152:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23a00/0x4173739f0fc8083c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996279.291161:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8e0861fcf800) 00010000:00010000:1.0:1789996279.291168:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789996279.291171:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23a00/0x4173739f0fc8083c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996279.291177:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23a00/0x4173739f0fc8083c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996279.291221:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23800/0x4173739f0fc8082e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e354a6 expref: 10 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996279.291235:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22a00/0x4173739f0fc80843 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e354a6 expref: 9 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996279.291243:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8e0861fcf500) 00010000:00010000:1.0:1789996279.291245:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789996279.291247:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e0876a22a00, rc 0) 00000100:00100000:1.0:1789996279.293063:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fde9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+9:9681:x1876946927501824:12345-192.168.204.37@tcp:101:chown.0 Request processed in 3371us (3851us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996279.293076:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 19 00000100:00100000:0.0:1789996279.297423:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1789996279.297524:0:9163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927502080 00000100:00100000:1.0:1789996279.297539:0:9163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927502080 00000100:00100000:1.0:1789996279.297642:0:9163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 20 00000100:00100000:1.0:1789996279.297654:0:9163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0846266a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+9:9681:x1876946927502080:12345-192.168.204.37@tcp:36:chown.0 00010000:00010000:1.0:1789996279.297707:0:9163:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789996279.297733:0:9163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22a00/0x4173739f0fc80843 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e354a6 expref: 9 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996279.297750:0:9163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8e0861fcf500) 00010000:00010000:1.0:1789996279.297761:0:9163:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789996279.297784:0:9163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22c00/0x4173739f0fc8084a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996279.297797:0:9163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22c00/0x4173739f0fc8084a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996279.297808:0:9163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22c00/0x4173739f0fc8084a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789996279.350165:0:9163:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000042dd0bfc reply state 00000000b1ba7c79 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22c00/0x4173739f0fc8084a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789996279.350184:0:9163:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1789996279.350198:0:9163:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1789996279.350314:0:9163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0846266a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+10:9681:x1876946927502080:12345-192.168.204.37@tcp:36:chown.0 Request processed in 52659us (52897us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1789996279.350324:0:9163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 20 00000001:00080000:2.0:1789996279.352141:0:5868:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00010000:00010000:1.0:1789996279.352388:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22c00/0x4173739f0fc8084a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996279.352400:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22c00/0x4173739f0fc8084a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996279.352408:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22c00/0x4173739f0fc8084a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996279.352414:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0876a22c00 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:1.0:1789996279.352418:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22c00/0x4173739f0fc8084a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996279.352435:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22c00/0x4173739f0fc8084a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996279.352451:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8e0861fcf200) 00010000:00010000:1.0:1789996279.352454:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789996279.352459:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22c00/0x4173739f0fc8084a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996279.352465:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22c00/0x4173739f0fc8084a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789996279.392284:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996279.392791:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927502208 00000100:00100000:0.0:1789996279.392803:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927502208 00000100:00100000:0.0:1789996279.392914:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 21 00000100:00100000:0.0:1789996279.392924:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086f889c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+6:9682:x1876946927502208:12345-192.168.204.37@tcp:101:touch.500 00010000:00010000:0.0:1789996279.392954:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789996279.392979:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0840030200/0x4173739f0fc80851 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b97003095e354ad expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789996279.396413:0:5846:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 3377us 00010000:00010000:3.0:1789996279.421381:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856600/0x4173739f0fc80858 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996279.421404:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856600/0x4173739f0fc80858 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996279.421415:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856600/0x4173739f0fc80858 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996279.421431:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857c00/0x4173739f0fc8085f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996279.421439:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857c00/0x4173739f0fc8085f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996279.421446:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857c00/0x4173739f0fc8085f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996279.421777:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856200/0x4173739f0fc80866 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996279.421786:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856200/0x4173739f0fc80866 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996279.421793:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856200/0x4173739f0fc80866 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789996279.421814:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789996279.421818:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789996279.421876:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856200/0x4173739f0fc80866 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996279.421888:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856600/0x4173739f0fc80858 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996279.421895:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856600/0x4173739f0fc80858 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996279.421903:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856600/0x4173739f0fc80858 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996279.421909:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e087f856600 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:3.0:1789996279.421913:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856600/0x4173739f0fc80858 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996279.421920:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856600/0x4173739f0fc80858 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996279.421932:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e084601bc00) 00010000:00010000:3.0:1789996279.421936:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789996279.421941:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856600/0x4173739f0fc80858 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996279.421946:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856600/0x4173739f0fc80858 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996279.421956:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857c00/0x4173739f0fc8085f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996279.421962:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857c00/0x4173739f0fc8085f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996279.421978:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857c00/0x4173739f0fc8085f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996279.421983:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e087f857c00 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:3.0:1789996279.421986:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857c00/0x4173739f0fc8085f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996279.421993:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857c00/0x4173739f0fc8085f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996279.422001:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8e0846583600) 00010000:00010000:3.0:1789996279.422004:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789996279.422007:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857c00/0x4173739f0fc8085f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996279.422012:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857c00/0x4173739f0fc8085f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996279.422050:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0840030200/0x4173739f0fc80851 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e354ad expref: 8 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996279.422066:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856200/0x4173739f0fc80866 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e354ad expref: 7 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996279.422072:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8e0846583a00) 00010000:00010000:3.0:1789996279.422074:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789996279.422077:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e087f856200, rc 0) 00000100:00100000:3.0:1789996279.422151:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086f889c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+7:9682:x1876946927502208:12345-192.168.204.37@tcp:101:touch.500 Request processed in 29228us (29875us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996279.422169:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 21 00000100:00100000:0.0:1789996279.462874:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996279.463066:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927502464 00000100:00100000:2.0:1789996279.463077:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927502464 00000100:00100000:2.0:1789996279.463216:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 22 00000100:00100000:2.0:1789996279.463227:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0846266680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+7:9682:x1876946927502464:12345-192.168.204.37@tcp:101:touch.500 00010000:00010000:2.0:1789996279.463259:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789996279.463280:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5800/0x4173739f0fc8086d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b97003095e354b4 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996279.463737:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4200/0x4173739f0fc80874 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996279.463752:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4200/0x4173739f0fc80874 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996279.463764:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4200/0x4173739f0fc80874 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996279.463779:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4600/0x4173739f0fc8087b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996279.463786:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4600/0x4173739f0fc8087b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996279.463793:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4600/0x4173739f0fc8087b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789996279.465175:0:5848:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:2.0:1789996279.465472:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5c00/0x4173739f0fc80882 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996279.465493:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5c00/0x4173739f0fc80882 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996279.465505:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5c00/0x4173739f0fc80882 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996279.465599:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4200/0x4173739f0fc80874 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996279.465607:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4200/0x4173739f0fc80874 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996279.465615:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4200/0x4173739f0fc80874 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996279.465621:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0842de4200 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:2.0:1789996279.465626:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4200/0x4173739f0fc80874 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996279.465633:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4200/0x4173739f0fc80874 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996279.465646:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8e0846583a00) 00010000:00010000:2.0:1789996279.465649:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789996279.465653:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4200/0x4173739f0fc80874 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996279.465660:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4200/0x4173739f0fc80874 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789996279.465673:0:5848:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fcf86a18 reply state 00000000cd26c149 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4600/0x4173739f0fc8087b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789996279.465687:0:5848:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789996279.465725:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5800/0x4173739f0fc8086d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e354b4 expref: 10 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996279.465741:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5c00/0x4173739f0fc80882 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e354b4 expref: 9 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996279.465748:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8e084601b200) 00010000:00010000:2.0:1789996279.465750:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789996279.465753:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e0842de5c00, rc 0) 00000100:00100000:2.0:1789996279.465835:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0846266680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+10:9682:x1876946927502464:12345-192.168.204.37@tcp:101:touch.500 Request processed in 2610us (2971us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1789996279.465843:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 22 00010000:00010000:1.0:1789996279.470090:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4600/0x4173739f0fc8087b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996279.470109:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4600/0x4173739f0fc8087b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996279.470117:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4600/0x4173739f0fc8087b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996279.470123:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0842de4600 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:1.0:1789996279.470128:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4600/0x4173739f0fc8087b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996279.470136:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4600/0x4173739f0fc8087b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996279.470152:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x6fc107fe (ffff8e084601b400) 00010000:00010000:1.0:1789996279.470155:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789996279.470161:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4600/0x4173739f0fc8087b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996279.470187:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4600/0x4173739f0fc8087b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789996279.474630:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1789996279.474735:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927502720 00000100:00100000:1.0:1789996279.474747:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927502720 00000100:00100000:1.0:1789996279.474809:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 23 00000100:00100000:1.0:1789996279.474819:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0846264000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+9:9682:x1876946927502720:12345-192.168.204.37@tcp:36:touch.500 00010000:00010000:1.0:1789996279.474876:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789996279.474902:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5c00/0x4173739f0fc80882 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e354b4 expref: 9 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996279.474922:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8e084601b200) 00010000:00010000:1.0:1789996279.474935:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789996279.474977:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22c00/0x4173739f0fc80890 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996279.474990:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22c00/0x4173739f0fc80890 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996279.475001:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22c00/0x4173739f0fc80890 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789996279.475158:0:5847:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000054cbf667 reply state 00000000b48d6eb1 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22c00/0x4173739f0fc80890 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789996279.475168:0:5847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789996279.475263:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0846264000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+10:9682:x1876946927502720:12345-192.168.204.37@tcp:36:touch.500 Request processed in 445us (646us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1789996279.475271:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 23 00010000:00010000:1.0:1789996279.477340:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22c00/0x4173739f0fc80890 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996279.477366:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22c00/0x4173739f0fc80890 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996279.477375:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22c00/0x4173739f0fc80890 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996279.477381:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0876a22c00 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:1.0:1789996279.477386:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22c00/0x4173739f0fc80890 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996279.477401:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22c00/0x4173739f0fc80890 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996279.477415:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8e0861fcf200) 00010000:00010000:1.0:1789996279.477417:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789996279.477422:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22c00/0x4173739f0fc80890 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996279.477427:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22c00/0x4173739f0fc80890 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789996279.478699:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1789996279.479641:0:9163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927502848 00000100:00100000:1.0:1789996279.479653:0:9163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927502848 00000100:00100000:1.0:1789996279.479712:0:9163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 24 00000100:00100000:1.0:1789996279.479723:0:9163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0741834e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+9:9682:x1876946927502848:12345-192.168.204.37@tcp:101:touch.500 00010000:00010000:1.0:1789996279.479747:0:9163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789996279.479769:0:9163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23800/0x4173739f0fc80897 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b97003095e354bb expref: -99 pid: 9163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996279.480390:0:9163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23800/0x4173739f0fc80897 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e354bb expref: 10 pid: 9163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996279.480404:0:9163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23800/0x4173739f0fc80897 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e354bb expref: 10 pid: 9163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996279.480423:0:9163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8e0861fcf500) 00010000:00010000:1.0:1789996279.480425:0:9163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789996279.480429:0:9163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e0876a23800, rc 0) 00000100:00100000:1.0:1789996279.480493:0:9163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0741834e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+10:9682:x1876946927502848:12345-192.168.204.37@tcp:101:touch.500 Request processed in 772us (1802us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996279.480501:0:9163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 24 00000100:00100000:0.0:1789996279.483974:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1789996279.484247:0:8222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927502976 00000100:00100000:1.0:1789996279.484258:0:8222:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927502976 00000100:00100000:1.0:1789996279.484311:0:8222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 16 00000100:00100000:1.0:1789996279.484320:0:8222:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0741837b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2361:x1876946927502976:12345-192.168.204.37@tcp:8:touch.500 00010000:00080000:1.0:1789996279.484355:0:8222:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 189efa8a-c7eb-4b69-9afa-1dd36d6775f1@192.168.204.37@tcp t0 exp 0000000000000000 cur 321 last 0 00000020:00000080:1.0:1789996279.484394:0:8222:0:(genops.c:1384:class_connect()) connect: client 189efa8a-c7eb-4b69-9afa-1dd36d6775f1, cookie 0x4173739f0fc8089e 00002000:00100000:1.0:1789996279.484406:0:8222:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 189efa8a-c7eb-4b69-9afa-1dd36d6775f1/ffff8e087f8ef000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a3f ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789996279.484430:0:8222:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789996279.484738:0:8222:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789996279.484772:0:8222:0:(import.c:65:import_set_state_nolock()) ffff8e087f8ef800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789996279.484848:0:8222:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0741837b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+6:2361:x1876946927502976:12345-192.168.204.37@tcp:8:touch.500 Request processed in 527us (885us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996279.484876:0:8222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 16 00000100:00100000:3.0:1789996279.488523:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1789996279.488858:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927503104 00000100:00100000:1.0:1789996279.488868:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927503104 00000100:00100000:1.0:1789996279.488949:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 17 00000100:00100000:1.0:1789996279.488959:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fdeb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+6:0:x1876946927503104:12345-192.168.204.37@tcp:2:touch.500 00000100:00080000:3.0:1789996279.489525:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:2.0:1789996279.535404:0:7659:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00100000:2.0:1789996279.535430:0:7659:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 189efa8a-c7eb-4b69-9afa-1dd36d6775f1 00000100:00100000:1.0:1789996279.535668:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fdeb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+5:0:x1876946927503104:12345-192.168.204.37@tcp:2:touch.500 Request processed in 46705us (47149us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1789996279.535688:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 17 00000100:00100000:0.0:1789996279.539802:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1789996279.540038:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927503360 00000100:00100000:1.0:1789996279.540049:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927503360 00000100:00100000:1.0:1789996279.540135:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 2 00000100:00100000:1.0:1789996279.540145:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0741836a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+10:9682:x1876946927503360:12345-192.168.204.37@tcp:35:touch.500 00000100:00100000:1.0:1789996279.540501:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0741836a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+11:9682:x1876946927503360:12345-192.168.204.37@tcp:35:touch.500 Request processed in 357us (708us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1789996279.540508:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 2 00000100:00100000:0.0:1789996279.557991:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1789996279.558280:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927503488 00000100:00100000:3.0:1789996279.558291:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927503488 00000100:00100000:3.0:1789996279.558356:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 25 00000100:00100000:3.0:1789996279.558367:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0741836680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+11:9683:x1876946927503488:12345-192.168.204.37@tcp:101:rm.0 00010000:00010000:3.0:1789996279.558391:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789996279.558411:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857c00/0x4173739f0fc808a5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b97003095e354c2 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996279.558472:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856600/0x4173739f0fc808ac lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996279.558487:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856600/0x4173739f0fc808ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996279.558500:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856600/0x4173739f0fc808ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789996279.558534:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789996279.558539:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789996279.558684:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856600/0x4173739f0fc808ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996279.558714:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857c00/0x4173739f0fc808a5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e354c2 expref: 13 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996279.558735:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856600/0x4173739f0fc808ac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e354c2 expref: 12 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996279.558757:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8e0846583a00) 00010000:00010000:3.0:1789996279.558760:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789996279.558764:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e087f856600, rc 0) 00000100:00100000:3.0:1789996279.558816:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0741836680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+12:9683:x1876946927503488:12345-192.168.204.37@tcp:101:rm.0 Request processed in 450us (834us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996279.558823:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 25 00000100:00100000:3.0:1789996279.562636:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996279.565762:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927503744 00000100:00100000:2.0:1789996279.565780:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927503744 00000100:00100000:0.0:1789996279.566131:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 26 00000100:00100000:0.0:1789996279.566142:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fdeb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+12:9683:x1876946927503744:12345-192.168.204.37@tcp:101:rm.0 00010000:00010000:0.0:1789996279.566161:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789996279.566181:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0840031200/0x4173739f0fc808b3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b97003095e354c9 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789996279.566282:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1789996279.566429:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0840031200/0x4173739f0fc808b3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e354c9 expref: 14 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996279.566443:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e084601bc00) 00010000:00010000:0.0:1789996279.566446:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789996279.566452:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0840031200/0x4173739f0fc808b3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e354c9 expref: 14 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996279.566466:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e0840031200, rc 0) 00000100:00100000:0.0:1789996279.566596:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fdeb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+13:9683:x1876946927503744:12345-192.168.204.37@tcp:101:rm.0 Request processed in 400us (3915us total) trans 4294967303 rc 301/301 00000100:00100000:0.0:1789996279.566605:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 26 00000100:00100000:0.0:1789996279.572644:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1789996279.572887:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927503872 00000100:00100000:3.0:1789996279.572898:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927503872 00000100:00100000:3.0:1789996279.572948:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 3 00000100:00100000:1.0:1789996279.572955:0:5850:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 2 min 2 max 80 00000100:00100000:3.0:1789996279.572962:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0741837480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+13:9683:x1876946927503872:12345-192.168.204.37@tcp:37:rm.0 00000100:00100000:1.0:1789996279.572970:0:5850:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_002' 00000100:00100000:0.0:1789996279.577623:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0741837480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+13:9683:x1876946927503872:12345-192.168.204.37@tcp:37:rm.0 Request processed in 4653us (4979us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996279.577642:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 3 00000100:00100000:2.0:1789996279.583899:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1789996279.584008:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927504128 00000100:00100000:1.0:1789996279.584027:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927504128 00000100:00100000:1.0:1789996279.584090:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 4 00000100:00100000:1.0:1789996279.584100:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0850a22050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+13:9683:x1876946927504128:12345-192.168.204.37@tcp:35:rm.0 00000100:00100000:1.0:1789996279.584357:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0850a22050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+14:9683:x1876946927504128:12345-192.168.204.37@tcp:35:rm.0 Request processed in 257us (467us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1789996279.584365:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 4 00000100:00100000:2.0:1789996279.588929:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1789996279.589042:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927504384 00000100:00100000:1.0:1789996279.589069:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927504384 00000100:00100000:1.0:1789996279.589174:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 27 00000100:00100000:1.0:1789996279.589184:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086f88bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+14:9683:x1876946927504384:12345-192.168.204.37@tcp:101:rm.0 00010000:00010000:1.0:1789996279.589208:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789996279.589228:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23a00/0x4173739f0fc808c1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b97003095e354d0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996279.589317:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23c00/0x4173739f0fc808c8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996279.589333:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23c00/0x4173739f0fc808c8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996279.589344:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23c00/0x4173739f0fc808c8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789996279.589355:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1789996279.589536:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23a00/0x4173739f0fc808c1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e354d0 expref: 17 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996279.589592:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23c00/0x4173739f0fc808c8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e354d0 expref: 16 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996279.589601:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8e0846583a00) 00010000:00010000:1.0:1789996279.589604:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789996279.589608:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e0876a23c00, rc 0) 00000100:00100000:1.0:1789996279.589666:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086f88bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+16:9683:x1876946927504384:12345-192.168.204.37@tcp:101:rm.0 Request processed in 483us (820us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1789996279.589674:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 27 00000100:00100000:0.0:1789996279.593273:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1789996279.593349:0:9163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927504512 00000100:00100000:1.0:1789996279.593359:0:9163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927504512 00000100:00100000:1.0:1789996279.593426:0:9163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 28 00000100:00100000:1.0:1789996279.593436:0:9163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0741836d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+16:9683:x1876946927504512:12345-192.168.204.37@tcp:41:rm.0 00000004:00000024:1.0:1789996279.593496:0:9163:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:1.0:1789996279.593587:0:9163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0741836d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+16:9683:x1876946927504512:12345-192.168.204.37@tcp:41:rm.0 Request processed in 151us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996279.593595:0:9163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 28 00000100:00100000:2.0:1789996279.596188:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1789996279.596273:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927504640 00000100:00100000:3.0:1789996279.596282:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927504640 00000100:00100000:3.0:1789996279.596337:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 29 00000100:00100000:3.0:1789996279.596347:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086f888700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+16:9683:x1876946927504640:12345-192.168.204.37@tcp:101:rm.0 00010000:00010000:3.0:1789996279.596365:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789996279.596383:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857c00/0x4173739f0fc808d6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b97003095e354d7 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996279.596453:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857e00/0x4173739f0fc808dd lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996279.596742:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857e00/0x4173739f0fc808dd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996279.596757:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857e00/0x4173739f0fc808dd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996279.596936:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4800/0x4173739f0fc808e4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996279.596946:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4800/0x4173739f0fc808e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996279.596955:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4800/0x4173739f0fc808e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996279.597060:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4000/0x4173739f0fc808eb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996279.597069:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4000/0x4173739f0fc808eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996279.597076:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4000/0x4173739f0fc808eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789996279.597103:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:2.0:1789996279.597108:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789996279.597129:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4000/0x4173739f0fc808eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996279.597140:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4000/0x4173739f0fc808eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996279.597148:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857e00/0x4173739f0fc808dd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996279.597155:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857e00/0x4173739f0fc808dd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996279.597161:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857e00/0x4173739f0fc808dd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996279.597168:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e087f857e00 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:2.0:1789996279.597173:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857e00/0x4173739f0fc808dd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996279.597180:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857e00/0x4173739f0fc808dd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996279.597197:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8e0846583a00) 00010000:00010000:2.0:1789996279.597200:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789996279.597206:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857e00/0x4173739f0fc808dd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996279.597212:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857e00/0x4173739f0fc808dd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996279.597225:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4800/0x4173739f0fc808e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996279.597231:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4800/0x4173739f0fc808e4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996279.597236:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4800/0x4173739f0fc808e4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996279.597241:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0842de4800 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:2.0:1789996279.597244:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4800/0x4173739f0fc808e4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996279.597249:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4800/0x4173739f0fc808e4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996279.597256:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x6fc107fe (ffff8e084601bb00) 00010000:00010000:2.0:1789996279.597259:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789996279.597261:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4800/0x4173739f0fc808e4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996279.597267:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4800/0x4173739f0fc808e4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996279.597308:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857c00/0x4173739f0fc808d6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e354d7 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996279.597321:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4000/0x4173739f0fc808eb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e354d7 expref: 17 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996279.597329:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8e0861fcf500) 00010000:00010000:2.0:1789996279.597331:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789996279.597334:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e0842de4000, rc 0) 00000100:00100000:2.0:1789996279.597450:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086f888700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+17:9683:x1876946927504640:12345-192.168.204.37@tcp:101:rm.0 Request processed in 1104us (1269us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996279.597458:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 29 00000100:00100000:2.0:1789996279.604409:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1789996279.604503:0:9163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927504896 00000100:00100000:1.0:1789996279.604513:0:9163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927504896 00000100:00100000:1.0:1789996279.604612:0:9163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 30 00000100:00100000:1.0:1789996279.604631:0:9163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086f888000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+17:9683:x1876946927504896:12345-192.168.204.37@tcp:36:rm.0 00010000:00010000:1.0:1789996279.604682:0:9163:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1789996279.604707:0:9163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4000/0x4173739f0fc808eb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e354d7 expref: 17 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996279.604730:0:9163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23800/0x4173739f0fc80897 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e354bb expref: 16 pid: 9163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996279.604741:0:9163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8e0861fcf500) 00010000:00010000:1.0:1789996279.604756:0:9163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856600/0x4173739f0fc808ac lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e354c2 expref: 15 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996279.604766:0:9163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8e0846583a00) 00010000:00010000:1.0:1789996279.604769:0:9163:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789996279.604795:0:9163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23a00/0x4173739f0fc808f2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996279.604823:0:9163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23a00/0x4173739f0fc808f2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996279.604834:0:9163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23a00/0x4173739f0fc808f2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996279.604849:0:9163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22000/0x4173739f0fc808f9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996279.604868:0:9163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22000/0x4173739f0fc808f9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996279.604876:0:9163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22000/0x4173739f0fc808f9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996279.605014:0:9163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22800/0x4173739f0fc80900 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996279.605023:0:9163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22800/0x4173739f0fc80900 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996279.605030:0:9163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22800/0x4173739f0fc80900 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789996279.605779:0:9163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:1.0:1789996279.605790:0:9163:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 321325246897ns, next at 322325244797ns, rc = 0 00010000:00010000:1.0:1789996279.605851:0:9163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22e00/0x4173739f0fc80907 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996279.605862:0:9163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22e00/0x4173739f0fc80907 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996279.605882:0:9163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22e00/0x4173739f0fc80907 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996279.605890:0:9163:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22e00/0x4173739f0fc80907 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996279.605896:0:9163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22e00/0x4173739f0fc80907 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996279.605902:0:9163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22e00/0x4173739f0fc80907 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996279.605920:0:9163:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789996279.605938:0:9163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22800/0x4173739f0fc80900 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996279.605943:0:9163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22800/0x4173739f0fc80900 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996279.605949:0:9163:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22800/0x4173739f0fc80900 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996279.605955:0:9163:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0876a22800 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:1.0:1789996279.605959:0:9163:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22800/0x4173739f0fc80900 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996279.605968:0:9163:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22800/0x4173739f0fc80900 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996279.605977:0:9163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8e0861fcf800) 00010000:00010000:1.0:1789996279.605980:0:9163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1789996279.605991:0:9163:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22800/0x4173739f0fc80900 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996279.605997:0:9163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22800/0x4173739f0fc80900 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996279.606013:0:9163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23a00/0x4173739f0fc808f2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996279.606019:0:9163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23a00/0x4173739f0fc808f2 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996279.606024:0:9163:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23a00/0x4173739f0fc808f2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996279.606029:0:9163:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0876a23a00 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:1.0:1789996279.606031:0:9163:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23a00/0x4173739f0fc808f2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996279.606036:0:9163:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23a00/0x4173739f0fc808f2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996279.606043:0:9163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8e0846583a00) 00010000:00010000:1.0:1789996279.606045:0:9163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789996279.606048:0:9163:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23a00/0x4173739f0fc808f2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996279.606054:0:9163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23a00/0x4173739f0fc808f2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789996279.606063:0:9163:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e63bf6c2 reply state 00000000f46f777b transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22000/0x4173739f0fc808f9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789996279.606081:0:9163:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789996279.606157:0:9163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086f888000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+16:9683:x1876946927504896:12345-192.168.204.37@tcp:36:rm.0 Request processed in 1535us (1765us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1789996279.606165:0:9163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 30 00010000:00010000:2.0:1789996279.606643:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789996279.606650:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22e00/0x4173739f0fc80907 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996279.606657:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0876a22e00 already unused, calling callback (ffffffffc1595910) 00010000:00010000:2.0:1789996279.606661:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22e00/0x4173739f0fc80907 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996279.606667:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22e00/0x4173739f0fc80907 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996279.606678:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8e0861fcf800) 00010000:00010000:2.0:1789996279.606680:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789996279.606683:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22e00/0x4173739f0fc80907 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996279.606702:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22e00/0x4173739f0fc80907 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996279.606719:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789996279.606720:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789996279.606722:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789996279.609102:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22000/0x4173739f0fc808f9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996279.609119:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22000/0x4173739f0fc808f9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996279.609127:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22000/0x4173739f0fc808f9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996279.609133:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0876a22000 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:1.0:1789996279.609138:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22000/0x4173739f0fc808f9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996279.609145:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22000/0x4173739f0fc808f9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996279.609161:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x6fc107fe (ffff8e0861fcf200) 00010000:00010000:1.0:1789996279.609164:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789996279.609169:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22000/0x4173739f0fc808f9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996279.609176:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22000/0x4173739f0fc808f9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x6fc107fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789996279.612438:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996279.612730:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927505152 00000100:00100000:0.0:1789996279.612740:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927505152 00000100:00100000:0.0:1789996279.612796:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 5 00000100:00100000:0.0:1789996279.612808:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086f889880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+15:9683:x1876946927505152:12345-192.168.204.37@tcp:35:rm.0 00000100:00100000:0.0:1789996279.613041:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086f889880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+16:9683:x1876946927505152:12345-192.168.204.37@tcp:35:rm.0 Request processed in 234us (611us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1789996279.613048:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 5 00000100:00100000:0.0:1789996279.616525:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1789996279.616716:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927505408 00000100:00100000:1.0:1789996279.616726:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927505408 00000100:00100000:1.0:1789996279.616806:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 31 00000100:00100000:1.0:1789996279.616815:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0741834a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+16:9683:x1876946927505408:12345-192.168.204.37@tcp:36:rm.0 00010000:00010000:1.0:1789996279.617043:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1789996279.617072:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23c00/0x4173739f0fc808c8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e354d0 expref: 16 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996279.617097:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856200/0x4173739f0fc80866 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e354ad expref: 15 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996279.617108:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8e0846583a00) 00010000:00010000:1.0:1789996279.617125:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5400/0x4173739f0fc80827 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e3549f expref: 14 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996279.617133:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e084601bc00) 00010000:00010000:1.0:1789996279.617140:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789996279.617163:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23a00/0x4173739f0fc8090e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996279.617174:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23a00/0x4173739f0fc8090e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996279.617184:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23a00/0x4173739f0fc8090e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996279.617197:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22800/0x4173739f0fc80915 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996279.617204:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22800/0x4173739f0fc80915 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996279.617222:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22800/0x4173739f0fc80915 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996279.617451:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23800/0x4173739f0fc8091c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996279.617460:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23800/0x4173739f0fc8091c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996279.617467:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23800/0x4173739f0fc8091c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789996279.619074:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1789996279.619095:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23800/0x4173739f0fc8091c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996279.619103:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23800/0x4173739f0fc8091c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996279.619110:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23800/0x4173739f0fc8091c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996279.619115:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0876a23800 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:1.0:1789996279.619119:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23800/0x4173739f0fc8091c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996279.619127:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23800/0x4173739f0fc8091c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996279.619141:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8e0861fcf100) 00010000:00010000:1.0:1789996279.619144:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1789996279.619157:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23800/0x4173739f0fc8091c lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996279.619163:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23800/0x4173739f0fc8091c lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996279.619187:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23a00/0x4173739f0fc8090e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996279.619194:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23a00/0x4173739f0fc8090e lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996279.619199:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23a00/0x4173739f0fc8090e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996279.619204:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0876a23a00 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:1.0:1789996279.619207:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23a00/0x4173739f0fc8090e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996279.619213:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23a00/0x4173739f0fc8090e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996279.619221:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e0861fcf500) 00010000:00010000:1.0:1789996279.619224:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789996279.619227:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23a00/0x4173739f0fc8090e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996279.619234:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23a00/0x4173739f0fc8090e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789996279.619245:0:5847:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000044397e52 reply state 00000000f13edfb2 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22800/0x4173739f0fc80915 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789996279.619264:0:5847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789996279.619361:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0741834a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+15:9683:x1876946927505408:12345-192.168.204.37@tcp:36:rm.0 Request processed in 2543us (2841us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1789996279.619370:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 31 00010000:00010000:1.0:1789996279.623387:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22800/0x4173739f0fc80915 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996279.623417:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22800/0x4173739f0fc80915 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996279.623424:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22800/0x4173739f0fc80915 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996279.623430:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0876a22800 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:1.0:1789996279.623435:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22800/0x4173739f0fc80915 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996279.623444:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22800/0x4173739f0fc80915 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996279.623580:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8e0861fcf300) 00010000:00010000:1.0:1789996279.623584:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789996279.623590:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22800/0x4173739f0fc80915 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996279.623596:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22800/0x4173739f0fc80915 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996280.168685:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789996281.192756:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789996281.833365:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e087f828000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876946942216192:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789996281.833454:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789996281.833859:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942216192 00000100:00100000:3.0:1789996281.833868:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942216192 00000100:00080000:2.0:1789996281.834006:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789996281.835244:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789996281.835262:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e087f839500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876946942216192:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789996281.835303:0:6692:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789996281.835384:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e087f839500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876946942216192:12345-0@lo:13:osp-pre-0-0.0 Request processed in 130us (1930us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996281.835390:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:1.0:1789996281.835472:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e087f828000 x1876946942216192/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789996297 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789996281.835492:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e087f828000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876946942216192:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789996282.219820:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789996282.659479:0:11630:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00000100:00100000:3.0:1789996282.684530:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1789996282.685090:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996282.686844:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927505536 00000100:00100000:2.0:1789996282.686858:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927505536 00000100:00100000:2.0:1789996282.686921:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 243 00000100:00100000:2.0:1789996282.686949:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852b6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f78f7903-47ba-48a7-bb82-1f616cb85fc0+13:2365:x1876946927505536:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:2.0:1789996282.687054:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852b6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f78f7903-47ba-48a7-bb82-1f616cb85fc0+13:2365:x1876946927505536:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 107us (2547us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996282.687063:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 243 00000100:00100000:3.0:1789996282.688417:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1789996282.690337:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1789996282.690377:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927505792 00000100:00100000:3.0:1789996282.690385:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927505792 00000100:00100000:3.0:1789996282.690445:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 51 00000100:00100000:3.0:1789996282.690456:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086f887100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+5:2365:x1876946927505792:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:3.0:1789996282.690536:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086f887100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+5:2365:x1876946927505792:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 81us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996282.690566:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 51 00000100:00080000:3.0:1789996282.690684:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789996282.693435:0:9163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927505664 00000100:00100000:0.0:1789996282.693448:0:9163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927505664 00000100:00100000:0.0:1789996282.693539:0:9163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927505920 00000100:00100000:0.0:1789996282.693560:0:9163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927505920 00000100:00080000:1.0:1789996282.693712:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789996282.693742:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 89 00000100:00100000:1.0:1789996282.693754:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fdea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+14:2364:x1876946927505664:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:1.0:1789996282.693829:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fdea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+14:2364:x1876946927505664:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 78us (8931us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996282.693837:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 89 00000100:00100000:0.0:1789996282.693967:0:9163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 90 00000100:00100000:0.0:1789996282.693976:0:9163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fde9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cfc759a1-09a6-40ba-80a8-7399de51b555+5:2364:x1876946927505920:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:0.0:1789996282.694009:0:9163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fde9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cfc759a1-09a6-40ba-80a8-7399de51b555+5:2364:x1876946927505920:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 35us (5597us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996282.694016:0:9163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 90 00000100:00100000:3.0:1789996282.857687:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789996282.857711:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e087f82a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e0c28cd8-555e-481f-bd03-c3b02aee51c5:3313:1876946942216320:0@lo:400:kworker.0 00000100:00100000:3.0:1789996282.857775:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789996282.857865:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942216320 00000100:00100000:3.0:1789996282.857873:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942216320 00000100:00100000:3.0:1789996282.857923:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1789996282.857942:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852b6e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0c28cd8-555e-481f-bd03-c3b02aee51c5+19:3313:x1876946942216320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789996282.858002:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852b6e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0c28cd8-555e-481f-bd03-c3b02aee51c5+19:3313:x1876946942216320:12345-0@lo:400:kworker.0 Request processed in 62us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996282.858009:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:2.0:1789996282.858059:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e087f82a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e0c28cd8-555e-481f-bd03-c3b02aee51c5:3313:1876946942216320:0@lo:400:kworker.0 00000100:00100000:0.0:1789996282.858245:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789996282.858285:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789996282.858297:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086f885180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3313:1876946942216832:0@lo:400:kworker.0 00000100:00100000:2.0:1789996282.858333:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996282.858368:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942216832 00000100:00100000:2.0:1789996282.858373:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942216832 00000100:00100000:2.0:1789996282.858416:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1789996282.858425:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e087f82a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876946942216832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789996282.858468:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e087f82a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876946942216832:12345-0@lo:400:kworker.0 Request processed in 45us (134us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996282.858487:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00080000:2.0:1789996282.858523:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789996282.858634:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086f885180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3313:1876946942216832:0@lo:400:kworker.0 00000100:00100000:2.0:1789996282.859745:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086f887b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876946942216448:0@lo:400:kworker.0 00000100:00100000:2.0:1789996282.859795:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996282.859830:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942216448 00000100:00100000:2.0:1789996282.859836:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789996282.859837:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942216448 00000100:00100000:2.0:1789996282.859846:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086f884380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1876946942216576:0@lo:400:kworker.0 00000100:00100000:2.0:1789996282.859873:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996282.859885:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942216576 00000100:00100000:1.0:1789996282.859889:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942216576 00000100:00100000:2.0:1789996282.859912:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1789996282.859923:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e087f82b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876946942216448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789996282.859965:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e087f82b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876946942216448:12345-0@lo:400:kworker.0 Request processed in 45us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996282.860019:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1789996282.860028:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e087f82a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876946942216576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789996282.860064:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e087f82a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876946942216576:12345-0@lo:400:kworker.0 Request processed in 38us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996282.860130:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1789996282.861197:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086f886a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876946942216704:0@lo:400:kworker.0 00000100:00100000:0.0:1789996282.861243:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996282.861289:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942216704 00000100:00100000:0.0:1789996282.861294:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942216704 00000100:00100000:0.0:1789996282.861328:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789996282.861335:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0741835880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1876946942216704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789996282.861376:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0741835880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1876946942216704:12345-0@lo:400:kworker.0 Request processed in 41us (132us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996282.861382:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:0.0:1789996282.861419:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e086f886a00 x1876946942216704/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789996298 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789996282.861433:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086f886a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876946942216704:0@lo:400:kworker.0 00000100:00100000:2.0:1789996282.861822:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00080000:2.0:1789996282.861851:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789996282.861881:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086f884380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1876946942216576:0@lo:400:kworker.0 00000100:00100000:2.0:1789996282.861894:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086f887b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876946942216448:0@lo:400:kworker.0 00000100:00100000:1.0:1789996282.862740:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789996282.862873:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086f887480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876946942216960:0@lo:400:kworker.0 00000100:00100000:1.0:1789996282.862922:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789996282.863014:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942216960 00000100:00100000:3.0:1789996282.863021:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942216960 00000100:00100000:3.0:1789996282.863120:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789996282.863129:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e087f83b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1876946942216960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789996282.863184:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e087f83b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1876946942216960:12345-0@lo:400:kworker.0 Request processed in 55us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996282.863191:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:0.0:1789996282.863316:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e086f887480 x1876946942216960/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789996298 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789996282.863351:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086f887480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876946942216960:0@lo:400:kworker.0 00000100:00080000:2.0:1789996282.863422:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1789996283.245840:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1789996283.369466:0:8107:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 325088921077ns, next at 326088918991ns, rc = 0 00000100:00100000:2.0:1789996283.369534:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789996283.369583:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e087f83aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876946942217088:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789996283.369650:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996283.370835:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942217088 00000100:00100000:1.0:1789996283.370844:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942217088 00000100:00100000:1.0:1789996283.370906:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789996283.370932:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e087f828700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876946942217088:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789996283.370966:0:6691:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789996283.371029:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e087f828700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876946942217088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (1379us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996283.371037:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:2.0:1789996283.371141:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e087f83aa00 x1876946942217088/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789996299 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789996283.371162:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e087f83aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876946942217088:0@lo:13:osp-pre-1-0.0 00000020:00000080:3.0:1789996283.763979:0:11678:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcf1b24fc0 20000000:00000080:3.0:1789996283.763997:0:11678:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8e0876ac4800 uarg=0000000000000000 20000000:01000000:3.0:1789996283.764032:0:11678:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1789996283.764039:0:11678:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1789996283.764043:0:11678:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:1.0:1789996283.764984:0:11679:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:3.0:1789996283.765149:0:11678:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:3.0:1789996283.771424:0:11678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:3.0:1789996283.771508:0:11678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:3.0:1789996283.772251:0:11678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:3.0:1789996283.772275:0:11678:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1789996283.772295:0:11678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e087f856800/0x4173739f0fc80923 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996283.772317:0:11678:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e0840031e00/0x4173739f0fc807c5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e3548a expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996283.772325:0:11678:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e0840031400/0x4173739f0fc807d3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4173739f0fc807cc expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996283.772346:0:11678:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e087f856400/0x4173739f0fc807e1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4173739f0fc807da expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996283.772354:0:11678:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e087f857800/0x4173739f0fc807ef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4173739f0fc807e8 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996283.772360:0:11678:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e0840031000/0x4173739f0fc807f6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35491 expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996283.772368:0:11678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8e087f856800/0x4173739f0fc80923 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996283.772406:0:11678:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e0840031000/0x4173739f0fc807f6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35491 expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996283.772423:0:11678:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e0840031000/0x4173739f0fc807f6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35491 expref: 12 pid: 5839 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789996283.772438:0:11678:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086f885500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11678:1876946942217216:192.168.204.37@tcp:104: 00010000:00010000:3.0:1789996283.773052:0:11678:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e087f857800/0x4173739f0fc807ef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4173739f0fc807e8 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996283.773063:0:11678:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e087f857800/0x4173739f0fc807ef lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4173739f0fc807e8 expref: 18 pid: 5840 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789996283.773073:0:11678:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086f886d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11678:1876946942217344:0@lo:104: 00000100:00100000:3.0:1789996283.773126:0:11678:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789996283.773166:0:11678:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e087f856400/0x4173739f0fc807e1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4173739f0fc807da expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996283.773184:0:11678:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e087f856400/0x4173739f0fc807e1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4173739f0fc807da expref: 18 pid: 5841 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789996283.773193:0:11678:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086f884700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11678:1876946942217472:0@lo:104: 00000100:00100000:3.0:1789996283.773215:0:11678:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789996283.773249:0:11678:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e0840031400/0x4173739f0fc807d3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4173739f0fc807cc expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996283.773258:0:11678:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e0840031400/0x4173739f0fc807d3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4173739f0fc807cc expref: 18 pid: 5840 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789996283.773266:0:11678:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086f884e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11678:1876946942217600:0@lo:104: 00000100:00100000:3.0:1789996283.773290:0:11678:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789996283.773312:0:11678:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e0840031e00/0x4173739f0fc807c5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e3548a expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996283.773320:0:11678:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e0840031e00/0x4173739f0fc807c5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e3548a expref: 12 pid: 5839 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789996283.773328:0:11678:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086f884a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11678:1876946942217728:192.168.204.37@tcp:104: 00000100:00100000:3.0:1789996283.773353:0:11678:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e07432d6540 going to sleep for 11 seconds 00000100:00100000:1.0:1789996283.773415:0:5830:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1789996283.773429:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942217344 00000100:00100000:1.0:1789996283.773436:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942217344 00000100:00100000:1.0:1789996283.773471:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942217472 00000100:00100000:1.0:1789996283.773474:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942217472 00000100:00100000:1.0:1789996283.773485:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942217600 00000100:00100000:1.0:1789996283.773498:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942217600 00000100:00100000:1.0:1789996283.773512:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789996283.773521:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086f885f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e0c28cd8-555e-481f-bd03-c3b02aee51c5+5:11678:x1876946942217344:12345-0@lo:104: 00010000:00010000:1.0:1789996283.773571:0:5830:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.137@tcp lock: ffff8e0842de5200/0x4173739f0fc807e8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4173739f0fc807ef expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996283.773750:0:5830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789996283.773757:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086f885f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e0c28cd8-555e-481f-bd03-c3b02aee51c5+5:11678:x1876946942217344:12345-0@lo:104: Request processed in 237us (632us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996283.773764:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789996283.773783:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789996283.773790:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086f887800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e0c28cd8-555e-481f-bd03-c3b02aee51c5+4:11678:x1876946942217472:12345-0@lo:104: 00010000:00010000:1.0:1789996283.773798:0:5830:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.137@tcp lock: ffff8e0876a22400/0x4173739f0fc807da lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4173739f0fc807e1 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996283.773831:0:5830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789996283.773843:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086f887800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e0c28cd8-555e-481f-bd03-c3b02aee51c5+4:11678:x1876946942217472:12345-0@lo:104: Request processed in 54us (627us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996283.773849:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789996283.773861:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789996283.773867:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fad1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e0c28cd8-555e-481f-bd03-c3b02aee51c5+3:11678:x1876946942217600:12345-0@lo:104: 00010000:00010000:1.0:1789996283.773874:0:5830:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.137@tcp lock: ffff8e0842de4c00/0x4173739f0fc807cc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4173739f0fc807d3 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996283.773898:0:5830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1789996283.773903:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fad1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e0c28cd8-555e-481f-bd03-c3b02aee51c5+3:11678:x1876946942217600:12345-0@lo:104: Request processed in 37us (612us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996283.773908:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:1.0:1789996283.773942:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789996283.773949:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.137@tcp lock: ffff8e0842de5200/0x4173739f0fc807e8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4173739f0fc807ef expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996283.773957:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0842de5200 already unused, calling callback (ffffffffc1be0c20) 10000000:00010000:1.0:1789996283.773961:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.137@tcp lock: ffff8e0842de5200/0x4173739f0fc807e8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x4173739f0fc807ef expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996283.773970:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.137@tcp lock: ffff8e0842de5200/0x4173739f0fc807e8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x4173739f0fc807ef expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789996283.773978:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.137@tcp lock: ffff8e0842de5200/0x4173739f0fc807e8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x4173739f0fc807ef expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789996283.773985:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789996283.774012:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.137@tcp lock: ffff8e0842de5200/0x4173739f0fc807e8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4173739f0fc807ef expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996283.774028:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789996283.774049:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.137@tcp lock: ffff8e0842de5200/0x4173739f0fc807e8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4173739f0fc807ef expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996283.774056:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.137@tcp lock: ffff8e0842de5200/0x4173739f0fc807e8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4173739f0fc807ef expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996283.774070:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789996283.774073:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.137@tcp lock: ffff8e0876a22400/0x4173739f0fc807da lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4173739f0fc807e1 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996283.774078:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0876a22400 already unused, calling callback (ffffffffc1be0c20) 10000000:00010000:1.0:1789996283.774081:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.137@tcp lock: ffff8e0876a22400/0x4173739f0fc807da lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x4173739f0fc807e1 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996283.774087:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.137@tcp lock: ffff8e0876a22400/0x4173739f0fc807da lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x4173739f0fc807e1 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789996283.774093:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.137@tcp lock: ffff8e0876a22400/0x4173739f0fc807da lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x4173739f0fc807e1 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789996283.774097:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789996283.774110:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.137@tcp lock: ffff8e0876a22400/0x4173739f0fc807da lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4173739f0fc807e1 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996283.774116:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789996283.774122:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.137@tcp lock: ffff8e0876a22400/0x4173739f0fc807da lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4173739f0fc807e1 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996283.774127:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.137@tcp lock: ffff8e0876a22400/0x4173739f0fc807da lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4173739f0fc807e1 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996283.774142:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789996283.774145:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.137@tcp lock: ffff8e0842de4c00/0x4173739f0fc807cc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4173739f0fc807d3 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996283.774150:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0842de4c00 already unused, calling callback (ffffffffc1be0c20) 10000000:00010000:1.0:1789996283.774153:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.137@tcp lock: ffff8e0842de4c00/0x4173739f0fc807cc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4173739f0fc807d3 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996283.774160:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.137@tcp lock: ffff8e0842de4c00/0x4173739f0fc807cc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4173739f0fc807d3 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789996283.774166:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.137@tcp lock: ffff8e0842de4c00/0x4173739f0fc807cc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4173739f0fc807d3 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789996283.774171:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789996283.774185:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.137@tcp lock: ffff8e0842de4c00/0x4173739f0fc807cc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4173739f0fc807d3 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996283.774190:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789996283.774206:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.137@tcp lock: ffff8e0842de4c00/0x4173739f0fc807cc lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4173739f0fc807d3 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996283.774212:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.137@tcp lock: ffff8e0842de4c00/0x4173739f0fc807cc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4173739f0fc807d3 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996283.774233:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789996283.774235:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789996283.774237:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789996283.774244:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789996283.774273:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e087f83aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e0c28cd8-555e-481f-bd03-c3b02aee51c5:3313:1876946942217856:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789996283.774352:0:11678:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086f886d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11678:1876946942217344:0@lo:104: 00000100:00100000:3.0:1789996283.774369:0:11678:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086f884700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11678:1876946942217472:0@lo:104: 00000100:00100000:3.0:1789996283.774377:0:11678:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086f884e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11678:1876946942217600:0@lo:104: 00000100:00100000:0.0:1789996283.775521:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086f88b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e0c28cd8-555e-481f-bd03-c3b02aee51c5:3315:1876946942218112:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789996283.775953:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996283.776038:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789996283.776046:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e087f83ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e0c28cd8-555e-481f-bd03-c3b02aee51c5:3313:1876946942217984:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789996283.776075:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996283.776257:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789996283.776275:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942217856 00000100:00100000:3.0:1789996283.776282:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942217856 00010000:00010000:3.0:1789996283.776324:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e087f857800/0x4173739f0fc807ef lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4173739f0fc807e8 expref: 19 pid: 5840 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789996283.776371:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942217984 00000100:00100000:0.0:1789996283.776374:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942217984 00010000:00010000:0.0:1789996283.776390:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e087f856400/0x4173739f0fc807e1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4173739f0fc807da expref: 20 pid: 5841 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789996283.776415:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789996283.776423:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086f88ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e0c28cd8-555e-481f-bd03-c3b02aee51c5+20:3313:x1876946942217856:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789996283.776435:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789996283.776440:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e087f857800/0x4173739f0fc807ef lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4173739f0fc807e8 expref: 20 pid: 5840 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996283.776450:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e087f857800/0x4173739f0fc807ef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4173739f0fc807e8 expref: 20 pid: 5840 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996283.776465:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e087f857800/0x4173739f0fc807ef lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4173739f0fc807e8 expref: 20 pid: 5840 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996283.776478:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789996283.776526:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086f88ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e0c28cd8-555e-481f-bd03-c3b02aee51c5+19:3313:x1876946942217856:12345-0@lo:103:ldlm_bl.0 Request processed in 104us (573us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996283.776533:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789996283.776588:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789996283.776594:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086f88a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e0c28cd8-555e-481f-bd03-c3b02aee51c5+18:3313:x1876946942217984:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789996283.776602:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789996283.776625:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e087f856400/0x4173739f0fc807e1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4173739f0fc807da expref: 18 pid: 5841 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996283.776634:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e087f856400/0x4173739f0fc807e1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4173739f0fc807da expref: 18 pid: 5841 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996283.776644:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e087f856400/0x4173739f0fc807e1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4173739f0fc807da expref: 18 pid: 5841 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996283.776653:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789996283.776676:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086f88a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e0c28cd8-555e-481f-bd03-c3b02aee51c5+17:3313:x1876946942217984:12345-0@lo:103:ldlm_bl.0 Request processed in 83us (600us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996283.776682:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789996283.777612:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e087f83ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e0c28cd8-555e-481f-bd03-c3b02aee51c5:3313:1876946942217984:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789996283.777627:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e087f83aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e0c28cd8-555e-481f-bd03-c3b02aee51c5:3313:1876946942217856:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789996283.777944:0:8520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942218112 00000100:00100000:0.0:1789996283.777951:0:8520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942218112 00010000:00010000:0.0:1789996283.777978:0:8520:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e0840031400/0x4173739f0fc807d3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4173739f0fc807cc expref: 17 pid: 5840 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789996283.778033:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789996283.778044:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0848c1c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e0c28cd8-555e-481f-bd03-c3b02aee51c5+17:3315:x1876946942218112:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789996283.778057:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789996283.778062:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e0840031400/0x4173739f0fc807d3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4173739f0fc807cc expref: 17 pid: 5840 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996283.778071:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e0840031400/0x4173739f0fc807d3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4173739f0fc807cc expref: 17 pid: 5840 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996283.778086:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e0840031400/0x4173739f0fc807d3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4173739f0fc807cc expref: 17 pid: 5840 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996283.778108:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789996283.778171:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0848c1c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e0c28cd8-555e-481f-bd03-c3b02aee51c5+16:3315:x1876946942218112:12345-0@lo:103:ldlm_bl.0 Request processed in 130us (1912us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996283.778179:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789996283.778643:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086f88b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e0c28cd8-555e-481f-bd03-c3b02aee51c5:3315:1876946942218112:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789996283.781168:0:11678:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086f885500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11678:1876946942217216:192.168.204.37@tcp:104: 00000100:00100000:3.0:1789996283.781185:0:11678:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086f884a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11678:1876946942217728:192.168.204.37@tcp:104: 00010000:00010000:3.0:1789996283.781216:0:11678:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8e087f856800/0x4173739f0fc80923 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789996283.785809:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996283.785857:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1789996283.785917:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927506048 00000100:00100000:3.0:1789996283.785927:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927506048 00010000:00010000:3.0:1789996283.785967:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e0840031000/0x4173739f0fc807f6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35491 expref: 13 pid: 5839 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789996283.786053:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927506176 00000100:00100000:2.0:1789996283.786060:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927506176 00000100:00100000:0.0:1789996283.786074:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 33 00000100:00100000:0.0:1789996283.786085:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0741835500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f78f7903-47ba-48a7-bb82-1f616cb85fc0+13:2363:x1876946927506048:12345-192.168.204.37@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789996283.786099:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789996283.786106:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e0840031000/0x4173739f0fc807f6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35491 expref: 13 pid: 5839 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996283.786117:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e0840031000/0x4173739f0fc807f6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35491 expref: 13 pid: 5839 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996283.786135:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e0840031000/0x4173739f0fc807f6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35491 expref: 13 pid: 5839 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996283.786164:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789996283.786207:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e0840031e00/0x4173739f0fc807c5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e3548a expref: 13 pid: 5839 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789996283.786226:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0741835500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f78f7903-47ba-48a7-bb82-1f616cb85fc0+13:2363:x1876946927506048:12345-192.168.204.37@tcp:103:ldlm_bl.0 Request processed in 142us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996283.786234:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 33 00000100:00100000:2.0:1789996283.786344:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 34 00000100:00100000:2.0:1789996283.786355:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0741835f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f78f7903-47ba-48a7-bb82-1f616cb85fc0+12:2363:x1876946927506176:12345-192.168.204.37@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789996283.786364:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789996283.786370:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e0840031e00/0x4173739f0fc807c5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e3548a expref: 12 pid: 5839 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996283.786381:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e0840031e00/0x4173739f0fc807c5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e3548a expref: 12 pid: 5839 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996283.786393:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e0840031e00/0x4173739f0fc807c5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e3548a expref: 12 pid: 5839 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996283.786417:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8e087f856800/0x4173739f0fc80923 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996283.786426:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e087f856800/0x4173739f0fc80923 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996283.786443:0:5833:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e087f856800/0x4173739f0fc80923 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996283.786451:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e087f856800/0x4173739f0fc80923 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996283.786468:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e087f856800/0x4173739f0fc80923 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996283.786475:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e087f856800/0x4173739f0fc80923 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996283.786482:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e087f856800 already unused, calling callback (ffffffffc1595910) 00010000:00010000:2.0:1789996283.786485:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e087f856800/0x4173739f0fc80923 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996283.786507:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e087f856800/0x4173739f0fc80923 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996283.786523:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e087f856800/0x4173739f0fc80923 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996283.786534:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789996283.786603:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0741835f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f78f7903-47ba-48a7-bb82-1f616cb85fc0+11:2363:x1876946927506176:12345-192.168.204.37@tcp:103:ldlm_bl.0 Request processed in 251us (745us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996283.786611:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 34 00010000:00010000:3.0:1789996283.786689:0:11678:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8e087f856800/0x4173739f0fc80923 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996283.786707:0:11678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e087f856800/0x4173739f0fc80923 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996283.786715:0:11678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e087f856800/0x4173739f0fc80923 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996284.267311:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789996284.492374:0:5868:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967307 is committed 00000004:00080000:2.0:1789996284.492396:0:5868:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000001:00080000:2.0:1789996284.492416:0:5868:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000004:00080000:2.0:1789996284.492421:0:5868:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:1.0:1789996284.492600:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789996284.492620:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086f88b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876946942218240:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1789996284.492690:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996284.492988:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942218240 00000100:00100000:0.0:1789996284.492996:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942218240 00000100:00080000:2.0:1789996284.493030:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789996284.493076:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789996284.493084:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086f88ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1876946942218240:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1789996284.493104:0:6688:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:0.0:1789996284.493130:0:6688:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x6ab12cf8, atime: 0x6ab12cf8, ctime: 0x6ab12cf8, blocks: 0x1 00010000:00010000:0.0:1789996284.493137:0:6688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000043daf9a1/0x4173739f0fc8092a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996284.493149:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=326s v=(0 0) 00010000:00010000:0.0:1789996284.493153:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789996284.493157:0:6688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000043daf9a1/0x4173739f0fc8092a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996284.493169:0:6688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000043daf9a1/0x4173739f0fc8092a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996284.493176:0:6688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000043daf9a1/0x4173739f0fc8092a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996284.493181:0:6688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000043daf9a1/0x4173739f0fc8092a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996284.493207:0:6688:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789996284.493229:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789996284.493235:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000043daf9a1/0x4173739f0fc8092a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996284.493253:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0840031000 already unused, calling callback (ffffffffc1595910) 00010000:00010000:2.0:1789996284.493257:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000043daf9a1/0x4173739f0fc8092a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996284.493266:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000043daf9a1/0x4173739f0fc8092a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996284.493296:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000043daf9a1/0x4173739f0fc8092a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996284.493304:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000043daf9a1/0x4173739f0fc8092a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996284.493324:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789996284.493326:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789996284.493327:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789996284.493872:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086f88ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3315:x1876946942218240:12345-0@lo:6:osp-syn-1-0.0 Request processed in 787us (1180us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1789996284.493881:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000004:00080000:1.0:1789996284.493912:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e086f88b100/2, rc 0, transno 4294967300 00000100:00100000:1.0:1789996284.493919:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086f88b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876946942218240:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1789996284.844023:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996284.844267:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927506304 00000100:00100000:2.0:1789996284.844289:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927506304 00000100:00100000:2.0:1789996284.844342:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 245 00000100:00100000:2.0:1789996284.844352:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852b6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f78f7903-47ba-48a7-bb82-1f616cb85fc0+11:5601:x1876946927506304:12345-192.168.204.37@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789996284.844370:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789996284.844392:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e0842de4c00/0x4173739f0fc80931 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b97003095e354de expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996284.844421:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e0842de4c00/0x4173739f0fc80931 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e354de expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996284.844450:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e0842de4c00/0x4173739f0fc80931 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e354de expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996284.844459:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e0842de4c00, rc 0) 00000100:00100000:2.0:1789996284.844535:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852b6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f78f7903-47ba-48a7-bb82-1f616cb85fc0+12:5601:x1876946927506304:12345-192.168.204.37@tcp:101:ll_cfg_requeue.0 Request processed in 179us (516us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996284.844562:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 245 00000100:00100000:1.0:1789996284.848440:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1789996284.848685:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927506432 00000100:00100000:3.0:1789996284.848694:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927506432 00000100:00100000:2.0:1789996284.848883:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 246 00000100:00100000:2.0:1789996284.848894:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0870532050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f78f7903-47ba-48a7-bb82-1f616cb85fc0+12:5601:x1876946927506432:12345-192.168.204.37@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789996284.849308:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0870532050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f78f7903-47ba-48a7-bb82-1f616cb85fc0+12:5601:x1876946927506432:12345-192.168.204.37@tcp:501:ll_cfg_requeue.0 Request processed in 415us (878us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996284.849316:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 246 00000100:00100000:3.0:1789996284.851572:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996284.851641:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927506560 00000100:00100000:2.0:1789996284.851650:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927506560 00000100:00100000:2.0:1789996284.851703:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 247 00000100:00100000:2.0:1789996284.851712:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e08602c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f78f7903-47ba-48a7-bb82-1f616cb85fc0+12:5601:x1876946927506560:12345-192.168.204.37@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789996284.851933:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e08602c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f78f7903-47ba-48a7-bb82-1f616cb85fc0+12:5601:x1876946927506560:12345-192.168.204.37@tcp:503:ll_cfg_requeue.0 Request processed in 221us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996284.851941:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 247 00000100:00100000:3.0:1789996284.855157:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996284.855620:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927506688 00000100:00100000:2.0:1789996284.855631:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927506688 00000100:00100000:2.0:1789996284.856214:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 248 00000100:00100000:2.0:1789996284.856226:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e08602ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f78f7903-47ba-48a7-bb82-1f616cb85fc0+12:9953:x1876946927506688:12345-192.168.204.37@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789996284.856652:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e08602ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f78f7903-47ba-48a7-bb82-1f616cb85fc0+12:9953:x1876946927506688:12345-192.168.204.37@tcp:502:llog_process_th.0 Request processed in 426us (1502us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996284.856668:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 248 00000100:00100000:3.0:1789996284.860051:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1789996284.860167:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927506816 00000100:00100000:1.0:1789996284.860177:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927506816 00000100:00100000:1.0:1789996284.860231:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 249 00000100:00100000:1.0:1789996284.860242:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e08602cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f78f7903-47ba-48a7-bb82-1f616cb85fc0+12:9953:x1876946927506816:12345-192.168.204.37@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789996284.860853:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e08602cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f78f7903-47ba-48a7-bb82-1f616cb85fc0+12:9953:x1876946927506816:12345-192.168.204.37@tcp:502:llog_process_th.0 Request processed in 610us (807us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996284.860864:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 249 00000100:00100000:0.0:1789996284.869682:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996284.870272:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927506944 00000100:00100000:2.0:1789996284.870353:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927506944 00000100:00100000:2.0:1789996284.870475:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 250 00000100:00100000:2.0:1789996284.870486:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e08602cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f78f7903-47ba-48a7-bb82-1f616cb85fc0+12:5601:x1876946927506944:12345-192.168.204.37@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789996284.870502:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789996284.870528:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e0842de5200/0x4173739f0fc80938 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b97003095e354e5 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996284.870585:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e0842de5200/0x4173739f0fc80938 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e354e5 expref: 13 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996284.870596:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e0842de5200/0x4173739f0fc80938 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e354e5 expref: 13 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996284.870605:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e0842de5200, rc 0) 00000100:00100000:2.0:1789996284.870669:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e08602cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f78f7903-47ba-48a7-bb82-1f616cb85fc0+13:5601:x1876946927506944:12345-192.168.204.37@tcp:101:ll_cfg_requeue.0 Request processed in 185us (997us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996284.870677:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 250 00000100:00100000:0.0:1789996284.873184:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1789996284.873272:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927507072 00000100:00100000:1.0:1789996284.873344:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927507072 00000100:00100000:1.0:1789996284.873650:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 251 00000100:00100000:1.0:1789996284.873662:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e08602c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f78f7903-47ba-48a7-bb82-1f616cb85fc0+13:5601:x1876946927507072:12345-192.168.204.37@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789996284.873957:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e08602c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f78f7903-47ba-48a7-bb82-1f616cb85fc0+13:5601:x1876946927507072:12345-192.168.204.37@tcp:501:ll_cfg_requeue.0 Request processed in 297us (781us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996284.873966:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 251 00000100:00100000:1.0:1789996284.876933:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996284.877138:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927507200 00000100:00100000:2.0:1789996284.877152:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927507200 00000100:00100000:2.0:1789996284.877243:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 252 00000100:00100000:2.0:1789996284.877254:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e08602c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f78f7903-47ba-48a7-bb82-1f616cb85fc0+13:5601:x1876946927507200:12345-192.168.204.37@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789996284.877486:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e08602c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f78f7903-47ba-48a7-bb82-1f616cb85fc0+13:5601:x1876946927507200:12345-192.168.204.37@tcp:503:ll_cfg_requeue.0 Request processed in 216us (547us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996284.877495:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 252 00000100:00100000:0.0:1789996284.886706:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1789996284.886792:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927507328 00000100:00100000:3.0:1789996284.886802:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927507328 00000100:00100000:3.0:1789996284.886911:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 253 00000100:00100000:3.0:1789996284.886921:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e08602ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f78f7903-47ba-48a7-bb82-1f616cb85fc0+13:9956:x1876946927507328:12345-192.168.204.37@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789996284.887249:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e08602ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f78f7903-47ba-48a7-bb82-1f616cb85fc0+13:9956:x1876946927507328:12345-192.168.204.37@tcp:502:llog_process_th.0 Request processed in 328us (707us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996284.887257:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 253 00000100:00100000:0.0:1789996284.889221:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996284.889490:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927507456 00000100:00100000:2.0:1789996284.889500:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927507456 00000100:00100000:2.0:1789996284.889744:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 254 00000100:00100000:2.0:1789996284.889755:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e08602c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f78f7903-47ba-48a7-bb82-1f616cb85fc0+13:9956:x1876946927507456:12345-192.168.204.37@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789996284.889993:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e08602c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f78f7903-47ba-48a7-bb82-1f616cb85fc0+13:9956:x1876946927507456:12345-192.168.204.37@tcp:502:llog_process_th.0 Request processed in 239us (776us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996284.890002:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 254 00000001:00080000:1.0:1789996284.928954:0:7659:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00010000:00010000:1.0:1789996285.288791:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789996285.352713:0:5843:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789996285.352721:0:5843:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e0847d01800 from 7 10000000:01000000:1.0:1789996285.352726:0:5843:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789996285.352773:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.137@tcp lock: ffff8e0876a22400/0x4173739f0fc8093f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996285.352785:0:5843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.137@tcp lock: ffff8e0876a22400/0x4173739f0fc8093f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996285.352795:0:5843:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.137@tcp lock: ffff8e0876a22400/0x4173739f0fc8093f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789996285.352822:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086f88a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5843:1876946942218368:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789996285.352890:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789996285.352957:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942218368 00000100:00100000:3.0:1789996285.352966:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942218368 00000100:00100000:1.0:1789996285.352974:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0852b62600 going to sleep for 11 seconds 00000100:00100000:3.0:1789996285.353008:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1789996285.353018:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e08602c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+16:5843:x1876946942218368:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789996285.353031:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789996285.353045:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e087f856000/0x4173739f0fc80946 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4173739f0fc8093f expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996285.353088:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e087f856000/0x4173739f0fc80946 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4173739f0fc8093f expref: 17 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996285.353100:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e087f856000/0x4173739f0fc80946 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4173739f0fc8093f expref: 17 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996285.353109:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e087f856000, rc 0) 00000100:00100000:3.0:1789996285.353155:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e08602c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+17:5843:x1876946942218368:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 138us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996285.353162:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:1.0:1789996285.353277:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086f88a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5843:1876946942218368:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789996285.353293:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.137@tcp lock: ffff8e0876a22400/0x4173739f0fc8093f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc80946 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996285.353301:0:5843:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.137@tcp lock: ffff8e0876a22400/0x4173739f0fc8093f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4173739f0fc80946 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789996285.353363:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086f88a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5843:1876946942218496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789996285.353396:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996285.353418:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0852b62600 going to sleep for 11 seconds 00000100:00100000:2.0:1789996285.353568:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942218496 00000100:00100000:2.0:1789996285.353574:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942218496 00000100:00100000:2.0:1789996285.353612:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:2.0:1789996285.353619:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852bea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0c28cd8-555e-481f-bd03-c3b02aee51c5+17:5843:x1876946942218496:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789996285.353906:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852bea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0c28cd8-555e-481f-bd03-c3b02aee51c5+17:5843:x1876946942218496:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 287us (508us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996285.353913:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1789996285.357345:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086f88a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5843:1876946942218496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789996285.357406:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086f884a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5843:1876946942218624:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789996285.357481:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789996285.357529:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e07432d6540 going to sleep for 11 seconds 00000100:00100000:2.0:1789996285.357698:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942218624 00000100:00100000:2.0:1789996285.357705:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942218624 00000100:00100000:2.0:1789996285.357753:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1789996285.357761:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852beb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+17:5843:x1876946942218624:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789996285.357935:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852beb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+17:5843:x1876946942218624:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 174us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996285.357943:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1789996285.358060:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086f884a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5843:1876946942218624:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789996285.365037:0:11693:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086f884a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0c28cd8-555e-481f-bd03-c3b02aee51c5:11693:1876946942218752:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789996285.365122:0:11693:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789996285.365218:0:11693:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e07432d6900 going to sleep for 11 seconds 00000100:00100000:2.0:1789996285.365228:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942218752 00000100:00100000:2.0:1789996285.365236:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942218752 00000100:00100000:2.0:1789996285.365346:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1789996285.365356:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852be9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+17:11693:x1876946942218752:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789996285.365636:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852be9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+17:11693:x1876946942218752:12345-0@lo:502:llog_process_th.0 Request processed in 281us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996285.365650:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1789996285.365699:0:11693:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086f884a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0c28cd8-555e-481f-bd03-c3b02aee51c5:11693:1876946942218752:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789996285.365726:0:11693:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789996285.365734:0:11693:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789996285.365737:0:11693:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789996285.365750:0:11693:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8e0847d01800 00000020:00000080:3.0:1789996285.365753:0:11693:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789996285.365839:0:11693:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086f884a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0c28cd8-555e-481f-bd03-c3b02aee51c5:11693:1876946942218880:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789996285.365871:0:11693:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789996285.365909:0:11693:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e07432d6900 going to sleep for 11 seconds 00000100:00100000:2.0:1789996285.366171:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942218880 00000100:00100000:2.0:1789996285.366176:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942218880 00000100:00100000:2.0:1789996285.366209:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1789996285.366215:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852bea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+17:11693:x1876946942218880:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789996285.366409:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852bea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+17:11693:x1876946942218880:12345-0@lo:502:llog_process_th.0 Request processed in 194us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996285.366416:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1789996285.368418:0:11693:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086f884a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0c28cd8-555e-481f-bd03-c3b02aee51c5:11693:1876946942218880:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789996285.368472:0:11693:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789996285.368480:0:11693:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789996285.368483:0:11693:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1789996285.368488:0:11693:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1789996285.368582:0:5843:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1789996285.368602:0:5843:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.137@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789996285.368612:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.137@tcp lock: ffff8e0876a22400/0x4173739f0fc8093f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc80946 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996285.368624:0:5843:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.137@tcp lock: ffff8e0876a22400/0x4173739f0fc8093f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc80946 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789996285.368634:0:5843:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789996285.368637:0:5843:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e0849c2f000 from 7 10000000:01000000:1.0:1789996285.368640:0:5843:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789996285.368669:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.137@tcp lock: ffff8e0876a23c00/0x4173739f0fc8094d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996285.368677:0:5843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.137@tcp lock: ffff8e0876a23c00/0x4173739f0fc8094d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996285.368687:0:5843:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.137@tcp lock: ffff8e0876a23c00/0x4173739f0fc8094d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789996285.368706:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086f88a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5843:1876946942219008:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789996285.368753:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996285.368775:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0852b62480 going to sleep for 11 seconds 00000100:00100000:1.0:1789996285.368792:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942219008 00000100:00100000:1.0:1789996285.368797:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942219008 00000100:00100000:2.0:1789996285.368999:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1789996285.369010:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852be8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+17:5843:x1876946942219008:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789996285.369032:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789996285.369046:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e0842de5400/0x4173739f0fc80954 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4173739f0fc8094d expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996285.369139:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e0842de5400/0x4173739f0fc80954 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4173739f0fc8094d expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996285.369152:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e0842de5400/0x4173739f0fc80954 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4173739f0fc8094d expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996285.369161:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e0842de5400, rc 0) 00000100:00100000:2.0:1789996285.369209:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852be8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+18:5843:x1876946942219008:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 201us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996285.369215:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1789996285.369484:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086f88a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5843:1876946942219008:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789996285.369498:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.137@tcp lock: ffff8e0876a23c00/0x4173739f0fc8094d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc80954 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996285.369506:0:5843:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.137@tcp lock: ffff8e0876a23c00/0x4173739f0fc8094d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4173739f0fc80954 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789996285.369580:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086f885500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5843:1876946942219136:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789996285.369608:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789996285.369635:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e07432d6780 going to sleep for 11 seconds 00000100:00100000:2.0:1789996285.370613:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942219136 00000100:00100000:2.0:1789996285.370622:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942219136 00000100:00100000:2.0:1789996285.370656:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1789996285.370669:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852be8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0c28cd8-555e-481f-bd03-c3b02aee51c5+18:5843:x1876946942219136:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789996285.370919:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852be8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0c28cd8-555e-481f-bd03-c3b02aee51c5+18:5843:x1876946942219136:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 249us (1309us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996285.370926:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1789996285.371063:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086f885500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5843:1876946942219136:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789996285.371101:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086f885500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5843:1876946942219264:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789996285.371141:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789996285.371172:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e07432d6780 going to sleep for 11 seconds 00000100:00100000:2.0:1789996285.371222:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942219264 00000100:00100000:2.0:1789996285.371227:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942219264 00000100:00100000:2.0:1789996285.371290:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1789996285.371297:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852ba5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+18:5843:x1876946942219264:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789996285.371428:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852ba5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+18:5843:x1876946942219264:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 131us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996285.371435:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1789996285.372269:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086f885500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5843:1876946942219264:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789996285.372517:0:11695:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086f885500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0c28cd8-555e-481f-bd03-c3b02aee51c5:11695:1876946942219392:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789996285.372599:0:11695:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789996285.372632:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942219392 00000100:00100000:3.0:1789996285.372638:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942219392 00000100:00100000:3.0:1789996285.372661:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1789996285.372669:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852ba4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0c28cd8-555e-481f-bd03-c3b02aee51c5+18:11695:x1876946942219392:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789996285.372823:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852ba4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0c28cd8-555e-481f-bd03-c3b02aee51c5+18:11695:x1876946942219392:12345-0@lo:502:llog_process_th.0 Request processed in 154us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996285.372835:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1789996285.372875:0:11695:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e07432d6900 going to sleep for 11 seconds 00000100:00100000:3.0:1789996285.372887:0:11695:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086f885500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0c28cd8-555e-481f-bd03-c3b02aee51c5:11695:1876946942219392:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789996285.372907:0:11695:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789996285.372917:0:11695:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789996285.372920:0:11695:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789996285.372927:0:11695:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8e0849c2f000 00000020:00000080:3.0:1789996285.372929:0:11695:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789996285.372999:0:11695:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086f885500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0c28cd8-555e-481f-bd03-c3b02aee51c5:11695:1876946942219520:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789996285.373034:0:11695:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789996285.373058:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942219520 00000100:00100000:3.0:1789996285.373062:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942219520 00000100:00100000:2.0:1789996285.373064:0:11695:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e07432d6900 going to sleep for 11 seconds 00000100:00100000:3.0:1789996285.373088:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1789996285.373095:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852ba7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0c28cd8-555e-481f-bd03-c3b02aee51c5+18:11695:x1876946942219520:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789996285.373233:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852ba7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0c28cd8-555e-481f-bd03-c3b02aee51c5+18:11695:x1876946942219520:12345-0@lo:502:llog_process_th.0 Request processed in 137us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996285.373240:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1789996285.373630:0:11695:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086f885500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0c28cd8-555e-481f-bd03-c3b02aee51c5:11695:1876946942219520:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789996285.373653:0:11695:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789996285.373659:0:11695:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789996285.373661:0:11695:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1789996285.373666:0:11695:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1789996285.373814:0:5843:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1789996285.373859:0:5843:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.137@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789996285.373869:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.137@tcp lock: ffff8e0876a23c00/0x4173739f0fc8094d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc80954 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996285.373881:0:5843:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.137@tcp lock: ffff8e0876a23c00/0x4173739f0fc8094d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc80954 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789996285.373891:0:5843:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789996285.373894:0:5843:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e08709bf800 from 7 10000000:01000000:3.0:1789996285.373903:0:5843:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789996285.374001:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.137@tcp lock: ffff8e087f856800/0x4173739f0fc8095b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996285.374010:0:5843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.137@tcp lock: ffff8e087f856800/0x4173739f0fc8095b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996285.374019:0:5843:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.137@tcp lock: ffff8e087f856800/0x4173739f0fc8095b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789996285.374035:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086f884e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5843:1876946942219648:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789996285.374071:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789996285.374100:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0847518600 going to sleep for 11 seconds 00000100:00100000:2.0:1789996285.374186:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942219648 00000100:00100000:2.0:1789996285.374191:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942219648 00000100:00100000:2.0:1789996285.374222:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1789996285.374228:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852ba6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0c28cd8-555e-481f-bd03-c3b02aee51c5+18:5843:x1876946942219648:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789996285.374237:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789996285.374248:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e0842de4000/0x4173739f0fc80962 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4173739f0fc8095b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996285.374281:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e0842de4000/0x4173739f0fc80962 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4173739f0fc8095b expref: 19 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996285.374446:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e0842de4000/0x4173739f0fc80962 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4173739f0fc8095b expref: 19 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996285.374455:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e0842de4000, rc 0) 00000100:00100000:2.0:1789996285.374514:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852ba6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0c28cd8-555e-481f-bd03-c3b02aee51c5+19:5843:x1876946942219648:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 286us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996285.374520:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1789996285.374606:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086f884e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5843:1876946942219648:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789996285.374618:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.137@tcp lock: ffff8e087f856800/0x4173739f0fc8095b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc80962 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996285.374626:0:5843:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.137@tcp lock: ffff8e087f856800/0x4173739f0fc8095b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4173739f0fc80962 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789996285.374665:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086f884e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5843:1876946942219776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789996285.374688:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789996285.374714:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0847518600 going to sleep for 11 seconds 00000100:00100000:1.0:1789996285.374996:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942219776 00000100:00100000:1.0:1789996285.375002:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942219776 00000100:00100000:1.0:1789996285.375034:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1789996285.375042:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852ba7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0c28cd8-555e-481f-bd03-c3b02aee51c5+19:5843:x1876946942219776:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789996285.375309:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852ba7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0c28cd8-555e-481f-bd03-c3b02aee51c5+19:5843:x1876946942219776:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 268us (618us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996285.375471:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1789996285.375499:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086f884e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5843:1876946942219776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789996285.375532:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086f884e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5843:1876946942219904:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789996285.375596:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789996285.375627:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0847518600 going to sleep for 11 seconds 00000100:00100000:1.0:1789996285.375878:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942219904 00000100:00100000:1.0:1789996285.375883:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942219904 00000100:00100000:1.0:1789996285.375912:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1789996285.375919:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852ba7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0c28cd8-555e-481f-bd03-c3b02aee51c5+19:5843:x1876946942219904:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789996285.376071:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852ba7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0c28cd8-555e-481f-bd03-c3b02aee51c5+19:5843:x1876946942219904:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 152us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996285.376077:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1789996285.376253:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086f884e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e0c28cd8-555e-481f-bd03-c3b02aee51c5:5843:1876946942219904:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789996285.377200:0:11697:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0741836a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0c28cd8-555e-481f-bd03-c3b02aee51c5:11697:1876946942220032:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789996285.377254:0:11697:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996285.377298:0:11697:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0848997f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789996285.377472:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942220032 00000100:00100000:1.0:1789996285.377477:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942220032 00000100:00100000:1.0:1789996285.377520:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1789996285.377529:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852ba5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0c28cd8-555e-481f-bd03-c3b02aee51c5+19:11697:x1876946942220032:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789996285.377749:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852ba5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0c28cd8-555e-481f-bd03-c3b02aee51c5+19:11697:x1876946942220032:12345-0@lo:502:llog_process_th.0 Request processed in 221us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996285.377755:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1789996285.377917:0:11697:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0741836a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0c28cd8-555e-481f-bd03-c3b02aee51c5:11697:1876946942220032:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789996285.377943:0:11697:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789996285.377953:0:11697:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789996285.377956:0:11697:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789996285.377964:0:11697:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8e08709bf800 00000020:00000080:0.0:1789996285.377967:0:11697:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789996285.378061:0:11697:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0741836a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0c28cd8-555e-481f-bd03-c3b02aee51c5:11697:1876946942220160:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789996285.378103:0:11697:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996285.378122:0:11697:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0848997f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789996285.378178:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942220160 00000100:00100000:3.0:1789996285.378189:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942220160 00000100:00100000:3.0:1789996285.378222:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1789996285.378230:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852ba6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+19:11697:x1876946942220160:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789996285.378416:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852ba6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+19:11697:x1876946942220160:12345-0@lo:502:llog_process_th.0 Request processed in 186us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996285.378424:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1789996285.378739:0:11697:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0741836a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e0c28cd8-555e-481f-bd03-c3b02aee51c5:11697:1876946942220160:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789996285.378759:0:11697:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789996285.378764:0:11697:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789996285.378765:0:11697:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1789996285.378769:0:11697:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1789996285.380191:0:5843:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1789996285.380217:0:5843:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.137@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789996285.380228:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.137@tcp lock: ffff8e087f856800/0x4173739f0fc8095b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc80962 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996285.380241:0:5843:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.137@tcp lock: ffff8e087f856800/0x4173739f0fc8095b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc80962 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789996285.387000:0:11698:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789996286.312874:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789996286.441428:0:11698:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789996286.952936:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789996286.952962:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e087f829500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876946942220288:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789996286.953034:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996286.953171:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942220288 00000100:00100000:2.0:1789996286.953179:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942220288 00000100:00100000:2.0:1789996286.953245:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789996286.953255:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0741836a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876946942220288:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789996286.953288:0:6691:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789996286.953333:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0741836a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876946942220288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996286.953339:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:3.0:1789996286.953413:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789996286.953580:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e087f829500 x1876946942220288/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789996302 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789996286.953599:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e087f829500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876946942220288:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789996287.337804:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789996287.789461:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996287.789498:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1789996287.789668:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927507584 00000100:00100000:3.0:1789996287.789678:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927507584 00000100:00100000:3.0:1789996287.789720:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 270 00000100:00100000:3.0:1789996287.789729:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852ba4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f78f7903-47ba-48a7-bb82-1f616cb85fc0+13:2365:x1876946927507584:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:3.0:1789996287.789789:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852ba4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f78f7903-47ba-48a7-bb82-1f616cb85fc0+13:2365:x1876946927507584:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 61us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996287.789796:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 270 00000100:00100000:2.0:1789996287.790258:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996287.790282:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1789996287.790344:0:9163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927507712 00000100:00100000:3.0:1789996287.790349:0:9163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927507712 00000100:00100000:0.0:1789996287.790359:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927507840 00000100:00100000:0.0:1789996287.790366:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927507840 00000100:00100000:3.0:1789996287.790388:0:9163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927507968 00000100:00100000:3.0:1789996287.790392:0:9163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927507968 00000100:00100000:3.0:1789996287.790407:0:9163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 94 00000100:00100000:3.0:1789996287.790426:0:9163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e087f82aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+5:2365:x1876946927507712:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:3.0:1789996287.790474:0:9163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e087f82aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+5:2365:x1876946927507712:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 49us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996287.790481:0:9163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 94 00000100:00100000:3.0:1789996287.790495:0:9163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 95 00000100:00100000:3.0:1789996287.790503:0:9163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e087f82bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cfc759a1-09a6-40ba-80a8-7399de51b555+5:2365:x1876946927507968:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:3.0:1789996287.790524:0:9163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e087f82bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cfc759a1-09a6-40ba-80a8-7399de51b555+5:2365:x1876946927507968:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 24us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996287.790530:0:9163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 95 00000100:00100000:3.0:1789996287.790624:0:8222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 54 00000100:00100000:3.0:1789996287.790630:0:8222:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e087f828e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+5:2365:x1876946927507840:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:3.0:1789996287.790660:0:8222:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e087f828e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+5:2365:x1876946927507840:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 30us (1161us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996287.790665:0:8222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 54 00000100:00080000:2.0:1789996287.790815:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789996287.790819:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789996287.977329:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e087f839f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876946942220544:0@lo:400:kworker.0 00000100:00100000:3.0:1789996287.977404:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996287.977431:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789996287.977449:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086f88a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e0c28cd8-555e-481f-bd03-c3b02aee51c5:3313:1876946942220416:0@lo:400:kworker.0 00000100:00100000:2.0:1789996287.977502:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996287.977595:0:9163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942220544 00000100:00100000:2.0:1789996287.977603:0:9163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942220544 00000100:00100000:0.0:1789996287.977666:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942220416 00000100:00100000:0.0:1789996287.977672:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942220416 00000100:00100000:2.0:1789996287.977684:0:9163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1789996287.977694:0:9163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086f884700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876946942220544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789996287.977817:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:0.0:1789996287.977822:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852ba4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0c28cd8-555e-481f-bd03-c3b02aee51c5+19:3313:x1876946942220416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789996287.977849:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852ba4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0c28cd8-555e-481f-bd03-c3b02aee51c5+19:3313:x1876946942220416:12345-0@lo:400:kworker.0 Request processed in 28us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996287.977854:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:0.0:1789996287.977940:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e087f838700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3316:1876946942220672:0@lo:400:kworker.0 00000100:00100000:0.0:1789996287.977958:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996287.977996:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942220672 00000100:00100000:0.0:1789996287.978000:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942220672 00000100:00100000:0.0:1789996287.978047:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1789996287.978053:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0741837480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1876946942220672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789996287.978094:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0741837480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1876946942220672:12345-0@lo:400:kworker.0 Request processed in 40us (133us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996287.978100:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1789996287.978133:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e087f838700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3316:1876946942220672:0@lo:400:kworker.0 00000100:00080000:0.0:1789996287.978167:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789996287.978191:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086f88a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e0c28cd8-555e-481f-bd03-c3b02aee51c5:3313:1876946942220416:0@lo:400:kworker.0 00000100:00100000:3.0:1789996287.979098:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e087f839f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876946942220544:0@lo:400:kworker.0 00000100:00100000:2.0:1789996287.979147:0:9163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086f884700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876946942220544:12345-0@lo:400:kworker.0 Request processed in 1400us (1689us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996287.979156:0:9163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1789996287.979256:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e087f838e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876946942220800:0@lo:400:kworker.0 00000100:00100000:3.0:1789996287.979282:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e087f83aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876946942221056:0@lo:400:kworker.0 00000100:00100000:0.0:1789996287.979298:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996287.979323:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789996287.979329:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e087f83b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3313:1876946942220928:0@lo:400:kworker.0 00000100:00100000:0.0:1789996287.979368:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789996287.979395:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996287.979833:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942220928 00000100:00100000:2.0:1789996287.979839:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942220928 00000100:00080000:3.0:1789996287.979964:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789996287.980223:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1789996287.980232:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0880f78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876946942220928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789996287.980299:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0880f78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876946942220928:12345-0@lo:400:kworker.0 Request processed in 68us (930us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996287.980319:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1789996287.980365:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e087f83b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3313:1876946942220928:0@lo:400:kworker.0 00000100:00100000:1.0:1789996287.982927:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942220800 00000100:00100000:1.0:1789996287.982941:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942220800 00000100:00100000:1.0:1789996287.983162:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942221056 00000100:00100000:1.0:1789996287.983167:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942221056 00000100:00080000:2.0:1789996287.983243:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789996287.983571:0:8222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789996287.983584:0:8222:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086f88a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1876946942220800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789996287.983682:0:8222:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086f88a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1876946942220800:12345-0@lo:400:kworker.0 Request processed in 92us (4375us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996287.983706:0:8222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789996287.983723:0:8222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789996287.983730:0:8222:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086f886d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1876946942221056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789996287.983766:0:8222:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086f886d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1876946942221056:12345-0@lo:400:kworker.0 Request processed in 37us (4373us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996287.983772:0:8222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789996287.983809:0:3315:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:3.0:1789996287.983815:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e086f88b100, transno 4294967300 00000100:00100000:3.0:1789996287.983830:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e087f83aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876946942221056:0@lo:400:kworker.0 00010000:00080000:2.0:1789996287.984225:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e087f838e00 x1876946942220800/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789996303 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789996287.984239:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e087f838e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876946942220800:0@lo:400:kworker.0 00010000:00010000:2.0:1789996288.361046:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789996288.488802:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789996288.488824:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e087f83ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876946942221184:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789996288.488887:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996288.489000:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942221184 00000100:00100000:1.0:1789996288.489008:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942221184 00000100:00100000:1.0:1789996288.489051:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789996288.489062:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086f886680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876946942221184:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789996288.489097:0:6691:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789996288.489163:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086f886680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876946942221184:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996288.489170:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789996288.489255:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e087f83ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876946942221184:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789996289.386920:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789996290.408935:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789996291.432830:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789996292.073883:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789996292.073906:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e087f829180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876946942221312:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789996292.073977:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996292.074142:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942221312 00000100:00100000:1.0:1789996292.074150:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942221312 00000100:00100000:1.0:1789996292.074224:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789996292.074234:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086f885880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876946942221312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789996292.074268:0:6691:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789996292.074362:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086f885880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876946942221312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 129us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996292.074370:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:1.0:1789996292.074419:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e087f829180 x1876946942221312/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789996308 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789996292.074438:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e087f829180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876946942221312:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789996292.074623:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789996292.456873:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789996292.913077:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996292.913126:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996292.913168:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996292.913207:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996292.913244:0:8222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927508352 00000100:00100000:2.0:1789996292.913253:0:8222:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927508352 00000100:00100000:2.0:1789996292.913337:0:8222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 57 00000100:00100000:2.0:1789996292.913349:0:8222:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e087f828000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+5:2362:x1876946927508352:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:3.0:1789996292.913374:0:9163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927508224 00000100:00100000:3.0:1789996292.913380:0:9163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927508224 00000100:00100000:3.0:1789996292.913417:0:9163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927508480 00000100:00100000:3.0:1789996292.913420:0:9163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927508480 00000100:00100000:2.0:1789996292.913439:0:8222:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e087f828000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+5:2362:x1876946927508352:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 92us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996292.913449:0:9163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 99 00000100:00100000:2.0:1789996292.913450:0:8222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 57 00000100:00100000:3.0:1789996292.913463:0:9163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e087f829180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+5:2362:x1876946927508224:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:2.0:1789996292.913487:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 100 00000100:00100000:2.0:1789996292.913497:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e087f829500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cfc759a1-09a6-40ba-80a8-7399de51b555+5:2362:x1876946927508480:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:3.0:1789996292.913515:0:9163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e087f829180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+5:2362:x1876946927508224:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 44us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996292.913523:0:9163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 99 00000100:00100000:2.0:1789996292.913528:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e087f829500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cfc759a1-09a6-40ba-80a8-7399de51b555+5:2362:x1876946927508480:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 33us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996292.913540:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 100 00000100:00080000:3.0:1789996292.913611:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789996292.913616:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789996292.914072:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927508096 00000100:00100000:1.0:1789996292.914079:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927508096 00000100:00100000:1.0:1789996292.914120:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 272 00000100:00100000:1.0:1789996292.914128:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852ba6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f78f7903-47ba-48a7-bb82-1f616cb85fc0+13:2362:x1876946927508096:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:1.0:1789996292.914175:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852ba6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f78f7903-47ba-48a7-bb82-1f616cb85fc0+13:2362:x1876946927508096:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 48us (1006us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996292.914182:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 272 00000100:00100000:2.0:1789996293.098749:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0847556680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3316:1876946942221696:0@lo:400:kworker.0 00000100:00100000:2.0:1789996293.098810:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996293.098871:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1789996293.098876:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0849c75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3316:1876946942221568:0@lo:400:kworker.0 00000100:00100000:2.0:1789996293.098894:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996293.098908:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0879939180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876946942222080:0@lo:400:kworker.0 00000100:00100000:2.0:1789996293.098946:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996293.098979:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942221696 00000100:00100000:2.0:1789996293.098986:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942221696 00000100:00100000:2.0:1789996293.099027:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942221568 00000100:00100000:2.0:1789996293.099029:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942221568 00000100:00100000:2.0:1789996293.099045:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1789996293.099052:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e087993b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1876946942221696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789996293.099097:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e087993b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1876946942221696:12345-0@lo:400:kworker.0 Request processed in 45us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996293.099113:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1789996293.099132:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1789996293.099139:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0879938700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1876946942221568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789996293.099163:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0879938700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1876946942221568:12345-0@lo:400:kworker.0 Request processed in 25us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996293.099169:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1789996293.099205:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0849c75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3316:1876946942221568:0@lo:400:kworker.0 00000100:00100000:2.0:1789996293.099213:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0847556680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3316:1876946942221696:0@lo:400:kworker.0 00000100:00100000:0.0:1789996293.099373:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0847556d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876946942221824:0@lo:400:kworker.0 00000100:00100000:0.0:1789996293.099409:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996293.099439:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789996293.099445:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0849c77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e0c28cd8-555e-481f-bd03-c3b02aee51c5:3313:1876946942221440:0@lo:400:kworker.0 00000100:00100000:0.0:1789996293.099472:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996293.099493:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e087993bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3313:1876946942221952:0@lo:400:kworker.0 00000100:00100000:0.0:1789996293.099524:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996293.099585:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942221440 00000100:00100000:0.0:1789996293.099590:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942221440 00000100:00100000:0.0:1789996293.099617:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:0.0:1789996293.099624:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852ba6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0c28cd8-555e-481f-bd03-c3b02aee51c5+19:3313:x1876946942221440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789996293.099681:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852ba6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0c28cd8-555e-481f-bd03-c3b02aee51c5+19:3313:x1876946942221440:12345-0@lo:400:kworker.0 Request processed in 57us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996293.099687:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:0.0:1789996293.099719:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0849c77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e0c28cd8-555e-481f-bd03-c3b02aee51c5:3313:1876946942221440:0@lo:400:kworker.0 00000100:00100000:0.0:1789996293.099733:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942221952 00000100:00100000:0.0:1789996293.099736:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942221952 00000100:00100000:0.0:1789996293.099757:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1789996293.099762:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0880f79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876946942221952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789996293.099789:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0880f79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876946942221952:12345-0@lo:400:kworker.0 Request processed in 27us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996293.099794:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1789996293.099814:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e087993bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3313:1876946942221952:0@lo:400:kworker.0 00000100:00100000:1.0:1789996293.099992:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942222080 00000100:00100000:1.0:1789996293.099997:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942222080 00000100:00100000:1.0:1789996293.100032:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942221824 00000100:00100000:1.0:1789996293.100034:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942221824 00000100:00100000:1.0:1789996293.100059:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789996293.100065:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e087993a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1876946942222080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789996293.100174:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e087993a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1876946942222080:12345-0@lo:400:kworker.0 Request processed in 40us (1158us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996293.100182:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789996293.100195:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789996293.100201:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0880f7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1876946942221824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789996293.100229:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0880f7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1876946942221824:12345-0@lo:400:kworker.0 Request processed in 29us (820us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996293.100234:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789996293.100262:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0879939180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876946942222080:0@lo:400:kworker.0 00000100:00080000:3.0:1789996293.100351:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789996293.100356:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1789996293.100510:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e0847556d80 x1876946942221824/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789996309 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789996293.100522:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0847556d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876946942221824:0@lo:400:kworker.0 00010000:00010000:1.0:1789996293.480913:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789996293.609029:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789996293.609073:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0879938000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876946942222208:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789996293.609139:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996293.609210:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942222208 00000100:00100000:2.0:1789996293.609218:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942222208 00000100:00100000:2.0:1789996293.609263:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789996293.609272:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0879939880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876946942222208:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789996293.609318:0:6691:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789996293.609362:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0879939880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876946942222208:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996293.609369:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789996293.609430:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0879938000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876946942222208:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789996294.504768:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789996295.528844:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789996296.555273:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789996296.684008:0:11698:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789996297.193594:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0879938000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876946942222336:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789996297.193669:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996297.193797:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942222336 00000100:00100000:1.0:1789996297.193805:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942222336 00000100:00100000:1.0:1789996297.193904:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789996297.193915:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0880f7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876946942222336:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789996297.193951:0:6691:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1789996297.194096:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789996297.195005:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0880f7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876946942222336:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1088us (1331us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996297.195014:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:0.0:1789996297.196494:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e0879938000 x1876946942222336/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789996313 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789996297.196525:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0879938000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876946942222336:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789996297.579730:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789996298.031411:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996298.031529:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996298.031629:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996298.031695:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927508608 00000100:00100000:0.0:1789996298.031705:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927508608 00000100:00100000:0.0:1789996298.031752:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 274 00000100:00100000:0.0:1789996298.031768:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852ba4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f78f7903-47ba-48a7-bb82-1f616cb85fc0+13:2365:x1876946927508608:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:0.0:1789996298.031846:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852ba4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f78f7903-47ba-48a7-bb82-1f616cb85fc0+13:2365:x1876946927508608:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 79us (1685us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996298.031863:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 274 00000100:00100000:2.0:1789996298.032787:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1789996298.032913:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927508864 00000100:00100000:1.0:1789996298.032919:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927508864 00000100:00100000:1.0:1789996298.032974:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 60 00000100:00100000:1.0:1789996298.032991:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0879938000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+5:2364:x1876946927508864:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:1.0:1789996298.033062:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0879938000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+5:2364:x1876946927508864:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 81us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996298.033070:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 60 00000100:00080000:2.0:1789996298.033459:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789996298.034717:0:9163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927508736 00000100:00100000:3.0:1789996298.034726:0:9163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927508736 00000100:00100000:3.0:1789996298.034865:0:9163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927508992 00000100:00100000:3.0:1789996298.034869:0:9163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927508992 00000100:00100000:1.0:1789996298.034927:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 104 00000100:00100000:1.0:1789996298.034939:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0879938380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+5:2365:x1876946927508736:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:1.0:1789996298.035028:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0879938380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+5:2365:x1876946927508736:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 92us (3499us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996298.035035:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 104 00000100:00080000:2.0:1789996298.036752:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789996298.036989:0:9163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 105 00000100:00100000:3.0:1789996298.037000:0:9163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0879939c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cfc759a1-09a6-40ba-80a8-7399de51b555+5:2364:x1876946927508992:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:3.0:1789996298.038536:0:9163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0879939c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cfc759a1-09a6-40ba-80a8-7399de51b555+5:2364:x1876946927508992:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 1533us (6902us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996298.038567:0:9163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 105 00000100:00100000:0.0:1789996298.216772:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789996298.217570:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0847556d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3316:1876946942222720:0@lo:400:kworker.0 00000100:00100000:1.0:1789996298.217627:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996298.217673:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789996298.217676:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e087993bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3316:1876946942222592:0@lo:400:kworker.0 00000100:00100000:1.0:1789996298.217689:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996298.217711:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942222720 00000100:00100000:1.0:1789996298.217716:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942222720 00000100:00100000:1.0:1789996298.217754:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942222592 00000100:00100000:1.0:1789996298.217756:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942222592 00000100:00100000:1.0:1789996298.217779:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1789996298.217785:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e087f83ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1876946942222720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789996298.217831:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e087f83ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1876946942222720:12345-0@lo:400:kworker.0 Request processed in 46us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996298.217838:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1789996298.217855:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1789996298.217861:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e087f838e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1876946942222592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789996298.217892:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e087f838e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1876946942222592:12345-0@lo:400:kworker.0 Request processed in 31us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996298.217911:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00080000:3.0:1789996298.217946:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789996298.217947:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e087993bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3316:1876946942222592:0@lo:400:kworker.0 00000100:00100000:1.0:1789996298.217957:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0847556d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3316:1876946942222720:0@lo:400:kworker.0 00000100:00100000:0.0:1789996298.218305:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0847556680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876946942222848:0@lo:400:kworker.0 00000100:00100000:0.0:1789996298.218337:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996298.218418:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0879939180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e0c28cd8-555e-481f-bd03-c3b02aee51c5:3313:1876946942222464:0@lo:400:kworker.0 00000100:00100000:0.0:1789996298.218445:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789996298.218528:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942222464 00000100:00100000:3.0:1789996298.218533:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942222464 00000100:00100000:3.0:1789996298.218583:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:3.0:1789996298.218590:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852ba7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+19:3313:x1876946942222464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789996298.218631:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852ba7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+19:3313:x1876946942222464:12345-0@lo:400:kworker.0 Request processed in 42us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996298.218638:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:3.0:1789996298.218673:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0879939180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e0c28cd8-555e-481f-bd03-c3b02aee51c5:3313:1876946942222464:0@lo:400:kworker.0 00000100:00100000:1.0:1789996298.218765:0:8222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942222848 00000100:00100000:1.0:1789996298.218769:0:8222:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942222848 00000100:00100000:1.0:1789996298.218839:0:8222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789996298.218846:0:8222:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0880f7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1876946942222848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789996298.218887:0:8222:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0880f7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1876946942222848:12345-0@lo:400:kworker.0 Request processed in 43us (550us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996298.218894:0:8222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00010000:00080000:3.0:1789996298.219005:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e0847556680 x1876946942222848/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789996314 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789996298.219016:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0847556680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876946942222848:0@lo:400:kworker.0 00000100:00100000:3.0:1789996298.219968:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789996298.220125:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789996298.220136:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0847556d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876946942223104:0@lo:400:kworker.0 00000100:00100000:1.0:1789996298.220191:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996298.220329:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942223104 00000100:00100000:2.0:1789996298.220334:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942223104 00000100:00100000:2.0:1789996298.220380:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789996298.220387:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e087f83aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1876946942223104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789996298.220426:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e087f83aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1876946942223104:12345-0@lo:400:kworker.0 Request processed in 39us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996298.220432:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:1.0:1789996298.220528:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789996298.220566:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0847556d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876946942223104:0@lo:400:kworker.0 00000100:00100000:3.0:1789996298.220673:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0847556680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3313:1876946942222976:0@lo:400:kworker.0 00000100:00100000:3.0:1789996298.220700:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996298.220782:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942222976 00000100:00100000:1.0:1789996298.220786:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942222976 00000100:00100000:1.0:1789996298.220917:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789996298.220924:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086f884000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876946942222976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789996298.220965:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086f884000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876946942222976:12345-0@lo:400:kworker.0 Request processed in 41us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996298.220983:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1789996298.221119:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0847556680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3313:1876946942222976:0@lo:400:kworker.0 00000100:00080000:3.0:1789996298.221357:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789996298.600804:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789996298.729004:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789996298.729026:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0847556680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876946942223232:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789996298.729091:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789996298.730041:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942223232 00000100:00100000:3.0:1789996298.730052:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942223232 00000100:00100000:3.0:1789996298.730109:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789996298.730119:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0880f78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876946942223232:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789996298.730161:0:6692:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789996298.730441:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0847556680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876946942223232:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789996298.730874:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0880f78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876946942223232:12345-0@lo:13:osp-pre-1-0.0 Request processed in 124us (1151us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996298.730883:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00010000:1.0:1789996299.625392:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789996300.650219:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789996301.674470:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789996302.313352:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789996302.313390:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0847556680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876946942223360:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789996302.313464:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996302.315223:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942223360 00000100:00100000:2.0:1789996302.315233:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942223360 00000100:00100000:2.0:1789996302.315329:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789996302.315339:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e087f83b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876946942223360:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789996302.315377:0:6691:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789996302.315448:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e087f83b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876946942223360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 110us (1983us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996302.315456:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:1.0:1789996302.315858:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e0847556680 x1876946942223360/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789996318 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789996302.315879:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0847556680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876946942223360:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789996302.316240:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789996302.699884:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789996303.155650:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996303.155741:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1789996303.156207:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927509120 00000100:00100000:1.0:1789996303.156221:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927509120 00000100:00100000:1.0:1789996303.156296:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 276 00000100:00100000:1.0:1789996303.156311:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852ba5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f78f7903-47ba-48a7-bb82-1f616cb85fc0+13:2364:x1876946927509120:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:1.0:1789996303.156425:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852ba5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f78f7903-47ba-48a7-bb82-1f616cb85fc0+13:2364:x1876946927509120:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 117us (682us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996303.156433:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 276 00000100:00100000:3.0:1789996303.157669:0:9163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927509248 00000100:00100000:3.0:1789996303.157683:0:9163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927509248 00000100:00100000:0.0:1789996303.157904:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 109 00000100:00100000:0.0:1789996303.157918:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0847556680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+5:2364:x1876946927509248:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:0.0:1789996303.158002:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0847556680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+5:2364:x1876946927509248:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 88us (2369us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996303.158009:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 109 00000100:00080000:1.0:1789996303.158643:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789996303.174791:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996303.174883:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996303.175054:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927509376 00000100:00100000:0.0:1789996303.175077:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927509376 00000100:00100000:0.0:1789996303.175189:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 19 00000100:00100000:0.0:1789996303.175204:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0847556d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+5:2361:x1876946927509376:12345-192.168.204.37@tcp:9:kworker.0 00000020:00000080:0.0:1789996303.175248:0:6690:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4173739f0fc8089e 00000100:00080000:0.0:1789996303.175261:0:6690:0:(import.c:65:import_set_state_nolock()) ffff8e087f8ef800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789996303.175313:0:6690:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:0.0:1789996303.175892:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0847556d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+2:2361:x1876946927509376:12345-192.168.204.37@tcp:9:kworker.0 Request processed in 690us (1114us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996303.175911:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 19 00010000:00010000:0.0:1789996303.175941:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789996303.176414:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927509504 00000100:00100000:1.0:1789996303.176421:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927509504 00000100:00100000:1.0:1789996303.176488:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 110 00000100:00100000:1.0:1789996303.176498:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0849c77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cfc759a1-09a6-40ba-80a8-7399de51b555+5:2365:x1876946927509504:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:1.0:1789996303.176539:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0849c77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cfc759a1-09a6-40ba-80a8-7399de51b555+5:2365:x1876946927509504:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 44us (1657us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996303.176568:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 110 00000100:00080000:3.0:1789996303.187845:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789996303.187861:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789996303.336991:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0876619c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3316:1876946942223744:0@lo:400:kworker.0 00000100:00100000:2.0:1789996303.337089:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996303.337187:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1789996303.337194:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e087661b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3316:1876946942223616:0@lo:400:kworker.0 00000100:00100000:2.0:1789996303.337218:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996303.337236:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e087661b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876946942224128:0@lo:400:kworker.0 00000100:00100000:2.0:1789996303.337261:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996303.337304:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942224128 00000100:00100000:2.0:1789996303.337314:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942224128 00000100:00100000:2.0:1789996303.337387:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789996303.337397:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0876618a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1876946942224128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789996303.337460:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0876618a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1876946942224128:12345-0@lo:400:kworker.0 Request processed in 64us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996303.337468:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789996303.337504:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942223744 00000100:00100000:2.0:1789996303.337508:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942223744 00000100:00100000:2.0:1789996303.337534:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942223616 00000100:00100000:2.0:1789996303.337537:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942223616 00000100:00100000:3.0:1789996303.337630:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0876618380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876946942223872:0@lo:400:kworker.0 00000100:00100000:3.0:1789996303.337663:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789996303.337690:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1789996303.337696:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0849c75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e0c28cd8-555e-481f-bd03-c3b02aee51c5:3313:1876946942223488:0@lo:400:kworker.0 00000100:00100000:3.0:1789996303.337728:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789996303.337752:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e087661ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3313:1876946942224000:0@lo:400:kworker.0 00000100:00100000:3.0:1789996303.337774:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789996303.337801:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789996303.337807:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789996303.337820:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942223488 00000100:00100000:3.0:1789996303.337824:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942223488 00000100:00100000:3.0:1789996303.337864:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:3.0:1789996303.337872:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852ba5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0c28cd8-555e-481f-bd03-c3b02aee51c5+19:3313:x1876946942223488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789996303.337941:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852ba5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0c28cd8-555e-481f-bd03-c3b02aee51c5+19:3313:x1876946942223488:12345-0@lo:400:kworker.0 Request processed in 69us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996303.337948:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:3.0:1789996303.337982:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942224000 00000100:00100000:3.0:1789996303.337986:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942224000 00000100:00100000:3.0:1789996303.338011:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1789996303.338016:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0876619880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1876946942223744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789996303.338044:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0876619880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1876946942223744:12345-0@lo:400:kworker.0 Request processed in 28us (956us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996303.338049:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1789996303.338061:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1789996303.338066:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086f885c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876946942224000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789996303.338093:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086f885c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876946942224000:12345-0@lo:400:kworker.0 Request processed in 26us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996303.338099:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00080000:3.0:1789996303.338128:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789996303.338161:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0849c75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e0c28cd8-555e-481f-bd03-c3b02aee51c5:3313:1876946942223488:0@lo:400:kworker.0 00000100:00100000:3.0:1789996303.338182:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e087661ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3313:1876946942224000:0@lo:400:kworker.0 00000100:00100000:3.0:1789996303.338210:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942223872 00000100:00100000:3.0:1789996303.338213:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942223872 00000100:00100000:3.0:1789996303.338238:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789996303.338244:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086f886300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1876946942223872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789996303.338278:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086f886300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1876946942223872:12345-0@lo:400:kworker.0 Request processed in 34us (614us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996303.338285:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00010000:00080000:3.0:1789996303.338324:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e0876618380 x1876946942223872/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789996319 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789996303.338337:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0876618380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876946942223872:0@lo:400:kworker.0 00000100:00100000:3.0:1789996303.338383:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e087661b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876946942224128:0@lo:400:kworker.0 00000100:00100000:3.0:1789996303.338394:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0876619c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3316:1876946942223744:0@lo:400:kworker.0 00000100:00100000:1.0:1789996303.340145:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1789996303.340167:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0876619f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1876946942223616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789996303.340272:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0876619f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1876946942223616:12345-0@lo:400:kworker.0 Request processed in 114us (3052us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996303.340279:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1789996303.340430:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e087661b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3316:1876946942223616:0@lo:400:kworker.0 00010000:00010000:2.0:1789996303.724486:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789996303.849394:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0876618e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876946942224256:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789996303.849519:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996303.849905:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942224256 00000100:00100000:2.0:1789996303.849917:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942224256 00000100:00100000:2.0:1789996303.849980:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789996303.849991:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086f884e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1876946942224256:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789996303.850052:0:6691:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789996303.850227:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086f884e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1876946942224256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 237us (709us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996303.850236:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789996303.857475:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0876618e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876946942224256:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789996304.745829:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1789996305.459638:0:7659:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 189efa8a-c7eb-4b69-9afa-1dd36d6775f1 00000020:00000080:0.0:1789996305.459651:0:7659:0:(genops.c:885:class_export_put()) final put ffff8e087f8ef000/189efa8a-c7eb-4b69-9afa-1dd36d6775f1 00000020:00000080:2.0:1789996305.459736:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8e087f8ef000/189efa8a-c7eb-4b69-9afa-1dd36d6775f1 for lustre-OST0001 00000020:00000080:2.0:1789996305.459818:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e087f8ef800 for lustre-OST0001 00010000:00010000:2.0:1789996305.773354:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789996306.796755:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789996306.923138:0:11698:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1789996307.433899:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0876618700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876946942224384:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789996307.434007:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996307.434141:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942224384 00000100:00100000:1.0:1789996307.434152:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942224384 00000100:00100000:1.0:1789996307.434238:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789996307.434250:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086f885500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876946942224384:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789996307.434293:0:6691:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1789996307.434456:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789996307.439228:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086f885500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876946942224384:12345-0@lo:13:osp-pre-0-0.0 Request processed in 4963us (5204us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996307.439249:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:3.0:1789996307.440186:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e0876618700 x1876946942224384/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789996323 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789996307.440220:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0876618700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876946942224384:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789996307.817746:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789996308.270948:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1789996308.270995:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1789996308.271035:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1789996308.271071:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927509888 00000100:00100000:1.0:1789996308.271085:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927509888 00000100:00100000:1.0:1789996308.271163:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927509760 00000100:00100000:1.0:1789996308.271167:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927509760 00000100:00080000:2.0:1789996308.271198:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789996308.271245:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927509632 00000100:00100000:0.0:1789996308.271252:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927509632 00000100:00100000:0.0:1789996308.271292:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 278 00000100:00100000:0.0:1789996308.271305:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852ba0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f78f7903-47ba-48a7-bb82-1f616cb85fc0+13:2364:x1876946927509632:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:1.0:1789996308.271345:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 114 00000100:00100000:1.0:1789996308.271357:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e087f839f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cfc759a1-09a6-40ba-80a8-7399de51b555+5:2364:x1876946927509888:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:2.0:1789996308.272090:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 115 00000100:00100000:2.0:1789996308.272105:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e087f838700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+5:2364:x1876946927509760:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:0.0:1789996308.275136:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852ba0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f78f7903-47ba-48a7-bb82-1f616cb85fc0+13:2364:x1876946927509632:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 3820us (4191us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996308.276519:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e087f838700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+5:2364:x1876946927509760:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 4406us (5470us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996308.276557:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 115 00000100:00100000:0.0:1789996308.277215:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 278 00000100:00100000:2.0:1789996308.277633:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e087f839f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cfc759a1-09a6-40ba-80a8-7399de51b555+5:2364:x1876946927509888:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 6276us (6633us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996308.277644:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 114 00000100:00100000:2.0:1789996308.456823:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0876618e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876946942224640:0@lo:400:kworker.0 00000100:00100000:2.0:1789996308.456922:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996308.456988:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0876618380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876946942225152:0@lo:400:kworker.0 00000100:00100000:2.0:1789996308.457245:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996308.457284:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789996308.457290:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e087661b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1876946942224768:0@lo:400:kworker.0 00000100:00100000:2.0:1789996308.457314:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996308.457354:0:9163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942224640 00000100:00100000:2.0:1789996308.457456:0:9163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942224640 00000100:00100000:2.0:1789996308.457515:0:9163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942224768 00000100:00100000:2.0:1789996308.457519:0:9163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942224768 00000100:00100000:2.0:1789996308.457588:0:9163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1789996308.457599:0:9163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e087661ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876946942224640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789996308.457748:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0876618700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e0c28cd8-555e-481f-bd03-c3b02aee51c5:3314:1876946942224512:0@lo:400:kworker.0 00000100:00100000:0.0:1789996308.457795:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996308.457825:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e087661b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3314:1876946942225024:0@lo:400:kworker.0 00000100:00100000:0.0:1789996308.457848:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996308.457861:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789996308.457868:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0876619c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876946942224896:0@lo:400:kworker.0 00000100:00100000:0.0:1789996308.457888:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996308.457922:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942225024 00000100:00100000:0.0:1789996308.457934:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942225024 00000100:00100000:0.0:1789996308.457961:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1789996308.457967:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086d7f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876946942224768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789996308.458036:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086d7f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876946942224768:12345-0@lo:400:kworker.0 Request processed in 68us (720us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996308.458042:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1789996308.458764:0:9163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e087661ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876946942224640:12345-0@lo:400:kworker.0 Request processed in 1164us (1840us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996308.458773:0:9163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1789996308.458797:0:9163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1789996308.458807:0:9163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0880f7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876946942225024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789996308.458847:0:9163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0880f7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876946942225024:12345-0@lo:400:kworker.0 Request processed in 43us (997us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996308.458854:0:9163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1789996308.458883:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942225152 00000100:00100000:2.0:1789996308.458887:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942225152 00000100:00100000:2.0:1789996308.458922:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942224896 00000100:00100000:2.0:1789996308.458925:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942224896 00000100:00100000:2.0:1789996308.458947:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789996308.458954:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086d7f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1876946942225152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789996308.458989:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086d7f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1876946942225152:12345-0@lo:400:kworker.0 Request processed in 35us (1937us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996308.458996:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789996308.459021:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789996308.459028:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0880f79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1876946942224896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789996308.459405:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942224512 00000100:00100000:0.0:1789996308.459411:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942224512 00000100:00100000:2.0:1789996308.459499:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0880f79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1876946942224896:12345-0@lo:400:kworker.0 Request processed in 471us (1608us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996308.459506:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:2.0:1789996308.459531:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789996308.459538:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789996308.462206:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:0.0:1789996308.462232:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852ba0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+19:3314:x1876946942224512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789996308.462335:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852ba0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+19:3314:x1876946942224512:12345-0@lo:400:kworker.0 Request processed in 115us (4538us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996308.462343:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00010000:00080000:0.0:1789996308.472029:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e0876619c00 x1876946942224896/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789996324 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789996308.472281:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0876619c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876946942224896:0@lo:400:kworker.0 00000100:00100000:0.0:1789996308.472302:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0876618700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e0c28cd8-555e-481f-bd03-c3b02aee51c5:3314:1876946942224512:0@lo:400:kworker.0 00000100:00100000:0.0:1789996308.472318:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e087661b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3314:1876946942225024:0@lo:400:kworker.0 00000100:00100000:3.0:1789996308.472775:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e087661b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1876946942224768:0@lo:400:kworker.0 00000100:00100000:3.0:1789996308.472791:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0876618e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876946942224640:0@lo:400:kworker.0 00000100:00100000:3.0:1789996308.472803:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0876618380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876946942225152:0@lo:400:kworker.0 00010000:00010000:0.0:1789996308.841320:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789996308.972083:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789996308.972120:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086d7f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876946942225280:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789996308.972288:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996308.972816:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942225280 00000100:00100000:2.0:1789996308.972829:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942225280 00000100:00100000:2.0:1789996308.972912:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789996308.972944:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086f884a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876946942225280:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789996308.972993:0:6692:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789996308.973080:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086f884a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876946942225280:12345-0@lo:13:osp-pre-1-0.0 Request processed in 139us (791us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996308.973089:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789996308.975228:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086d7f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876946942225280:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789996309.865466:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789996310.540269:0:11863:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 09:11:48 (1789996308) 00010000:00010000:0.0:1789996310.889735:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789996311.913176:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789996312.553257:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0879939180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876946942225408:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789996312.553329:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996312.555059:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942225408 00000100:00100000:2.0:1789996312.555072:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942225408 00000100:00100000:2.0:1789996312.555165:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789996312.555187:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086f885f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876946942225408:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789996312.555630:0:6692:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789996312.555717:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086f885f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876946942225408:12345-0@lo:13:osp-pre-0-0.0 Request processed in 531us (2387us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996312.555726:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:0.0:1789996312.555867:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789996312.556270:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e0879939180 x1876946942225408/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789996328 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789996312.556295:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0879939180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876946942225408:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789996312.936743:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789996313.388589:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1789996313.388638:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1789996313.388675:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996313.388749:0:9163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927510144 00000100:00100000:2.0:1789996313.388759:0:9163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927510144 00000100:00100000:2.0:1789996313.388830:0:9163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927510272 00000100:00100000:2.0:1789996313.388833:0:9163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927510272 00000100:00100000:2.0:1789996313.388857:0:9163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 119 00000100:00100000:2.0:1789996313.388867:0:9163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e087993bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+5:2364:x1876946927510144:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:2.0:1789996313.388947:0:9163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e087993bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+5:2364:x1876946927510144:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 81us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996313.388955:0:9163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 119 00000100:00100000:2.0:1789996313.388987:0:9163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 120 00000100:00100000:2.0:1789996313.388993:0:9163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0879939180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cfc759a1-09a6-40ba-80a8-7399de51b555+5:2364:x1876946927510272:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:2.0:1789996313.389017:0:9163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0879939180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cfc759a1-09a6-40ba-80a8-7399de51b555+5:2364:x1876946927510272:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 24us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996313.389040:0:9163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 120 00000100:00100000:3.0:1789996313.389699:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927510016 00000100:00100000:3.0:1789996313.389705:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927510016 00000100:00100000:3.0:1789996313.389745:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 280 00000100:00100000:3.0:1789996313.389753:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852ba2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f78f7903-47ba-48a7-bb82-1f616cb85fc0+13:2364:x1876946927510016:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:3.0:1789996313.389796:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852ba2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f78f7903-47ba-48a7-bb82-1f616cb85fc0+13:2364:x1876946927510016:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 44us (1158us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996313.389803:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 280 00000100:00080000:1.0:1789996313.391856:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789996313.494573:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996313.494723:0:9163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927510400 00000100:00100000:2.0:1789996313.494734:0:9163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927510400 00000100:00100000:2.0:1789996313.494803:0:9163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 32 00000100:00100000:2.0:1789996313.494823:0:9163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fa70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+5:10226:x1876946927510400:12345-192.168.204.37@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789996313.494843:0:9163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789996313.494866:0:9163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5800/0x4173739f0fc80969 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b97003095e354ec expref: -99 pid: 9163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996313.494951:0:9163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5c00/0x4173739f0fc80970 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996313.494967:0:9163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5c00/0x4173739f0fc80970 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996313.494980:0:9163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5c00/0x4173739f0fc80970 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789996313.495015:0:9163:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789996313.495020:0:9163:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789996313.495059:0:9163:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5c00/0x4173739f0fc80970 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996313.495084:0:9163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5800/0x4173739f0fc80969 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e354ec expref: 7 pid: 9163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996313.495242:0:9163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5c00/0x4173739f0fc80970 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e354ec expref: 6 pid: 9163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996313.495349:0:9163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e084601b400) 00010000:00010000:2.0:1789996313.495353:0:9163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789996313.495357:0:9163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e0842de5c00, rc 0) 00000100:00100000:2.0:1789996313.495430:0:9163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fa70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+6:10226:x1876946927510400:12345-192.168.204.37@tcp:101:lhsmtool_posix.0 Request processed in 617us (894us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996313.495437:0:9163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 32 00000100:00100000:0.0:1789996313.506085:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996313.506252:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927510528 00000100:00100000:2.0:1789996313.506263:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927510528 00000100:00100000:2.0:1789996313.506430:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 33 00000100:00100000:2.0:1789996313.506440:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0880f7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+6:10227:x1876946927510528:12345-192.168.204.37@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789996313.506460:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789996313.506613:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5800/0x4173739f0fc80977 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b97003095e354f3 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996313.506676:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4600/0x4173739f0fc8097e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996313.506693:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4600/0x4173739f0fc8097e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996313.506705:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4600/0x4173739f0fc8097e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996313.506717:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4200/0x4173739f0fc80985 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996313.506723:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4200/0x4173739f0fc80985 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996313.506742:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4200/0x4173739f0fc80985 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996313.507648:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5e00/0x4173739f0fc8098c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996313.507662:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5e00/0x4173739f0fc8098c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996313.507670:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5e00/0x4173739f0fc8098c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789996313.507697:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789996313.507700:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789996313.507717:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5e00/0x4173739f0fc8098c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996313.507728:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4600/0x4173739f0fc8097e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996313.507733:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4600/0x4173739f0fc8097e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996313.507740:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4600/0x4173739f0fc8097e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996313.507745:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0842de4600 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:2.0:1789996313.507749:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4600/0x4173739f0fc8097e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996313.507756:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4600/0x4173739f0fc8097e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996313.507773:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e084601b400) 00010000:00010000:2.0:1789996313.507776:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789996313.507781:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4600/0x4173739f0fc8097e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996313.507787:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4600/0x4173739f0fc8097e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996313.507799:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4200/0x4173739f0fc80985 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996313.507804:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4200/0x4173739f0fc80985 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996313.507809:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4200/0x4173739f0fc80985 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996313.507834:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0842de4200 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:2.0:1789996313.507837:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4200/0x4173739f0fc80985 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996313.507843:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4200/0x4173739f0fc80985 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996313.507851:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8e084601bf00) 00010000:00010000:2.0:1789996313.507853:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789996313.507856:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4200/0x4173739f0fc80985 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996313.507861:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4200/0x4173739f0fc80985 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996313.509157:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5800/0x4173739f0fc80977 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e354f3 expref: 8 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996313.509170:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5e00/0x4173739f0fc8098c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e354f3 expref: 7 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996313.509178:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8e084601b800) 00010000:00010000:2.0:1789996313.509181:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789996313.509183:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e0842de5e00, rc 0) 00000100:00100000:2.0:1789996313.509257:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0880f7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+7:10227:x1876946927510528:12345-192.168.204.37@tcp:101:lhsmtool_posix.0 Request processed in 2818us (3181us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996313.509278:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 33 00000100:00100000:3.0:1789996313.514918:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996313.515249:0:9163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927510784 00000100:00100000:2.0:1789996313.515258:0:9163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927510784 00000100:00100000:2.0:1789996313.515333:0:9163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 34 00000100:00100000:2.0:1789996313.515343:0:9163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086f887800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+7:10227:x1876946927510784:12345-192.168.204.37@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789996313.515364:0:9163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789996313.515384:0:9163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5a00/0x4173739f0fc80993 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b97003095e354fa expref: -99 pid: 9163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996313.515452:0:9163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4e00/0x4173739f0fc8099a lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996313.515466:0:9163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4e00/0x4173739f0fc8099a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996313.515488:0:9163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4e00/0x4173739f0fc8099a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996313.515593:0:9163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4800/0x4173739f0fc809a1 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996313.515602:0:9163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4800/0x4173739f0fc809a1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996313.515609:0:9163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4800/0x4173739f0fc809a1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996313.515949:0:9163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4a00/0x4173739f0fc809a8 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996313.515968:0:9163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4a00/0x4173739f0fc809a8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996313.515975:0:9163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4a00/0x4173739f0fc809a8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789996313.515985:0:9163:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:2.0:1789996313.516138:0:9163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4e00/0x4173739f0fc8099a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996313.516146:0:9163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4e00/0x4173739f0fc8099a lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996313.516152:0:9163:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4e00/0x4173739f0fc8099a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996313.516157:0:9163:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0842de4e00 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:2.0:1789996313.516161:0:9163:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4e00/0x4173739f0fc8099a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996313.516178:0:9163:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4e00/0x4173739f0fc8099a lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996313.516190:0:9163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8e084601b800) 00010000:00010000:2.0:1789996313.516194:0:9163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789996313.516199:0:9163:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4e00/0x4173739f0fc8099a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996313.516205:0:9163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4e00/0x4173739f0fc8099a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996313.516217:0:9163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4800/0x4173739f0fc809a1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996313.516224:0:9163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4800/0x4173739f0fc809a1 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996313.516229:0:9163:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4800/0x4173739f0fc809a1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996313.516235:0:9163:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0842de4800 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:2.0:1789996313.516238:0:9163:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4800/0x4173739f0fc809a1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996313.516244:0:9163:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4800/0x4173739f0fc809a1 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996313.516250:0:9163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8e084601b700) 00010000:00010000:2.0:1789996313.516252:0:9163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789996313.516255:0:9163:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4800/0x4173739f0fc809a1 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996313.516271:0:9163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4800/0x4173739f0fc809a1 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996313.516745:0:9163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5a00/0x4173739f0fc80993 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e354fa expref: 10 pid: 9163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996313.516760:0:9163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4a00/0x4173739f0fc809a8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e354fa expref: 9 pid: 9163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996313.516768:0:9163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e084601b600) 00010000:00010000:2.0:1789996313.516770:0:9163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789996313.516773:0:9163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e0842de4a00, rc 0) 00000100:00100000:2.0:1789996313.516835:0:9163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086f887800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+9:10227:x1876946927510784:12345-192.168.204.37@tcp:101:lhsmtool_posix.0 Request processed in 1492us (1936us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1789996313.516844:0:9163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 34 00000100:00100000:1.0:1789996313.526990:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996313.527859:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927510912 00000100:00100000:0.0:1789996313.527871:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927510912 00000100:00100000:0.0:1789996313.527947:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 35 00000100:00100000:0.0:1789996313.527984:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fa93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+9:10227:x1876946927510912:12345-192.168.204.37@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1789996313.528114:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fa93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+9:10227:x1876946927510912:12345-192.168.204.37@tcp:59:lhsmtool_posix.0 Request processed in 133us (1134us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996313.528122:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 35 00000100:00100000:0.0:1789996313.577197:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0880f79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3316:1876946942225792:0@lo:400:kworker.0 00000100:00100000:0.0:1789996313.577284:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996313.577354:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1789996313.577361:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0880f7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3316:1876946942225664:0@lo:400:kworker.0 00000100:00100000:0.0:1789996313.577382:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996313.577397:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0880f78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876946942226176:0@lo:400:kworker.0 00000100:00100000:0.0:1789996313.577418:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996313.577457:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942226176 00000100:00100000:0.0:1789996313.577464:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942226176 00000100:00100000:3.0:1789996313.577501:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0880f78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876946942225920:0@lo:400:kworker.0 00000100:00100000:3.0:1789996313.577530:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789996313.577576:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1789996313.577582:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0880f79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e0c28cd8-555e-481f-bd03-c3b02aee51c5:3313:1876946942225536:0@lo:400:kworker.0 00000100:00100000:3.0:1789996313.577612:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789996313.577634:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0880f7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3313:1876946942226048:0@lo:400:kworker.0 00000100:00100000:3.0:1789996313.577654:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789996313.577679:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942225920 00000100:00100000:3.0:1789996313.577683:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942225920 00000100:00100000:1.0:1789996313.577700:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942225792 00000100:00100000:1.0:1789996313.577716:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942225792 00000100:00100000:3.0:1789996313.577727:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789996313.577735:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086f887480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1876946942225920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789996313.577746:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942225664 00000100:00100000:1.0:1789996313.577748:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942225664 00000100:00100000:1.0:1789996313.577758:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942226048 00000100:00100000:1.0:1789996313.577760:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942226048 00000100:00100000:1.0:1789996313.577773:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1789996313.577779:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0880f78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1876946942225792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789996313.577794:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086f887480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1876946942225920:12345-0@lo:400:kworker.0 Request processed in 46us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996313.577800:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789996313.577817:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0880f78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1876946942225792:12345-0@lo:400:kworker.0 Request processed in 38us (533us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996313.577822:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1789996313.577845:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1789996313.577850:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0880f7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1876946942225664:12345-0@lo:400:kworker.0 00010000:00080000:3.0:1789996313.577858:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e0880f78700 x1876946942225920/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789996329 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789996313.577872:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0880f78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876946942225920:0@lo:400:kworker.0 00000100:00100000:1.0:1789996313.577873:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0880f7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1876946942225664:12345-0@lo:400:kworker.0 Request processed in 24us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996313.577879:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1789996313.577888:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1789996313.577894:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086f887b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876946942226048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789996313.577920:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942225536 00000100:00100000:3.0:1789996313.577924:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942225536 00000100:00100000:1.0:1789996313.577936:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086f887b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876946942226048:12345-0@lo:400:kworker.0 Request processed in 43us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996313.577942:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1789996313.577944:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:3.0:1789996313.577949:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852ba2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+19:3313:x1876946942225536:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1789996313.577956:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789996313.577974:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0880f7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3316:1876946942225664:0@lo:400:kworker.0 00000100:00100000:1.0:1789996313.577984:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0880f79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3316:1876946942225792:0@lo:400:kworker.0 00000100:00100000:1.0:1789996313.578006:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0880f7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3313:1876946942226048:0@lo:400:kworker.0 00000100:00100000:3.0:1789996313.578188:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852ba2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+19:3313:x1876946942225536:12345-0@lo:400:kworker.0 Request processed in 238us (574us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996313.578195:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:1.0:1789996313.579395:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0880f79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e0c28cd8-555e-481f-bd03-c3b02aee51c5:3313:1876946942225536:0@lo:400:kworker.0 00000100:00100000:1.0:1789996313.579512:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789996313.579520:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0880f79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1876946942226176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789996313.579612:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0880f79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1876946942226176:12345-0@lo:400:kworker.0 Request processed in 93us (2193us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996313.579619:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789996313.579820:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0880f78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876946942226176:0@lo:400:kworker.0 00000100:00080000:2.0:1789996313.580254:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1789996313.967182:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789996314.090172:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789996314.090194:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0880f78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876946942226304:0@lo:13:osp-pre-1-0.0 00000040:00080000:2.0:1789996314.091503:0:11698:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789996314.094360:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789996314.095647:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942226304 00000100:00100000:3.0:1789996314.095658:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942226304 00000100:00100000:3.0:1789996314.095712:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789996314.095722:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0880f79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876946942226304:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789996314.095763:0:6691:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789996314.095852:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0880f79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876946942226304:12345-0@lo:13:osp-pre-1-0.0 Request processed in 131us (5059us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996314.095858:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789996314.096176:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0880f78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876946942226304:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789996314.985638:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789996315.215326:0:5868:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967309 is committed 00000100:00100000:3.0:1789996315.965446:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996315.965529:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927511040 00000100:00100000:2.0:1789996315.965538:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927511040 00000100:00100000:2.0:1789996315.965628:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 36 00000100:00100000:2.0:1789996315.965639:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086f884380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+8:10270:x1876946927511040:12345-192.168.204.37@tcp:101:lfs.0 00010000:00010000:2.0:1789996315.965659:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789996315.965688:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4800/0x4173739f0fc809b6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b97003095e35501 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996315.965748:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4e00/0x4173739f0fc809bd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996315.965786:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4e00/0x4173739f0fc809bd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996315.965800:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4e00/0x4173739f0fc809bd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996315.965817:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5800/0x4173739f0fc809c4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996315.965823:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5800/0x4173739f0fc809c4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996315.965829:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5800/0x4173739f0fc809c4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1789996315.966060:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789996315.966292:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4e00/0x4173739f0fc809bd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996315.966301:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4e00/0x4173739f0fc809bd lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996315.966308:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4e00/0x4173739f0fc809bd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996315.966313:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0842de4e00 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:2.0:1789996315.966318:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4e00/0x4173739f0fc809bd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996315.966324:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4e00/0x4173739f0fc809bd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996315.966337:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e084601b400) 00010000:00010000:2.0:1789996315.966347:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789996315.966352:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4e00/0x4173739f0fc809bd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996315.966359:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4e00/0x4173739f0fc809bd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996315.966371:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5800/0x4173739f0fc809c4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996315.966377:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5800/0x4173739f0fc809c4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996315.966383:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5800/0x4173739f0fc809c4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996315.966389:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0842de5800 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:2.0:1789996315.966392:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5800/0x4173739f0fc809c4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996315.966397:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5800/0x4173739f0fc809c4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996315.966404:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8e084601b700) 00010000:00010000:2.0:1789996315.966407:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789996315.966409:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5800/0x4173739f0fc809c4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996315.966415:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5800/0x4173739f0fc809c4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996315.966446:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4800/0x4173739f0fc809b6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35501 expref: 9 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996315.966468:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e084601b400) 00010000:00010000:2.0:1789996315.966470:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789996315.966475:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4800/0x4173739f0fc809b6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35501 expref: 9 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996315.966484:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e0842de4800, rc 0) 00000100:00100000:2.0:1789996315.967445:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086f884380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+8:10270:x1876946927511040:12345-192.168.204.37@tcp:101:lfs.0 Request processed in 1802us (2002us total) trans 0 rc 301/301 00000100:00100000:2.0:1789996315.967455:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 36 00000100:00100000:2.0:1789996315.976135:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1789996315.977017:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927511296 00000100:00100000:3.0:1789996315.977028:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927511296 00000100:00100000:3.0:1789996315.977096:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 37 00000100:00100000:3.0:1789996315.977106:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086d7f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+8:10270:x1876946927511296:12345-192.168.204.37@tcp:36:lfs.0 00010000:00010000:3.0:1789996315.977165:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789996315.977192:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5c00/0x4173739f0fc80970 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e354ec expref: 8 pid: 9163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996315.977211:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e084601b400) 00010000:00010000:3.0:1789996315.977223:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789996315.978012:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856c00/0x4173739f0fc809cb lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996315.978030:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856c00/0x4173739f0fc809cb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996315.978041:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856c00/0x4173739f0fc809cb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996315.978056:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856a00/0x4173739f0fc809d2 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996315.978063:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856a00/0x4173739f0fc809d2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996315.978070:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856a00/0x4173739f0fc809d2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789996315.980418:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1789996315.980437:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856c00/0x4173739f0fc809cb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996315.980446:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856c00/0x4173739f0fc809cb lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996315.980460:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856c00/0x4173739f0fc809cb lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996315.980467:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e087f856c00 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:3.0:1789996315.980472:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856c00/0x4173739f0fc809cb lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996315.980479:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856c00/0x4173739f0fc809cb lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996315.980493:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e0846583a00) 00010000:00010000:3.0:1789996315.980496:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789996315.980501:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856c00/0x4173739f0fc809cb lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996315.980507:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856c00/0x4173739f0fc809cb lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789996315.980528:0:5846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001443e95b reply state 00000000dbe52bab transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856a00/0x4173739f0fc809d2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789996315.980537:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789996315.980783:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086d7f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+9:10270:x1876946927511296:12345-192.168.204.37@tcp:36:lfs.0 Request processed in 3674us (4663us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1789996315.980792:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 37 00010000:00010000:2.0:1789996315.986790:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856a00/0x4173739f0fc809d2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996315.986808:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856a00/0x4173739f0fc809d2 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996315.986816:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856a00/0x4173739f0fc809d2 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996315.986824:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e087f856a00 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:2.0:1789996315.986828:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856a00/0x4173739f0fc809d2 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996315.986836:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856a00/0x4173739f0fc809d2 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996315.986852:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8e0846583800) 00010000:00010000:2.0:1789996315.986855:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789996315.986890:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856a00/0x4173739f0fc809d2 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996315.986896:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856a00/0x4173739f0fc809d2 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996316.009901:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789996316.062245:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996316.062326:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927511424 00000100:00100000:0.0:1789996316.062337:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927511424 00000100:00100000:0.0:1789996316.062400:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 38 00000100:00100000:0.0:1789996316.062410:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086d7f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+8:10278:x1876946927511424:12345-192.168.204.37@tcp:101:lctl.0 00010000:00010000:0.0:1789996316.062433:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789996316.062454:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0840030200/0x4173739f0fc809d9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b97003095e35508 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996316.062517:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0840031200/0x4173739f0fc809e0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996316.062657:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0840031200/0x4173739f0fc809e0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996316.062673:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0840031200/0x4173739f0fc809e0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789996316.062711:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789996316.062716:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789996316.062753:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e0840031200/0x4173739f0fc809e0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996316.062779:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0840030200/0x4173739f0fc809d9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35508 expref: 10 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996316.062795:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0840031200/0x4173739f0fc809e0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35508 expref: 9 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996316.062804:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e0850c28200) 00010000:00010000:0.0:1789996316.062807:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789996316.062810:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e0840031200, rc 0) 00000100:00100000:0.0:1789996316.062889:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086d7f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+9:10278:x1876946927511424:12345-192.168.204.37@tcp:101:lctl.0 Request processed in 480us (654us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996316.062896:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 38 00000040:00080000:2.0:1789996316.139354:0:11698:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1789996316.150526:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996316.150789:0:9163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927511552 00000100:00100000:2.0:1789996316.150800:0:9163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927511552 00000100:00100000:2.0:1789996316.150855:0:9163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 39 00000100:00100000:2.0:1789996316.150874:0:9163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fa91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+9:10284:x1876946927511552:12345-192.168.204.37@tcp:101:bash.0 00010000:00010000:2.0:1789996316.150893:0:9163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789996316.150911:0:9163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5800/0x4173739f0fc809e7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b97003095e3550f expref: -99 pid: 9163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996316.151031:0:9163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4e00/0x4173739f0fc809ee lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996316.151044:0:9163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4e00/0x4173739f0fc809ee lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996316.151055:0:9163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4e00/0x4173739f0fc809ee lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996316.151067:0:9163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4200/0x4173739f0fc809f5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996316.151073:0:9163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4200/0x4173739f0fc809f5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996316.151078:0:9163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4200/0x4173739f0fc809f5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996316.151166:0:9163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4600/0x4173739f0fc809fc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996316.151173:0:9163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4600/0x4173739f0fc809fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996316.151184:0:9163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4600/0x4173739f0fc809fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789996316.151206:0:9163:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:2.0:1789996316.151209:0:9163:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789996316.151242:0:9163:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4600/0x4173739f0fc809fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996316.151252:0:9163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4e00/0x4173739f0fc809ee lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996316.151258:0:9163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4e00/0x4173739f0fc809ee lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996316.151264:0:9163:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4e00/0x4173739f0fc809ee lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996316.151269:0:9163:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0842de4e00 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:2.0:1789996316.151273:0:9163:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4e00/0x4173739f0fc809ee lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996316.151279:0:9163:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4e00/0x4173739f0fc809ee lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996316.151290:0:9163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e0850c28200) 00010000:00010000:2.0:1789996316.151297:0:9163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789996316.151303:0:9163:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4e00/0x4173739f0fc809ee lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996316.151309:0:9163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4e00/0x4173739f0fc809ee lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996316.151321:0:9163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4200/0x4173739f0fc809f5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996316.151326:0:9163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4200/0x4173739f0fc809f5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996316.151331:0:9163:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4200/0x4173739f0fc809f5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996316.151336:0:9163:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0842de4200 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:2.0:1789996316.151338:0:9163:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4200/0x4173739f0fc809f5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996316.151343:0:9163:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4200/0x4173739f0fc809f5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996316.151348:0:9163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8e084601bf00) 00010000:00010000:2.0:1789996316.151350:0:9163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789996316.151352:0:9163:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4200/0x4173739f0fc809f5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996316.151357:0:9163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4200/0x4173739f0fc809f5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996316.151382:0:9163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5800/0x4173739f0fc809e7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e3550f expref: 11 pid: 9163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996316.151402:0:9163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4600/0x4173739f0fc809fc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e3550f expref: 10 pid: 9163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996316.151409:0:9163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e084601b700) 00010000:00010000:2.0:1789996316.151411:0:9163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789996316.151413:0:9163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e0842de4600, rc 0) 00000100:00100000:2.0:1789996316.151689:0:9163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fa91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+10:10284:x1876946927511552:12345-192.168.204.37@tcp:101:bash.0 Request processed in 816us (1172us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996316.151696:0:9163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 39 00000100:00100000:3.0:1789996316.157315:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996316.157400:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927511808 00000100:00100000:2.0:1789996316.157409:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927511808 00000100:00100000:2.0:1789996316.157466:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 40 00000100:00100000:2.0:1789996316.157476:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086f886a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+10:10284:x1876946927511808:12345-192.168.204.37@tcp:101:bash.0 00010000:00010000:2.0:1789996316.157500:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789996316.157524:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5c00/0x4173739f0fc80a03 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b97003095e35516 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996316.157677:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4800/0x4173739f0fc80a0a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996316.157694:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4800/0x4173739f0fc80a0a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996316.157704:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4800/0x4173739f0fc80a0a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996316.157717:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5a00/0x4173739f0fc80a11 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996316.157740:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5a00/0x4173739f0fc80a11 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996316.157748:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5a00/0x4173739f0fc80a11 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789996316.159062:0:5848:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:2.0:1789996316.160084:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0841524e00/0x4173739f0fc80a18 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996316.160105:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0841524e00/0x4173739f0fc80a18 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996316.160115:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0841524e00/0x4173739f0fc80a18 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996316.160157:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4800/0x4173739f0fc80a0a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996316.160164:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4800/0x4173739f0fc80a0a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996316.160171:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4800/0x4173739f0fc80a0a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996316.160178:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0842de4800 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:2.0:1789996316.160182:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4800/0x4173739f0fc80a0a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996316.160189:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4800/0x4173739f0fc80a0a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996316.160878:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e084601b700) 00010000:00010000:2.0:1789996316.160881:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789996316.160888:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4800/0x4173739f0fc80a0a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996316.160895:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4800/0x4173739f0fc80a0a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789996316.160910:0:5848:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003e46c5e9 reply state 00000000f0e40aea transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5a00/0x4173739f0fc80a11 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789996316.160920:0:5848:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789996316.161024:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5c00/0x4173739f0fc80a03 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35516 expref: 13 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996316.161040:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0841524e00/0x4173739f0fc80a18 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35516 expref: 12 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996316.161048:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e084601be00) 00010000:00010000:2.0:1789996316.161050:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789996316.161052:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e0841524e00, rc 0) 00000100:00100000:2.0:1789996316.161186:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086f886a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+13:10284:x1876946927511808:12345-192.168.204.37@tcp:101:bash.0 Request processed in 3709us (3878us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1789996316.161195:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 40 00010000:00010000:1.0:1789996316.166235:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5a00/0x4173739f0fc80a11 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996316.166254:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5a00/0x4173739f0fc80a11 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996316.166262:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5a00/0x4173739f0fc80a11 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996316.166268:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0842de5a00 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:1.0:1789996316.166273:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5a00/0x4173739f0fc80a11 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996316.166282:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5a00/0x4173739f0fc80a11 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996316.166300:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8e084601b900) 00010000:00010000:1.0:1789996316.166303:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789996316.166308:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5a00/0x4173739f0fc80a11 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996316.166314:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5a00/0x4173739f0fc80a11 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789996316.172938:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996316.173049:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927511936 00000100:00100000:2.0:1789996316.173059:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927511936 00000100:00100000:2.0:1789996316.173111:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 20 00000100:00100000:2.0:1789996316.173120:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086f885180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2361:x1876946927511936:12345-192.168.204.37@tcp:8:bash.0 00010000:00080000:2.0:1789996316.173165:0:6688:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 189efa8a-c7eb-4b69-9afa-1dd36d6775f1@192.168.204.37@tcp t0 exp 0000000000000000 cur 357 last 0 00000020:00000080:2.0:1789996316.173206:0:6688:0:(genops.c:1384:class_connect()) connect: client 189efa8a-c7eb-4b69-9afa-1dd36d6775f1, cookie 0x4173739f0fc80a26 00002000:00100000:2.0:1789996316.173228:0:6688:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 189efa8a-c7eb-4b69-9afa-1dd36d6775f1/ffff8e0848966800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a3f ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789996316.173252:0:6688:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789996316.173480:0:6688:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1789996316.173508:0:6688:0:(import.c:65:import_set_state_nolock()) ffff8e0848961000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789996316.173607:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086f885180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+6:2361:x1876946927511936:12345-192.168.204.37@tcp:8:bash.0 Request processed in 486us (678us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996316.173615:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 20 00000100:00100000:0.0:1789996316.183294:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1789996316.184232:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927512064 00000100:00100000:1.0:1789996316.184245:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927512064 00000100:00100000:1.0:1789996316.184326:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 21 00000100:00100000:1.0:1789996316.184338:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0880f7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+6:0:x1876946927512064:12345-192.168.204.37@tcp:101:bash.0 00010000:00010000:1.0:1789996316.184355:0:6690:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789996316.184380:0:6690:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008dd6912d/0x4173739f0fc80a2d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1b97003095e3551d expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789996316.184408:0:6690:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789996316.184427:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=357s v=(0 0) 00010000:00010000:1.0:1789996316.184431:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789996316.184441:0:6690:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008dd6912d/0x4173739f0fc80a2d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e3551d expref: 7 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996316.184461:0:6690:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008dd6912d/0x4173739f0fc80a2d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e3551d expref: 7 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996316.184474:0:6690:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e0876a23800, rc 0) 00000100:00100000:1.0:1789996316.184570:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0880f7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+7:0:x1876946927512064:12345-192.168.204.37@tcp:101:bash.0 Request processed in 206us (1257us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996316.184577:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 21 00000100:00080000:3.0:1789996316.184682:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789996316.188686:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1789996316.188810:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927512192 00000100:00100000:3.0:1789996316.188826:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927512192 00000100:00100000:3.0:1789996316.188904:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 22 00000100:00100000:3.0:1789996316.188916:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fadb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+7:10284:x1876946927512192:12345-192.168.204.37@tcp:101:bash.0 00010000:00010000:3.0:1789996316.188934:0:6688:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789996316.189464:0:6688:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008ee5a869/0x4173739f0fc80a34 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1b97003095e35524 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996316.189497:0:6688:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008dd6912d/0x4173739f0fc80a2d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e3551d expref: 8 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996316.189507:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789996316.189511:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789996316.189516:0:6688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008ee5a869/0x4173739f0fc80a34 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35524 expref: 8 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996316.189591:0:6688:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008dd6912d/0x4173739f0fc80a2d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e3551d expref: 8 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996316.189608:0:6688:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008dd6912d/0x4173739f0fc80a2d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e3551d expref: 8 pid: 6690 timeout: 457 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789996316.189622:0:6688:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0849c75c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6688:1876946942226432:192.168.204.37@tcp:104: 00000100:00100000:3.0:1789996316.190426:0:6688:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e086fd99d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789996316.193473:0:6688:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0849c75c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6688:1876946942226432:192.168.204.37@tcp:104: 00010000:00010000:3.0:1789996316.193507:0:6688:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008ee5a869/0x4173739f0fc80a34 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35524 expref: 8 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996316.193662:0:6688:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e087f856c00, rc 0) 00000100:00100000:3.0:1789996316.193823:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fadb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+8:10284:x1876946927512192:12345-192.168.204.37@tcp:101:bash.0 Request processed in 4908us (5145us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996316.193832:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 22 00000100:00100000:3.0:1789996316.197637:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996316.197787:0:8520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927512320 00000100:00100000:0.0:1789996316.197798:0:8520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927512320 00010000:00010000:0.0:1789996316.197843:0:8520:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008dd6912d/0x4173739f0fc80a2d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e3551d expref: 8 pid: 6690 timeout: 457 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789996316.197912:0:8520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 35 00000100:00100000:0.0:1789996316.197922:0:8520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0849c75c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+8:2362:x1876946927512320:12345-192.168.204.37@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789996316.197936:0:8520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789996316.197957:0:8520:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008dd6912d/0x4173739f0fc80a2d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e3551d expref: 8 pid: 6690 timeout: 457 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996316.197969:0:8520:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008dd6912d/0x4173739f0fc80a2d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e3551d expref: 8 pid: 6690 timeout: 457 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996316.197999:0:8520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008dd6912d/0x4173739f0fc80a2d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e3551d expref: 8 pid: 6690 timeout: 457 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996316.198018:0:8520:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789996316.198023:0:8520:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789996316.198030:0:8520:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008ee5a869/0x4173739f0fc80a34 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35524 expref: 7 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996316.198040:0:8520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008ee5a869/0x4173739f0fc80a34 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35524 expref: 7 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996316.198079:0:8520:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000008ee5a869/0x4173739f0fc80a34 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35524 expref: 7 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789996316.198099:0:8520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0880f79f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8520:1876946942226560:192.168.204.37@tcp:105: 00000100:00100000:0.0:1789996316.198185:0:8520:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e084659e240 going to sleep for 11 seconds 00000100:00100000:1.0:1789996316.204414:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996316.205809:0:8520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0880f79f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8520:1876946942226560:192.168.204.37@tcp:105: 00010000:00010000:0.0:1789996316.205838:0:8520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789996316.205907:0:8520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0849c75c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+7:2362:x1876946927512320:12345-192.168.204.37@tcp:103:ldlm_bl.0 Request processed in 7987us (8280us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996316.205918:0:8520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 35 00000100:00100000:2.0:1789996316.209817:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927512576 00000100:00100000:2.0:1789996316.209832:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927512576 00000100:00100000:2.0:1789996316.209977:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 6 00000100:00100000:2.0:1789996316.209988:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fadbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+12:10284:x1876946927512576:12345-192.168.204.37@tcp:35:bash.0 00000100:00100000:2.0:1789996316.210657:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fadbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+13:10284:x1876946927512576:12345-192.168.204.37@tcp:35:bash.0 Request processed in 669us (6250us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1789996316.210666:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 6 00000100:00100000:1.0:1789996316.372695:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996316.372766:0:9163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927512832 00000100:00100000:2.0:1789996316.372777:0:9163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927512832 00000100:00100000:2.0:1789996316.372865:0:9163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 41 00000100:00100000:2.0:1789996316.372876:0:9163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fad8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+13:10294:x1876946927512832:12345-192.168.204.37@tcp:101:lfs.0 00010000:00010000:2.0:1789996316.372900:0:9163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789996316.372922:0:9163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0841524400/0x4173739f0fc80a3b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b97003095e3552b expref: -99 pid: 9163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789996316.373015:0:9163:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1789996316.373148:0:9163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0841524400/0x4173739f0fc80a3b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e3552b expref: 15 pid: 9163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996316.373162:0:9163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e0850c28200) 00010000:00010000:2.0:1789996316.373165:0:9163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789996316.373171:0:9163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0841524400/0x4173739f0fc80a3b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e3552b expref: 15 pid: 9163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996316.373187:0:9163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e0841524400, rc 0) 00000100:00100000:2.0:1789996316.373258:0:9163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fad8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+14:10294:x1876946927512832:12345-192.168.204.37@tcp:101:lfs.0 Request processed in 383us (572us total) trans 4294967313 rc 301/301 00000100:00100000:2.0:1789996316.373264:0:9163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 41 00000100:00100000:3.0:1789996316.379105:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996316.379326:0:11495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927513088 00000100:00100000:0.0:1789996316.379337:0:11495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927513088 00000100:00100000:0.0:1789996316.379403:0:11495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 7 00000100:00100000:0.0:1789996316.379415:0:11495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086f88b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+14:10294:x1876946927513088:12345-192.168.204.37@tcp:35:lfs.0 00000100:00100000:0.0:1789996316.379704:0:11495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086f88b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+15:10294:x1876946927513088:12345-192.168.204.37@tcp:35:lfs.0 Request processed in 290us (607us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1789996316.379712:0:11495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 7 00000100:00100000:0.0:1789996316.440662:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996316.441294:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927513216 00000100:00100000:2.0:1789996316.441306:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927513216 00000100:00100000:2.0:1789996316.441373:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 42 00000100:00100000:2.0:1789996316.441383:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0880f79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+15:10300:x1876946927513216:12345-192.168.204.37@tcp:101:lfs.0 00010000:00010000:2.0:1789996316.441405:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789996316.441425:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5c00/0x4173739f0fc80a49 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b97003095e35532 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996316.441523:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4800/0x4173739f0fc80a50 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996316.441537:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4800/0x4173739f0fc80a50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996316.441580:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4800/0x4173739f0fc80a50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789996316.441626:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:2.0:1789996316.441630:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789996316.441648:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4800/0x4173739f0fc80a50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996316.441675:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5c00/0x4173739f0fc80a49 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35532 expref: 17 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996316.441693:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4800/0x4173739f0fc80a50 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35532 expref: 16 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996316.441701:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e084601b700) 00010000:00010000:2.0:1789996316.441703:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789996316.441706:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e0842de4800, rc 0) 00000100:00100000:2.0:1789996316.441771:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0880f79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+16:10300:x1876946927513216:12345-192.168.204.37@tcp:101:lfs.0 Request processed in 389us (1119us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996316.441779:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 42 00000100:00100000:2.0:1789996316.446234:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996316.446493:0:9163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927513472 00000100:00100000:0.0:1789996316.446502:0:9163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927513472 00000100:00100000:0.0:1789996316.446585:0:9163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 43 00000100:00100000:0.0:1789996316.446596:0:9163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086d7f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+16:10300:x1876946927513472:12345-192.168.204.37@tcp:101:lfs.0 00010000:00010000:0.0:1789996316.446620:0:9163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789996316.446639:0:9163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0840031e00/0x4173739f0fc80a57 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b97003095e35539 expref: -99 pid: 9163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996316.446735:0:9163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0840031000/0x4173739f0fc80a5e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996316.446748:0:9163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0840031000/0x4173739f0fc80a5e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996316.446774:0:9163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0840031000/0x4173739f0fc80a5e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789996316.446788:0:9163:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1789996316.448206:0:9163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0840031e00/0x4173739f0fc80a57 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35539 expref: 19 pid: 9163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996316.448228:0:9163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0840031000/0x4173739f0fc80a5e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35539 expref: 18 pid: 9163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996316.448236:0:9163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e084601be00) 00010000:00010000:0.0:1789996316.448239:0:9163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789996316.448243:0:9163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e0840031000, rc 0) 00000100:00100000:0.0:1789996316.448313:0:9163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086d7f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+18:10300:x1876946927513472:12345-192.168.204.37@tcp:101:lfs.0 Request processed in 1719us (2088us total) trans 4294967315 rc 0/0 00000100:00100000:0.0:1789996316.448321:0:9163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 43 00000100:00100000:3.0:1789996316.451127:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1789996316.451872:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996316.452043:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927513728 00000100:00100000:0.0:1789996316.452053:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927513728 00000100:00100000:0.0:1789996316.452109:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 44 00000100:00100000:0.0:1789996316.452117:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0877b7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+18:10300:x1876946927513728:12345-192.168.204.37@tcp:101:lfs.0 00010000:00010000:0.0:1789996316.452138:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789996316.452156:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0840031400/0x4173739f0fc80a6c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b97003095e35540 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996316.452240:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0840030200/0x4173739f0fc80a73 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996316.452266:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0840030200/0x4173739f0fc80a73 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996316.452277:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0840030200/0x4173739f0fc80a73 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789996316.452290:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1789996316.452399:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0840031400/0x4173739f0fc80a6c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35540 expref: 21 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789996316.452409:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927513856 00010000:00010000:0.0:1789996316.452417:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0840030200/0x4173739f0fc80a73 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35540 expref: 20 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789996316.452422:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927513856 00010000:00010000:0.0:1789996316.452429:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e084601be00) 00010000:00010000:0.0:1789996316.452433:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1789996316.452436:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e0840030200, rc 0) 00000100:00100000:0.0:1789996316.452488:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0877b7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+21:10300:x1876946927513728:12345-192.168.204.37@tcp:101:lfs.0 Request processed in 371us (618us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1789996316.452496:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 44 00000100:00100000:1.0:1789996316.452507:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 2 00000100:00100000:1.0:1789996316.452519:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0877b7c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+20:2365:x1876946927513856:12345-192.168.204.37@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789996316.452530:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789996316.452563:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0840031000/0x4173739f0fc80a5e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35539 expref: 20 pid: 9163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996316.452577:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e084601be00) 00010000:00010000:1.0:1789996316.452581:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789996316.452603:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0877b7c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+19:2365:x1876946927513856:12345-192.168.204.37@tcp:103:ldlm_bl.0 Request processed in 89us (1485us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996316.452611:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 2 00000100:00100000:3.0:1789996316.457457:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1789996316.457536:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927513984 00000100:00100000:1.0:1789996316.457563:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927513984 00000100:00100000:1.0:1789996316.457617:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 23 00000100:00100000:1.0:1789996316.457627:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0877b7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+7:2363:x1876946927513984:12345-192.168.204.37@tcp:1:lfs.0 00010000:00010000:1.0:1789996316.457676:0:6690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008dd6912d/0x4173739f0fc80a81 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996316.457696:0:6690:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008ee5a869/0x4173739f0fc80a34 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35524 expref: 7 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996316.457705:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x2:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1789996316.457711:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789996316.457716:0:6690:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008dd6912d/0x4173739f0fc80a81 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996316.457783:0:6690:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008ee5a869/0x4173739f0fc80a34 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35524 expref: 7 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996316.457798:0:6690:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008ee5a869/0x4173739f0fc80a34 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35524 expref: 7 pid: 6688 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789996316.457811:0:6690:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fadaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6690:1876946942226688:192.168.204.37@tcp:104: 00000100:00100000:1.0:1789996316.457913:0:6690:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e086d479540 going to sleep for 11 seconds 00000100:00100000:0.0:1789996316.460703:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1789996316.460803:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927514112 00000100:00100000:3.0:1789996316.460812:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927514112 00002000:00100000:3.0:1789996316.460866:0:6693:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff8e0880f7ad80 x1876946927514112/t0(0) o4->189efa8a-c7eb-4b69-9afa-1dd36d6775f1@192.168.204.37@tcp:47/0 lens 504/0 e 0 to 0 dl 1789996327 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789996316.460877:0:6693:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8e0880f7ad80 with x1876946927514112 ext(0->12) 00010000:00010000:3.0:1789996316.460887:0:6693:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000008ee5a869/0x4173739f0fc80a34 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35524 expref: 8 pid: 6688 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996316.460914:0:6693:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000008ee5a869/0x4173739f0fc80a34 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35524 expref: 8 pid: 6688 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789996316.460923:0:6693:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8e0880f7ad80 00000100:00100000:3.0:1789996316.460952:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 0 00000100:00100000:3.0:1789996316.460961:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0880f7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+8:2362:x1876946927514112:12345-192.168.204.37@tcp:4:lfs.0 00000100:00100000:1.0:1789996316.461535:0:6690:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fadaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6690:1876946942226688:192.168.204.37@tcp:104: 00010000:00010000:1.0:1789996316.461581:0:6690:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008dd6912d/0x4173739f0fc80a81 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:0.0:1789996316.519384:0:6715:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 189efa8a-c7eb-4b69-9afa-1dd36d6775f1 00000100:00100000:2.0:1789996316.520999:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0880f7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+9:2362:x1876946927514112:12345-192.168.204.37@tcp:4:lfs.0 Request processed in 60029us (60295us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1789996316.521017:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 0 00002000:00100000:2.0:1789996316.521031:0:6693:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff8e0880f7ad80 x1876946927514112/t4294967299(0) o4->189efa8a-c7eb-4b69-9afa-1dd36d6775f1@192.168.204.37@tcp:47/0 lens 504/448 e 0 to 0 dl 1789996327 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789996316.521043:0:6693:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8e0880f7ad80 with x1876946927514112 ext(0->12) 00010000:00010000:2.0:1789996316.521054:0:6693:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000008ee5a869/0x4173739f0fc80a34 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35524 expref: 9 pid: 6688 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996316.521090:0:6693:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000008ee5a869/0x4173739f0fc80a34 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35524 expref: 9 pid: 6688 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789996316.521098:0:6693:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8e0880f7ad80 00000100:00100000:3.0:1789996316.524253:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1789996316.524709:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927514240 00000100:00100000:1.0:1789996316.524718:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927514240 00010000:00010000:1.0:1789996316.524770:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008ee5a869/0x4173739f0fc80a34 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35524 expref: 9 pid: 6688 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789996316.524926:0:8520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 36 00000100:00100000:0.0:1789996316.524939:0:8520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0877b7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+9:2363:x1876946927514240:12345-192.168.204.37@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789996316.524953:0:8520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1789996316.524970:0:8520:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1789996316.524973:0:8520:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1789996316 00002000:00010000:0.0:1789996316.524983:0:8520:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb atime from disk: 0 -> 1789996317 00002000:00010000:0.0:1789996316.524985:0:8520:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1789996316 00010000:00010000:0.0:1789996316.524993:0:8520:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008ee5a869/0x4173739f0fc80a34 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35524 expref: 9 pid: 6688 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996316.525008:0:8520:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008ee5a869/0x4173739f0fc80a34 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35524 expref: 9 pid: 6688 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996316.525032:0:8520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008ee5a869/0x4173739f0fc80a34 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35524 expref: 9 pid: 6688 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996316.525049:0:8520:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789996316.525054:0:8520:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789996316.525060:0:8520:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008dd6912d/0x4173739f0fc80a81 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996316.525071:0:8520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008dd6912d/0x4173739f0fc80a81 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996316.525108:0:8520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789996316.525167:0:8520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0877b7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+8:2363:x1876946927514240:12345-192.168.204.37@tcp:103:ldlm_bl.0 Request processed in 230us (922us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996316.525174:0:8520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 36 00010000:00010000:3.0:1789996316.525288:0:6690:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008dd6912d/0x4173739f0fc80a81 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996316.525298:0:6690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008dd6912d/0x4173739f0fc80a81 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996316.525322:0:6690:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008dd6912d/0x4173739f0fc80a81 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996316.525330:0:6690:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008dd6912d/0x4173739f0fc80a81 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996316.525339:0:6690:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008dd6912d/0x4173739f0fc80a81 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996316.525345:0:6690:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0876a23800 already unused, calling callback (ffffffffc1595910) 00010000:00010000:3.0:1789996316.525350:0:6690:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008dd6912d/0x4173739f0fc80a81 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996316.525358:0:6690:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008dd6912d/0x4173739f0fc80a81 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996316.525372:0:6690:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008dd6912d/0x4173739f0fc80a81 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996316.525380:0:6690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008dd6912d/0x4173739f0fc80a81 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789996316.525436:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0877b7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+7:2363:x1876946927513984:12345-192.168.204.37@tcp:1:lfs.0 Request processed in 67810us (67989us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996316.525444:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 23 00000100:00100000:3.0:1789996316.531899:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996316.532371:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927514496 00000100:00100000:2.0:1789996316.532381:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927514496 00000100:00100000:2.0:1789996316.532479:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 8 00000100:00100000:2.0:1789996316.532492:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0877b7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+19:10300:x1876946927514496:12345-192.168.204.37@tcp:35:lfs.0 00000004:00010000:2.0:1789996316.532585:0:5849:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e0840030200/0x4173739f0fc80a73 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35540 expref: 19 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789996316.532867:0:5849:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:2.0:1789996316.532928:0:5849:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:2.0:1789996316.533411:0:5849:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:2.0:1789996316.533469:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5800/0x4173739f0fc80a88 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996316.533487:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0841524e00/0x4173739f0fc80a18 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35516 expref: 23 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996316.533497:0:5849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5800/0x4173739f0fc80a88 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996316.533535:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e0841524e00/0x4173739f0fc80a18 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35516 expref: 23 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996316.533585:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0841524e00/0x4173739f0fc80a18 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35516 expref: 23 pid: 5848 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789996316.533608:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086d7f1c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5849:1876946942226816:192.168.204.37@tcp:104: 00000100:00100000:2.0:1789996316.533697:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0845297d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789996316.539082:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086d7f1c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5849:1876946942226816:192.168.204.37@tcp:104: 00010000:00010000:3.0:1789996316.539120:0:5849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5800/0x4173739f0fc80a88 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789996316.539345:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1789996316.539403:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927514624 00000100:00100000:3.0:1789996316.539409:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927514624 00010000:00010000:3.0:1789996316.539442:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0841524e00/0x4173739f0fc80a18 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35516 expref: 24 pid: 5848 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789996316.539520:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 37 00000100:00100000:3.0:1789996316.539529:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086d7f3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+24:2363:x1876946927514624:12345-192.168.204.37@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789996316.539568:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789996316.539575:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e0841524e00/0x4173739f0fc80a18 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35516 expref: 24 pid: 5848 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996316.539587:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e0841524e00/0x4173739f0fc80a18 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35516 expref: 24 pid: 5848 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996316.539606:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0841524e00/0x4173739f0fc80a18 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35516 expref: 24 pid: 5848 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996316.539640:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e084601be00) 00010000:00010000:3.0:1789996316.539645:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5800/0x4173739f0fc80a88 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996316.539654:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5800/0x4173739f0fc80a88 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996316.539661:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5800/0x4173739f0fc80a88 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996316.539679:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789996316.539722:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086d7f3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+23:2363:x1876946927514624:12345-192.168.204.37@tcp:103:ldlm_bl.0 Request processed in 195us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996316.539729:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 37 00010000:00010000:2.0:1789996316.542890:0:5849:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5800/0x4173739f0fc80a88 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996316.542908:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5800/0x4173739f0fc80a88 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789996316.543047:0:5849:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:2.0:1789996316.543242:0:5849:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:2.0:1789996316.543369:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086d7f3b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5849:1876946942226944:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1789996316.543436:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996316.543472:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0845297900 going to sleep for 11 seconds 00000100:00100000:2.0:1789996316.543505:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942226944 00000100:00100000:2.0:1789996316.543513:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942226944 00000100:00100000:2.0:1789996316.543587:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789996316.543597:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086d7f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5849:x1876946942226944:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1789996316.543669:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086d7f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5849:x1876946942226944:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 73us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996316.543676:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1789996316.543700:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789996316.543726:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086d7f3b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5849:1876946942226944:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1789996316.544331:0:5849:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:2.0:1789996316.544390:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086d7f3b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5849:1876946942227072:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1789996316.544422:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996316.544450:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0845297540 going to sleep for 11 seconds 00000100:00100000:2.0:1789996316.544467:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942227072 00000100:00100000:2.0:1789996316.544472:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942227072 00000100:00100000:2.0:1789996316.544495:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789996316.544503:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086d7f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5849:x1876946942227072:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1789996316.544678:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086d7f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5849:x1876946942227072:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 175us (255us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1789996316.544685:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789996316.544731:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086d7f3b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5849:1876946942227072:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1789996316.544781:0:5849:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:2.0:1789996316.544814:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5800/0x4173739f0fc80a88 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996316.544825:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5800/0x4173739f0fc80a88 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996316.544832:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5800/0x4173739f0fc80a88 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996316.544838:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0842de5800 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:2.0:1789996316.544842:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5800/0x4173739f0fc80a88 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996316.544862:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5800/0x4173739f0fc80a88 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996316.544879:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e084601be00) 00010000:00010000:2.0:1789996316.544883:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1789996316.544888:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5800/0x4173739f0fc80a88 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996316.544905:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5800/0x4173739f0fc80a88 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789996316.545066:0:5849:0:(mdd_object.c:4178:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1789996316.545272:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:2.0:1789996316.545284:0:5849:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 358264741189ns, next at 359264739092ns, rc = 0 00000001:00080000:2.0:1789996316.545291:0:5849:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:2.0:1789996316.545319:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e084601be00) 00010000:00010000:2.0:1789996316.545323:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789996316.545329:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0840030200/0x4173739f0fc80a73 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35540 expref: 27 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789996316.545408:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0877b7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+26:10300:x1876946927514496:12345-192.168.204.37@tcp:35:lfs.0 Request processed in 12919us (13520us total) trans 4294967325 rc 0/0 00000100:00100000:2.0:1789996316.545416:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 8 00000020:00080000:2.0:1789996316.545420:0:5849:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1789996316.550610:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996316.550691:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927514752 00000100:00100000:2.0:1789996316.550700:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927514752 00000100:00100000:2.0:1789996316.550750:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 45 00000100:00100000:2.0:1789996316.550761:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0877b7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+26:10300:x1876946927514752:12345-192.168.204.37@tcp:101:lfs.0 00010000:00010000:2.0:1789996316.550782:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789996316.550803:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4200/0x4173739f0fc80a8f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b97003095e35547 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996316.550873:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4200/0x4173739f0fc80a8f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35547 expref: 27 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996316.550905:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4200/0x4173739f0fc80a8f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35547 expref: 27 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996316.550927:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e084601b100) 00010000:00010000:2.0:1789996316.550931:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789996316.550934:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e0842de4200, rc 0) 00000100:00100000:2.0:1789996316.550994:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0877b7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+27:10300:x1876946927514752:12345-192.168.204.37@tcp:101:lfs.0 Request processed in 235us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996316.551002:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 45 00000100:00100000:3.0:1789996316.560656:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1789996316.560738:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927515008 00000100:00100000:1.0:1789996316.560748:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927515008 00000100:00100000:1.0:1789996316.560807:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 9 00000100:00100000:1.0:1789996316.560828:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0850a23450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+27:10300:x1876946927515008:12345-192.168.204.37@tcp:35:lfs.0 00000100:00100000:1.0:1789996316.561106:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0850a23450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+28:10300:x1876946927515008:12345-192.168.204.37@tcp:35:lfs.0 Request processed in 289us (459us total) trans 4294967326 rc 0/0 00000100:00100000:1.0:1789996316.561114:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 9 00000100:00100000:3.0:1789996316.649846:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996316.649928:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927515264 00000100:00100000:2.0:1789996316.649939:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927515264 00000100:00100000:2.0:1789996316.650059:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 46 00000100:00100000:2.0:1789996316.650070:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0877b7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+28:10310:x1876946927515264:12345-192.168.204.37@tcp:101:lfs.0 00010000:00010000:2.0:1789996316.650095:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789996316.650115:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5800/0x4173739f0fc80a96 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b97003095e3554e expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789996316.650198:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1789996316.650312:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5800/0x4173739f0fc80a96 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e3554e expref: 30 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996316.650325:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e0850c28200) 00010000:00010000:2.0:1789996316.650327:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789996316.650333:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5800/0x4173739f0fc80a96 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e3554e expref: 30 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996316.650363:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e0842de5800, rc 0) 00000100:00100000:2.0:1789996316.650433:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0877b7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+29:10310:x1876946927515264:12345-192.168.204.37@tcp:101:lfs.0 Request processed in 365us (597us total) trans 4294967327 rc 301/301 00000100:00100000:2.0:1789996316.650441:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 46 00000100:00100000:3.0:1789996316.653625:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996316.653795:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927515392 00000100:00100000:0.0:1789996316.653805:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927515392 00000100:00100000:0.0:1789996316.653882:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 47 00000100:00100000:0.0:1789996316.653892:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0877b7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+29:10310:x1876946927515392:12345-192.168.204.37@tcp:34:lfs.0 00010000:00010000:0.0:1789996316.654181:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7e00/0x4173739f0fc80aa4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996316.654198:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7e00/0x4173739f0fc80aa4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996316.654209:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7e00/0x4173739f0fc80aa4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996316.654224:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6e00/0x4173739f0fc80aab lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996316.654230:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6e00/0x4173739f0fc80aab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996316.654235:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6e00/0x4173739f0fc80aab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996316.654321:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6800/0x4173739f0fc80ab2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996316.654330:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6800/0x4173739f0fc80ab2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996316.654338:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6800/0x4173739f0fc80ab2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789996316.654376:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6800/0x4173739f0fc80ab2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996316.654389:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7e00/0x4173739f0fc80aa4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996316.654407:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7e00/0x4173739f0fc80aa4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996316.654414:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7e00/0x4173739f0fc80aa4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996316.654420:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e086fcb7e00 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:0.0:1789996316.654424:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7e00/0x4173739f0fc80aa4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996316.654431:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7e00/0x4173739f0fc80aa4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996316.654442:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e084601b700) 00010000:00010000:0.0:1789996316.654444:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789996316.654449:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7e00/0x4173739f0fc80aa4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996316.654455:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7e00/0x4173739f0fc80aa4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996316.654468:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6e00/0x4173739f0fc80aab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996316.654474:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6e00/0x4173739f0fc80aab lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996316.654481:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6e00/0x4173739f0fc80aab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996316.654486:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e086fcb6e00 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:0.0:1789996316.654495:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6e00/0x4173739f0fc80aab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996316.654501:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6e00/0x4173739f0fc80aab lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996316.654521:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8e0850c28800) 00010000:00010000:0.0:1789996316.654524:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789996316.654527:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6e00/0x4173739f0fc80aab lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996316.654533:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6e00/0x4173739f0fc80aab lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996316.654588:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6800/0x4173739f0fc80ab2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996316.654595:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6800/0x4173739f0fc80ab2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996316.654601:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6800/0x4173739f0fc80ab2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996316.654606:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e086fcb6800 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:0.0:1789996316.654609:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6800/0x4173739f0fc80ab2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996316.654615:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6800/0x4173739f0fc80ab2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996316.654624:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e084601b100) 00010000:00010000:0.0:1789996316.654626:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789996316.654636:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6800/0x4173739f0fc80ab2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996316.654642:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6800/0x4173739f0fc80ab2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789996316.654707:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0877b7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+29:10310:x1876946927515392:12345-192.168.204.37@tcp:34:lfs.0 Request processed in 815us (1092us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996316.654714:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 47 00000100:00100000:3.0:1789996316.657363:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996316.657633:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927515648 00000100:00100000:2.0:1789996316.657642:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927515648 00000100:00100000:2.0:1789996316.658071:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 10 00000100:00100000:2.0:1789996316.658083:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0877b7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+29:10310:x1876946927515648:12345-192.168.204.37@tcp:35:lfs.0 00000100:00100000:2.0:1789996316.658302:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0877b7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+30:10310:x1876946927515648:12345-192.168.204.37@tcp:35:lfs.0 Request processed in 220us (946us total) trans 4294967328 rc 0/0 00000100:00100000:2.0:1789996316.658310:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 10 00000100:00100000:3.0:1789996316.686413:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996316.686521:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927515904 00000100:00100000:0.0:1789996316.686532:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927515904 00000100:00100000:0.0:1789996316.686620:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 48 00000100:00100000:0.0:1789996316.686630:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0877b7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+30:10313:x1876946927515904:12345-192.168.204.37@tcp:101:lfs.0 00010000:00010000:0.0:1789996316.686652:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789996316.686671:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6800/0x4173739f0fc80ab9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b97003095e35555 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996316.686742:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6e00/0x4173739f0fc80ac0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996316.686757:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6e00/0x4173739f0fc80ac0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996316.686768:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6e00/0x4173739f0fc80ac0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996316.686800:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7e00/0x4173739f0fc80ac7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996316.686807:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7e00/0x4173739f0fc80ac7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996316.686830:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7e00/0x4173739f0fc80ac7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996316.686966:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6000/0x4173739f0fc80ace lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996316.686976:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6000/0x4173739f0fc80ace lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996316.686982:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6000/0x4173739f0fc80ace lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789996316.686991:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1789996316.687082:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6e00/0x4173739f0fc80ac0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996316.687091:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6e00/0x4173739f0fc80ac0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996316.687097:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6e00/0x4173739f0fc80ac0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996316.687103:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e086fcb6e00 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:0.0:1789996316.687107:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6e00/0x4173739f0fc80ac0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996316.687115:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6e00/0x4173739f0fc80ac0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996316.687127:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e084601b700) 00010000:00010000:0.0:1789996316.687130:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789996316.687144:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6e00/0x4173739f0fc80ac0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996316.687151:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6e00/0x4173739f0fc80ac0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996316.687164:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7e00/0x4173739f0fc80ac7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996316.687171:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7e00/0x4173739f0fc80ac7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996316.687177:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7e00/0x4173739f0fc80ac7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996316.687181:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e086fcb7e00 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:0.0:1789996316.687184:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7e00/0x4173739f0fc80ac7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996316.687188:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7e00/0x4173739f0fc80ac7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996316.687196:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8e0850c28800) 00010000:00010000:0.0:1789996316.687198:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789996316.687200:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7e00/0x4173739f0fc80ac7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996316.687205:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7e00/0x4173739f0fc80ac7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996316.687246:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6800/0x4173739f0fc80ab9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35555 expref: 33 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996316.687271:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6000/0x4173739f0fc80ace lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35555 expref: 32 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996316.687277:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e084601b100) 00010000:00010000:0.0:1789996316.687280:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789996316.687282:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e086fcb6000, rc 0) 00000100:00100000:0.0:1789996316.687352:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0877b7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+32:10313:x1876946927515904:12345-192.168.204.37@tcp:101:lfs.0 Request processed in 723us (947us total) trans 4294967329 rc 0/0 00000100:00100000:0.0:1789996316.687359:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 48 00000100:00100000:3.0:1789996316.690651:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996316.690756:0:9163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927516032 00000100:00100000:0.0:1789996316.690765:0:9163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927516032 00000100:00100000:0.0:1789996316.690837:0:9163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 49 00000100:00100000:0.0:1789996316.690857:0:9163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0877b7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+32:10313:x1876946927516032:12345-192.168.204.37@tcp:54:lfs.0 00010000:00010000:0.0:1789996316.690932:0:9163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6c00/0x4173739f0fc80adc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996316.690947:0:9163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6c00/0x4173739f0fc80adc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996316.690958:0:9163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6c00/0x4173739f0fc80adc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996316.690982:0:9163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6c00/0x4173739f0fc80adc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996316.690989:0:9163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6c00/0x4173739f0fc80adc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996316.691012:0:9163:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6c00/0x4173739f0fc80adc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996316.691018:0:9163:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e086fcb6c00 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:0.0:1789996316.691023:0:9163:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6c00/0x4173739f0fc80adc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996316.691031:0:9163:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6c00/0x4173739f0fc80adc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996316.691042:0:9163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e084601b100) 00010000:00010000:0.0:1789996316.691046:0:9163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789996316.691050:0:9163:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6c00/0x4173739f0fc80adc lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996316.691057:0:9163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6c00/0x4173739f0fc80adc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789996316.691130:0:9163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0877b7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+32:10313:x1876946927516032:12345-192.168.204.37@tcp:54:lfs.0 Request processed in 284us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996316.691139:0:9163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 49 00000100:00100000:3.0:1789996316.699943:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996316.700076:0:11495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927516288 00000100:00100000:0.0:1789996316.700087:0:11495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927516288 00000100:00100000:0.0:1789996316.700141:0:11495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 11 00000100:00100000:0.0:1789996316.700151:0:11495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0877b7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+32:10313:x1876946927516288:12345-192.168.204.37@tcp:35:lfs.0 00000100:00100000:0.0:1789996316.700366:0:11495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0877b7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+33:10313:x1876946927516288:12345-192.168.204.37@tcp:35:lfs.0 Request processed in 215us (431us total) trans 4294967330 rc 0/0 00000100:00100000:0.0:1789996316.700374:0:11495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 11 00000100:00100000:3.0:1789996316.939664:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996316.939767:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927516544 00000100:00100000:0.0:1789996316.939776:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927516544 00000100:00100000:0.0:1789996316.939865:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 50 00000100:00100000:0.0:1789996316.939876:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0877b7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+33:10344:x1876946927516544:12345-192.168.204.37@tcp:101:cat.0 00010000:00010000:0.0:1789996316.939908:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789996316.939929:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6c00/0x4173739f0fc80ae3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b97003095e3555c expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996316.940184:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6800/0x4173739f0fc80aea lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996316.940199:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6800/0x4173739f0fc80aea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996316.940211:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6800/0x4173739f0fc80aea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789996316.940222:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1789996316.940361:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6c00/0x4173739f0fc80ae3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e3555c expref: 36 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996316.940381:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6800/0x4173739f0fc80aea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e3555c expref: 35 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996316.940389:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e084601b100) 00010000:00010000:0.0:1789996316.940392:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789996316.940396:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e086fcb6800, rc 0) 00000100:00100000:0.0:1789996316.940457:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0877b7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+35:10344:x1876946927516544:12345-192.168.204.37@tcp:101:cat.0 Request processed in 583us (802us total) trans 4294967331 rc 0/0 00000100:00100000:0.0:1789996316.940480:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 50 00000100:00100000:2.0:1789996316.945361:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996316.945445:0:8520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927516672 00000100:00100000:0.0:1789996316.945456:0:8520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927516672 00000100:00100000:0.0:1789996316.945522:0:8520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 3 00000100:00100000:0.0:1789996316.945532:0:8520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0848c1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+35:2363:x1876946927516672:12345-192.168.204.37@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789996316.945575:0:8520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789996316.945601:0:8520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6800/0x4173739f0fc80aea lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e3555c expref: 35 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996316.945617:0:8520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e084601b100) 00010000:00010000:0.0:1789996316.945622:0:8520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789996316.945679:0:8520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0848c1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+34:2363:x1876946927516672:12345-192.168.204.37@tcp:103:ldlm_bl.0 Request processed in 148us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996316.945686:0:8520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 3 00000100:00100000:3.0:1789996316.946767:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996316.948448:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927516928 00000100:00100000:2.0:1789996316.948461:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927516928 00000100:00100000:2.0:1789996316.948579:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 12 00000100:00100000:2.0:1789996316.948590:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0877b7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+34:10344:x1876946927516928:12345-192.168.204.37@tcp:35:cat.0 00000100:00100000:2.0:1789996316.949452:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0877b7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+35:10344:x1876946927516928:12345-192.168.204.37@tcp:35:cat.0 Request processed in 860us (2687us total) trans 4294967332 rc 0/0 00000100:00100000:2.0:1789996316.949462:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 12 00000100:00100000:3.0:1789996317.012691:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996317.012825:0:9163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927517184 00000100:00100000:0.0:1789996317.012835:0:9163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927517184 00000100:00100000:0.0:1789996317.012935:0:9163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 51 00000100:00100000:0.0:1789996317.012945:0:9163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0877b7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+35:10350:x1876946927517184:12345-192.168.204.37@tcp:101:dd.0 00010000:00010000:0.0:1789996317.012967:0:9163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789996317.012971:0:9163:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789996317.012997:0:9163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4800/0x4173739f0fc80a50 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35532 expref: 35 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996317.013026:0:9163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e084601b700) 00010000:00010000:0.0:1789996317.013032:0:9163:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789996317.013045:0:9163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6800/0x4173739f0fc80af8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b97003095e35563 expref: -99 pid: 9163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996317.013157:0:9163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6c00/0x4173739f0fc80aff lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996317.013171:0:9163:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6000/0x4173739f0fc80ace lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35555 expref: 35 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996317.013178:0:9163:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6c00/0x4173739f0fc80aff lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996317.013208:0:9163:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6000/0x4173739f0fc80ace lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35555 expref: 35 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996317.013222:0:9163:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6000/0x4173739f0fc80ace lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35555 expref: 35 pid: 5848 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789996317.013235:0:9163:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0880f78700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9163:1876946942227200:192.168.204.37@tcp:104: 00000100:00100000:0.0:1789996317.013329:0:9163:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e084659e180 going to sleep for 11 seconds 00000100:00080000:2.0:1789996317.013837:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789996317.018222:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1789996317.018577:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927517312 00000100:00100000:1.0:1789996317.018586:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927517312 00010000:00010000:1.0:1789996317.018627:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6000/0x4173739f0fc80ace lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35555 expref: 36 pid: 5848 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789996317.018663:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 38 00000100:00100000:1.0:1789996317.018673:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086d7f1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+36:2363:x1876946927517312:12345-192.168.204.37@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789996317.018687:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789996317.018694:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6000/0x4173739f0fc80ace lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35555 expref: 36 pid: 5848 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996317.018707:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6000/0x4173739f0fc80ace lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35555 expref: 36 pid: 5848 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996317.018730:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e084601b100) 00010000:00010000:1.0:1789996317.018747:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6c00/0x4173739f0fc80aff lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996317.018757:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6c00/0x4173739f0fc80aff lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996317.018765:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6c00/0x4173739f0fc80aff lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996317.019085:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789996317.019157:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086d7f1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+36:2363:x1876946927517312:12345-192.168.204.37@tcp:103:ldlm_bl.0 Request processed in 484us (943us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996317.019164:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 38 00010000:00010000:0.0:1789996317.019776:0:9163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6000/0x4173739f0fc80ace lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35555 expref: 35 pid: 5848 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789996317.019821:0:9163:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0880f78700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9163:1876946942227200:192.168.204.37@tcp:104: 00010000:00010000:0.0:1789996317.019851:0:9163:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6c00/0x4173739f0fc80aff lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996317.019860:0:9163:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6c00/0x4173739f0fc80aff lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996317.019883:0:9163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6c00/0x4173739f0fc80aff lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789996317.020245:0:9163:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1789996317.020415:0:9163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6800/0x4173739f0fc80af8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35563 expref: 36 pid: 9163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996317.020430:0:9163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6c00/0x4173739f0fc80aff lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35563 expref: 35 pid: 9163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996317.020438:0:9163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e084601b100) 00010000:00010000:0.0:1789996317.020441:0:9163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789996317.020444:0:9163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e086fcb6c00, rc 0) 00000100:00100000:0.0:1789996317.020481:0:9163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0877b7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+35:10350:x1876946927517184:12345-192.168.204.37@tcp:101:dd.0 Request processed in 7538us (7800us total) trans 4294967333 rc 0/0 00000100:00100000:0.0:1789996317.020488:0:9163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 51 00000100:00100000:0.0:1789996317.026137:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996317.026241:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927517568 00000100:00100000:2.0:1789996317.026253:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927517568 00000100:00100000:2.0:1789996317.026348:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 52 00000100:00100000:2.0:1789996317.026360:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0880f78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+35:10350:x1876946927517568:12345-192.168.204.37@tcp:36:dd.0 00010000:00010000:2.0:1789996317.026646:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4e00/0x4173739f0fc80b0d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996317.026663:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4e00/0x4173739f0fc80b0d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996317.026675:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4e00/0x4173739f0fc80b0d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789996317.026725:0:5847:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:2.0:1789996317.026765:0:5847:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008456256a reply state 00000000a84ca919 transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4e00/0x4173739f0fc80b0d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789996317.026774:0:5847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789996317.027238:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0880f78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+38:10350:x1876946927517568:12345-192.168.204.37@tcp:36:dd.0 Request processed in 878us (1109us total) trans 4294967335 rc 0/0 00000100:00100000:2.0:1789996317.027246:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 52 00000020:00080000:2.0:1789996317.027251:0:5847:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789996317.033206:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789996317.033988:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4e00/0x4173739f0fc80b0d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996317.034003:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4e00/0x4173739f0fc80b0d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996317.034076:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4e00/0x4173739f0fc80b0d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996317.034083:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0842de4e00 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:0.0:1789996317.034088:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4e00/0x4173739f0fc80b0d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996317.034105:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4e00/0x4173739f0fc80b0d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996317.034119:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e084601b100) 00010000:00010000:0.0:1789996317.034121:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789996317.034126:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4e00/0x4173739f0fc80b0d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996317.034133:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4e00/0x4173739f0fc80b0d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789996317.251372:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1789996317.251500:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927517696 00000100:00100000:1.0:1789996317.251510:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927517696 00000100:00100000:1.0:1789996317.251634:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 53 00000100:00100000:1.0:1789996317.251645:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0880f78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+37:10364:x1876946927517696:12345-192.168.204.37@tcp:101:stat.0 00010000:00010000:1.0:1789996317.251669:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789996317.251689:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22000/0x4173739f0fc80b14 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b97003095e3556a expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996317.251764:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23a00/0x4173739f0fc80b1b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996317.251776:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23a00/0x4173739f0fc80b1b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996317.251795:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23a00/0x4173739f0fc80b1b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996317.251811:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22800/0x4173739f0fc80b22 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996317.251819:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22800/0x4173739f0fc80b22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996317.251826:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22800/0x4173739f0fc80b22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996317.251986:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22e00/0x4173739f0fc80b29 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996317.251997:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6c00/0x4173739f0fc80aff lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35563 expref: 38 pid: 9163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996317.252092:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22e00/0x4173739f0fc80b29 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996317.252128:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6c00/0x4173739f0fc80aff lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35563 expref: 38 pid: 9163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996317.252142:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6c00/0x4173739f0fc80aff lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35563 expref: 38 pid: 9163 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789996317.252156:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fadbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5846:1876946942227328:192.168.204.37@tcp:104: 00000100:00100000:1.0:1789996317.252313:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e086fd99e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789996317.255517:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996317.255607:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927517952 00000100:00100000:0.0:1789996317.255616:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927517952 00000100:00100000:0.0:1789996317.255666:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 13 00000100:00100000:0.0:1789996317.255675:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0877b7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+39:5598:x1876946927517952:12345-192.168.204.37@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1789996317.256953:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fadbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5846:1876946942227328:192.168.204.37@tcp:104: 00010000:00010000:1.0:1789996317.256981:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22e00/0x4173739f0fc80b29 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789996317.257392:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0877b7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+40:5598:x1876946927517952:12345-192.168.204.37@tcp:35:ldlm_bl.0 Request processed in 1715us (1882us total) trans 4294967336 rc 0/0 00000100:00100000:0.0:1789996317.257402:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 13 00000100:00100000:3.0:1789996317.260173:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996317.260419:0:8520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927518080 00000100:00100000:0.0:1789996317.260429:0:8520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927518080 00010000:00010000:0.0:1789996317.260463:0:8520:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6c00/0x4173739f0fc80aff lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35563 expref: 40 pid: 9163 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789996317.260540:0:8520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 39 00000100:00100000:0.0:1789996317.260570:0:8520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0877b7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+40:2362:x1876946927518080:12345-192.168.204.37@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789996317.260585:0:8520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789996317.260599:0:8520:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6c00/0x4173739f0fc80aff lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35563 expref: 40 pid: 9163 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996317.260612:0:8520:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6c00/0x4173739f0fc80aff lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35563 expref: 40 pid: 9163 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996317.260633:0:8520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6c00/0x4173739f0fc80aff lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35563 expref: 40 pid: 9163 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996317.260649:0:8520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e084601b100) 00010000:00010000:0.0:1789996317.260655:0:8520:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22e00/0x4173739f0fc80b29 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996317.260664:0:8520:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22e00/0x4173739f0fc80b29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996317.260671:0:8520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22e00/0x4173739f0fc80b29 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996317.260709:0:8520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789996317.260771:0:8520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0877b7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+39:2362:x1876946927518080:12345-192.168.204.37@tcp:103:ldlm_bl.0 Request processed in 203us (606us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996317.260790:0:8520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 39 00010000:00010000:2.0:1789996317.260859:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22e00/0x4173739f0fc80b29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996317.260867:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22e00/0x4173739f0fc80b29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789996317.260919:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1789996317.260923:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789996317.260963:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22e00/0x4173739f0fc80b29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996317.260975:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22e00/0x4173739f0fc80b29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996317.260994:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23a00/0x4173739f0fc80b1b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996317.261001:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23a00/0x4173739f0fc80b1b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996317.261494:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23a00/0x4173739f0fc80b1b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996317.261500:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0876a23a00 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:2.0:1789996317.261504:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23a00/0x4173739f0fc80b1b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996317.261512:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23a00/0x4173739f0fc80b1b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996317.261524:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e084601b700) 00010000:00010000:2.0:1789996317.261526:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789996317.261530:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23a00/0x4173739f0fc80b1b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996317.261536:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23a00/0x4173739f0fc80b1b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996317.261572:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22800/0x4173739f0fc80b22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996317.261579:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22800/0x4173739f0fc80b22 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996317.261584:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22800/0x4173739f0fc80b22 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996317.261596:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0876a22800 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:2.0:1789996317.261599:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22800/0x4173739f0fc80b22 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996317.261605:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22800/0x4173739f0fc80b22 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996317.261613:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8e0861fcfe00) 00010000:00010000:2.0:1789996317.261615:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789996317.261618:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22800/0x4173739f0fc80b22 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996317.261624:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22800/0x4173739f0fc80b22 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996317.261662:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22000/0x4173739f0fc80b14 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e3556a expref: 39 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996317.261676:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22e00/0x4173739f0fc80b29 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e3556a expref: 38 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996317.261684:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e084601b100) 00010000:00010000:2.0:1789996317.261686:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789996317.261689:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e0876a22e00, rc 0) 00000100:00100000:2.0:1789996317.261726:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0880f78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+38:10364:x1876946927517696:12345-192.168.204.37@tcp:101:stat.0 Request processed in 10084us (10365us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996317.261733:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 53 00000100:00100000:3.0:1789996317.333255:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996317.333359:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927518336 00000100:00100000:0.0:1789996317.333369:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927518336 00000100:00100000:0.0:1789996317.333429:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 54 00000100:00100000:0.0:1789996317.333439:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0877b7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+38:10370:x1876946927518336:12345-192.168.204.37@tcp:36:truncate.0 00010000:00010000:0.0:1789996317.333496:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789996317.333522:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22e00/0x4173739f0fc80b29 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e3556a expref: 38 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996317.333583:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e084601b100) 00010000:00010000:0.0:1789996317.333589:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789996317.333803:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6c00/0x4173739f0fc80b30 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996317.333818:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6c00/0x4173739f0fc80b30 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996317.333828:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6c00/0x4173739f0fc80b30 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789996317.334078:0:5848:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:0.0:1789996317.334108:0:5848:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000069a62110 reply state 00000000d15c2f0a transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6c00/0x4173739f0fc80b30 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789996317.334116:0:5848:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789996317.334231:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0877b7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+40:10370:x1876946927518336:12345-192.168.204.37@tcp:36:truncate.0 Request processed in 792us (984us total) trans 4294967338 rc 0/0 00000100:00100000:0.0:1789996317.334239:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 54 00000020:00080000:0.0:1789996317.334245:0:5848:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789996317.336044:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6c00/0x4173739f0fc80b30 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996317.336056:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6c00/0x4173739f0fc80b30 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996317.336063:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6c00/0x4173739f0fc80b30 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996317.336069:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e086fcb6c00 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:1.0:1789996317.336074:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6c00/0x4173739f0fc80b30 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996317.336099:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6c00/0x4173739f0fc80b30 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996317.336114:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e084601b100) 00010000:00010000:1.0:1789996317.336117:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789996317.336122:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6c00/0x4173739f0fc80b30 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996317.336129:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6c00/0x4173739f0fc80b30 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789996317.448923:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996317.449025:0:9163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927518464 00000100:00100000:0.0:1789996317.449035:0:9163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927518464 00000100:00100000:0.0:1789996317.449098:0:9163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 55 00000100:00100000:0.0:1789996317.449109:0:9163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0877b7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+39:10384:x1876946927518464:12345-192.168.204.37@tcp:101:stat.0 00010000:00010000:0.0:1789996317.449133:0:9163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789996317.449153:0:9163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6800/0x4173739f0fc80b37 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b97003095e35571 expref: -99 pid: 9163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996317.449234:0:9163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6000/0x4173739f0fc80b3e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996317.449249:0:9163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6000/0x4173739f0fc80b3e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996317.449260:0:9163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6000/0x4173739f0fc80b3e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996317.449274:0:9163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7e00/0x4173739f0fc80b45 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996317.449281:0:9163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7e00/0x4173739f0fc80b45 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996317.449287:0:9163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7e00/0x4173739f0fc80b45 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996317.449368:0:9163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6e00/0x4173739f0fc80b4c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996317.449377:0:9163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6e00/0x4173739f0fc80b4c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996317.449383:0:9163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6e00/0x4173739f0fc80b4c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789996317.449415:0:9163:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:0.0:1789996317.449419:0:9163:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789996317.449441:0:9163:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6e00/0x4173739f0fc80b4c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996317.449462:0:9163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6e00/0x4173739f0fc80b4c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996317.449471:0:9163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6000/0x4173739f0fc80b3e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996317.449478:0:9163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6000/0x4173739f0fc80b3e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996317.449485:0:9163:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6000/0x4173739f0fc80b3e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996317.449491:0:9163:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e086fcb6000 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:0.0:1789996317.449510:0:9163:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6000/0x4173739f0fc80b3e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996317.449518:0:9163:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6000/0x4173739f0fc80b3e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996317.449528:0:9163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e084601b700) 00010000:00010000:0.0:1789996317.449531:0:9163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789996317.449536:0:9163:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6000/0x4173739f0fc80b3e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996317.449573:0:9163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6000/0x4173739f0fc80b3e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996317.449587:0:9163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7e00/0x4173739f0fc80b45 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996317.449593:0:9163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7e00/0x4173739f0fc80b45 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996317.449605:0:9163:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7e00/0x4173739f0fc80b45 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996317.449610:0:9163:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e086fcb7e00 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:0.0:1789996317.449613:0:9163:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7e00/0x4173739f0fc80b45 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996317.449620:0:9163:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7e00/0x4173739f0fc80b45 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996317.449634:0:9163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8e0850c28800) 00010000:00010000:0.0:1789996317.449636:0:9163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789996317.449639:0:9163:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7e00/0x4173739f0fc80b45 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996317.449644:0:9163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7e00/0x4173739f0fc80b45 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996317.449676:0:9163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6800/0x4173739f0fc80b37 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35571 expref: 41 pid: 9163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996317.449689:0:9163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6e00/0x4173739f0fc80b4c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35571 expref: 40 pid: 9163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996317.449697:0:9163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e084601b100) 00010000:00010000:0.0:1789996317.449699:0:9163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789996317.449701:0:9163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e086fcb6e00, rc 0) 00000100:00100000:0.0:1789996317.449819:0:9163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0877b7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+40:10384:x1876946927518464:12345-192.168.204.37@tcp:101:stat.0 Request processed in 711us (905us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996317.449847:0:9163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 55 00000100:00100000:3.0:1789996317.562138:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996317.562351:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927518720 00000100:00100000:2.0:1789996317.562375:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927518720 00000100:00100000:2.0:1789996317.562442:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 56 00000100:00100000:2.0:1789996317.562452:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0877b7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+40:10394:x1876946927518720:12345-192.168.204.37@tcp:101:lfs.0 00010000:00010000:2.0:1789996317.562471:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789996317.562491:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4800/0x4173739f0fc80b53 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b97003095e35578 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789996317.562602:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1789996317.562717:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4800/0x4173739f0fc80b53 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35578 expref: 42 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996317.562729:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e0850c28200) 00010000:00010000:2.0:1789996317.562731:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789996317.562737:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4800/0x4173739f0fc80b53 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35578 expref: 42 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996317.562750:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e0842de4800, rc 0) 00000100:00100000:2.0:1789996317.562818:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0877b7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+41:10394:x1876946927518720:12345-192.168.204.37@tcp:101:lfs.0 Request processed in 367us (688us total) trans 4294967339 rc 301/301 00000100:00100000:2.0:1789996317.562826:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 56 00000100:00100000:3.0:1789996317.573318:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996317.573419:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927518976 00000100:00100000:2.0:1789996317.573432:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927518976 00000100:00100000:2.0:1789996317.573493:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 14 00000100:00100000:2.0:1789996317.573503:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0877b7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+41:10394:x1876946927518976:12345-192.168.204.37@tcp:35:lfs.0 00000100:00100000:2.0:1789996317.573789:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0877b7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+42:10394:x1876946927518976:12345-192.168.204.37@tcp:35:lfs.0 Request processed in 279us (473us total) trans 4294967340 rc 0/0 00000100:00100000:2.0:1789996317.573797:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 14 00000004:00080000:1.0:1789996317.673501:0:7018:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 359392955668ns, next at 360392953048ns, rc = 0 00000100:00100000:3.0:1789996317.673616:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fadbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876946942227456:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789996317.673711:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996317.673997:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942227456 00000100:00100000:1.0:1789996317.674005:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942227456 00000100:00100000:1.0:1789996317.674061:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789996317.674071:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0876a07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1876946942227456:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789996317.674106:0:6691:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789996317.674158:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0876a07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1876946942227456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996317.674165:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789996317.674301:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fadbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876946942227456:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789996317.687319:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996317.687421:0:9163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927519232 00000100:00100000:0.0:1789996317.687432:0:9163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927519232 00000100:00100000:0.0:1789996317.687498:0:9163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 57 00000100:00100000:0.0:1789996317.687509:0:9163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0876a04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+42:10400:x1876946927519232:12345-192.168.204.37@tcp:101:bash.0 00010000:00010000:0.0:1789996317.687535:0:9163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789996317.687579:0:9163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6800/0x4173739f0fc80b61 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b97003095e3557f expref: -99 pid: 9163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996317.687684:0:9163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7e00/0x4173739f0fc80b68 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996317.687699:0:9163:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6e00/0x4173739f0fc80b4c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35571 expref: 43 pid: 9163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996317.687707:0:9163:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7e00/0x4173739f0fc80b68 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996317.687745:0:9163:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6e00/0x4173739f0fc80b4c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35571 expref: 43 pid: 9163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996317.687760:0:9163:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6e00/0x4173739f0fc80b4c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35571 expref: 43 pid: 9163 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789996317.687774:0:9163:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0741835500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9163:1876946942227584:192.168.204.37@tcp:104: 00000100:00100000:0.0:1789996317.688055:0:9163:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e08411caf00 going to sleep for 11 seconds 00000100:00100000:3.0:1789996317.694589:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1789996317.695235:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927519360 00000100:00100000:1.0:1789996317.695245:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927519360 00010000:00010000:1.0:1789996317.695290:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6e00/0x4173739f0fc80b4c lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35571 expref: 44 pid: 9163 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789996317.695336:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 40 00000100:00100000:1.0:1789996317.695346:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0876a04a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+44:2363:x1876946927519360:12345-192.168.204.37@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789996317.695378:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789996317.695386:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6e00/0x4173739f0fc80b4c lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35571 expref: 44 pid: 9163 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996317.695399:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6e00/0x4173739f0fc80b4c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35571 expref: 44 pid: 9163 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996317.695419:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e084601b100) 00010000:00010000:1.0:1789996317.695423:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7e00/0x4173739f0fc80b68 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996317.695432:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7e00/0x4173739f0fc80b68 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996317.695440:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7e00/0x4173739f0fc80b68 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996317.695459:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789996317.695631:0:9163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6e00/0x4173739f0fc80b4c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35571 expref: 44 pid: 9163 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789996317.695659:0:9163:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0741835500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9163:1876946942227584:192.168.204.37@tcp:104: 00010000:00010000:0.0:1789996317.695683:0:9163:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7e00/0x4173739f0fc80b68 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996317.695692:0:9163:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7e00/0x4173739f0fc80b68 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996317.695698:0:9163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7e00/0x4173739f0fc80b68 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789996317.695719:0:9163:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000100:00100000:1.0:1789996317.696177:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0876a04a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+43:2363:x1876946927519360:12345-192.168.204.37@tcp:103:ldlm_bl.0 Request processed in 830us (1634us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996317.696187:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 40 00010000:00010000:0.0:1789996317.696370:0:9163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6800/0x4173739f0fc80b61 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e3557f expref: 44 pid: 9163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996317.696388:0:9163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7e00/0x4173739f0fc80b68 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e3557f expref: 43 pid: 9163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996317.696396:0:9163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e084601b100) 00010000:00010000:0.0:1789996317.696399:0:9163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789996317.696401:0:9163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e086fcb7e00, rc 0) 00000100:00100000:0.0:1789996317.696430:0:9163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0876a04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+43:10400:x1876946927519232:12345-192.168.204.37@tcp:101:bash.0 Request processed in 8923us (9120us total) trans 4294967341 rc 0/0 00000100:00100000:0.0:1789996317.696437:0:9163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 57 00000100:00100000:1.0:1789996317.706123:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996317.709317:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927519616 00000100:00100000:2.0:1789996317.709334:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927519616 00000100:00100000:2.0:1789996317.709422:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 58 00000100:00100000:2.0:1789996317.709433:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fadaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+43:10400:x1876946927519616:12345-192.168.204.37@tcp:36:bash.0 00010000:00010000:2.0:1789996317.709741:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5c00/0x4173739f0fc80b76 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996317.709760:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5c00/0x4173739f0fc80b76 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996317.709772:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5c00/0x4173739f0fc80b76 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789996317.709824:0:5847:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:2.0:1789996317.709864:0:5847:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000442b1a21 reply state 000000005cc6ae3f transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5c00/0x4173739f0fc80b76 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789996317.709872:0:5847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789996317.710320:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fadaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+46:10400:x1876946927519616:12345-192.168.204.37@tcp:36:bash.0 Request processed in 887us (4206us total) trans 4294967343 rc 0/0 00000100:00100000:2.0:1789996317.710328:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 58 00000020:00080000:2.0:1789996317.710334:0:5847:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789996317.713270:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5c00/0x4173739f0fc80b76 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996317.713288:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5c00/0x4173739f0fc80b76 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996317.713296:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5c00/0x4173739f0fc80b76 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996317.713321:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0842de5c00 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:1.0:1789996317.713326:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5c00/0x4173739f0fc80b76 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996317.713333:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5c00/0x4173739f0fc80b76 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996317.713350:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e084601b100) 00010000:00010000:1.0:1789996317.713353:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789996317.713359:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5c00/0x4173739f0fc80b76 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996317.713365:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5c00/0x4173739f0fc80b76 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789996317.720668:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996317.722421:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927519744 00000100:00100000:2.0:1789996317.722436:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927519744 00000100:00100000:2.0:1789996317.722648:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 59 00000100:00100000:2.0:1789996317.722661:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fad9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+45:10400:x1876946927519744:12345-192.168.204.37@tcp:101:bash.0 00010000:00010000:2.0:1789996317.722688:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789996317.722711:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5a00/0x4173739f0fc80b7d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b97003095e35586 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996317.722870:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5c00/0x4173739f0fc80b84 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996317.722898:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7e00/0x4173739f0fc80b68 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e3557f expref: 46 pid: 9163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996317.722908:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5c00/0x4173739f0fc80b84 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996317.722946:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7e00/0x4173739f0fc80b68 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e3557f expref: 46 pid: 9163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996317.722960:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7e00/0x4173739f0fc80b68 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e3557f expref: 46 pid: 9163 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789996317.723308:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086d7f3480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5846:1876946942227712:192.168.204.37@tcp:104: 00000100:00100000:2.0:1789996317.723405:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0845297a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789996317.725874:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086d7f3480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5846:1876946942227712:192.168.204.37@tcp:104: 00010000:00010000:1.0:1789996317.725915:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5c00/0x4173739f0fc80b84 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789996317.728629:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996317.728746:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927519872 00000100:00100000:2.0:1789996317.728757:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927519872 00010000:00010000:2.0:1789996317.728819:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7e00/0x4173739f0fc80b68 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e3557f expref: 47 pid: 9163 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789996317.728876:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 41 00000100:00100000:2.0:1789996317.728886:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fadb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+47:2362:x1876946927519872:12345-192.168.204.37@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789996317.728926:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789996317.728936:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7e00/0x4173739f0fc80b68 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e3557f expref: 47 pid: 9163 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996317.728957:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7e00/0x4173739f0fc80b68 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e3557f expref: 47 pid: 9163 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996317.729269:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7e00/0x4173739f0fc80b68 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e3557f expref: 47 pid: 9163 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996317.729289:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e084601b100) 00010000:00010000:2.0:1789996317.729295:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5c00/0x4173739f0fc80b84 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996317.729305:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5c00/0x4173739f0fc80b84 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996317.729313:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5c00/0x4173739f0fc80b84 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996317.729439:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789996317.729509:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fadb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+46:2362:x1876946927519872:12345-192.168.204.37@tcp:103:ldlm_bl.0 Request processed in 624us (891us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996317.729516:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 41 00010000:00010000:3.0:1789996317.743404:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5c00/0x4173739f0fc80b84 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996317.743425:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5c00/0x4173739f0fc80b84 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789996317.743594:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1789996317.743599:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789996317.743623:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5c00/0x4173739f0fc80b84 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996317.743665:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5a00/0x4173739f0fc80b7d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35586 expref: 46 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996317.743686:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5c00/0x4173739f0fc80b84 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35586 expref: 45 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996317.743717:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e084601b100) 00010000:00010000:2.0:1789996317.743720:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789996317.743736:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e0842de5c00, rc 0) 00000100:00100000:2.0:1789996317.743812:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fad9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+45:10400:x1876946927519744:12345-192.168.204.37@tcp:101:bash.0 Request processed in 21154us (23152us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996317.743821:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 59 00000100:00100000:1.0:1789996317.765668:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996317.765948:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927520128 00000100:00100000:0.0:1789996317.765959:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927520128 00000100:00100000:0.0:1789996317.766141:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 15 00000100:00100000:0.0:1789996317.766152:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0850a21c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+45:10400:x1876946927520128:12345-192.168.204.37@tcp:35:bash.0 00000100:00100000:0.0:1789996317.766422:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0850a21c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+46:10400:x1876946927520128:12345-192.168.204.37@tcp:35:bash.0 Request processed in 271us (765us total) trans 4294967344 rc 0/0 00000100:00100000:0.0:1789996317.766430:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 15 00000100:00100000:3.0:1789996317.853173:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996317.854431:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927520384 00000100:00100000:0.0:1789996317.854444:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927520384 00000100:00100000:0.0:1789996317.854531:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 60 00000100:00100000:0.0:1789996317.854578:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0876a06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+46:10410:x1876946927520384:12345-192.168.204.37@tcp:101:lfs.0 00010000:00010000:0.0:1789996317.854603:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789996317.854624:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6800/0x4173739f0fc80b8b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b97003095e3558d expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789996317.854713:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:0.0:1789996317.854845:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6800/0x4173739f0fc80b8b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e3558d expref: 48 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996317.854859:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e0850c28200) 00010000:00010000:0.0:1789996317.854862:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789996317.854868:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6800/0x4173739f0fc80b8b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e3558d expref: 48 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996317.854882:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e086fcb6800, rc 0) 00000100:00100000:0.0:1789996317.854941:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0876a06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+47:10410:x1876946927520384:12345-192.168.204.37@tcp:101:lfs.0 Request processed in 401us (1777us total) trans 4294967345 rc 301/301 00000100:00100000:0.0:1789996317.854948:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 60 00000100:00100000:1.0:1789996317.862773:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996317.862864:0:9163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927520512 00000100:00100000:0.0:1789996317.862876:0:9163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927520512 00000100:00100000:0.0:1789996317.862946:0:9163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 61 00000100:00100000:0.0:1789996317.862973:0:9163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fad9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+47:10410:x1876946927520512:12345-192.168.204.37@tcp:34:lfs.0 00010000:00010000:0.0:1789996317.863051:0:9163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6800/0x4173739f0fc80b99 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996317.863068:0:9163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6800/0x4173739f0fc80b99 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996317.863081:0:9163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6800/0x4173739f0fc80b99 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996317.863095:0:9163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6e00/0x4173739f0fc80ba0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996317.863102:0:9163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6e00/0x4173739f0fc80ba0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996317.863109:0:9163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6e00/0x4173739f0fc80ba0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996317.863200:0:9163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6000/0x4173739f0fc80ba7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996317.863208:0:9163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6000/0x4173739f0fc80ba7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996317.863215:0:9163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6000/0x4173739f0fc80ba7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789996317.863254:0:9163:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6000/0x4173739f0fc80ba7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996317.863267:0:9163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6800/0x4173739f0fc80b99 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996317.863281:0:9163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6800/0x4173739f0fc80b99 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996317.863288:0:9163:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6800/0x4173739f0fc80b99 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996317.863295:0:9163:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e086fcb6800 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:0.0:1789996317.863299:0:9163:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6800/0x4173739f0fc80b99 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996317.863306:0:9163:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6800/0x4173739f0fc80b99 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996317.863320:0:9163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e084601b700) 00010000:00010000:0.0:1789996317.863323:0:9163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789996317.863329:0:9163:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6800/0x4173739f0fc80b99 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996317.863335:0:9163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6800/0x4173739f0fc80b99 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996317.863348:0:9163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6e00/0x4173739f0fc80ba0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996317.863354:0:9163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6e00/0x4173739f0fc80ba0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996317.863360:0:9163:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6e00/0x4173739f0fc80ba0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996317.863365:0:9163:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e086fcb6e00 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:0.0:1789996317.863373:0:9163:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6e00/0x4173739f0fc80ba0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996317.863379:0:9163:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6e00/0x4173739f0fc80ba0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996317.863386:0:9163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8e0850c28800) 00010000:00010000:0.0:1789996317.863388:0:9163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789996317.863391:0:9163:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6e00/0x4173739f0fc80ba0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996317.863397:0:9163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6e00/0x4173739f0fc80ba0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996317.863410:0:9163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6000/0x4173739f0fc80ba7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996317.863415:0:9163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6000/0x4173739f0fc80ba7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996317.863421:0:9163:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6000/0x4173739f0fc80ba7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996317.863425:0:9163:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e086fcb6000 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:0.0:1789996317.863427:0:9163:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6000/0x4173739f0fc80ba7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996317.863432:0:9163:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6000/0x4173739f0fc80ba7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996317.863437:0:9163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e084601b100) 00010000:00010000:0.0:1789996317.863439:0:9163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789996317.863445:0:9163:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6000/0x4173739f0fc80ba7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996317.863451:0:9163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6000/0x4173739f0fc80ba7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789996317.863522:0:9163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fad9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+47:10410:x1876946927520512:12345-192.168.204.37@tcp:34:lfs.0 Request processed in 550us (758us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996317.863528:0:9163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 61 00000100:00100000:1.0:1789996317.865853:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996317.865940:0:11495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927520768 00000100:00100000:2.0:1789996317.865949:0:11495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927520768 00000100:00100000:2.0:1789996317.866004:0:11495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 16 00000100:00100000:2.0:1789996317.866015:0:11495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fadad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+47:10410:x1876946927520768:12345-192.168.204.37@tcp:35:lfs.0 00000100:00100000:2.0:1789996317.866274:0:11495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fadad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+48:10410:x1876946927520768:12345-192.168.204.37@tcp:35:lfs.0 Request processed in 260us (429us total) trans 4294967346 rc 0/0 00000100:00100000:2.0:1789996317.866282:0:11495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 16 00000100:00100000:3.0:1789996317.911269:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996317.914908:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927521024 00000100:00100000:0.0:1789996317.914923:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927521024 00000100:00100000:0.0:1789996317.915080:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 62 00000100:00100000:0.0:1789996317.915093:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0876a05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+48:10413:x1876946927521024:12345-192.168.204.37@tcp:101:lfs.0 00010000:00010000:0.0:1789996317.915119:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789996317.915140:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6000/0x4173739f0fc80bae lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b97003095e35594 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996317.915215:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6e00/0x4173739f0fc80bb5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996317.915230:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6e00/0x4173739f0fc80bb5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996317.915242:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6e00/0x4173739f0fc80bb5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996317.915258:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6800/0x4173739f0fc80bbc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996317.915265:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6800/0x4173739f0fc80bbc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996317.915735:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6800/0x4173739f0fc80bbc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996317.916173:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6a00/0x4173739f0fc80bc3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996317.916183:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6a00/0x4173739f0fc80bc3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996317.916191:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6a00/0x4173739f0fc80bc3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789996317.916202:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1789996317.916295:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6e00/0x4173739f0fc80bb5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996317.916303:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6e00/0x4173739f0fc80bb5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996317.916310:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6e00/0x4173739f0fc80bb5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996317.916316:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e086fcb6e00 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:0.0:1789996317.916321:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6e00/0x4173739f0fc80bb5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996317.916328:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6e00/0x4173739f0fc80bb5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996317.916340:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e084601b700) 00010000:00010000:0.0:1789996317.916344:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789996317.916358:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6e00/0x4173739f0fc80bb5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996317.916365:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6e00/0x4173739f0fc80bb5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996317.916378:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6800/0x4173739f0fc80bbc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996317.916384:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6800/0x4173739f0fc80bbc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996317.916390:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6800/0x4173739f0fc80bbc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996317.916395:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e086fcb6800 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:0.0:1789996317.916398:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6800/0x4173739f0fc80bbc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996317.916405:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6800/0x4173739f0fc80bbc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996317.916412:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8e0850c28800) 00010000:00010000:0.0:1789996317.916414:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789996317.916417:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6800/0x4173739f0fc80bbc lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996317.916423:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6800/0x4173739f0fc80bbc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996317.916470:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6000/0x4173739f0fc80bae lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35594 expref: 51 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996317.916657:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6a00/0x4173739f0fc80bc3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35594 expref: 50 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996317.916665:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e084601b100) 00010000:00010000:0.0:1789996317.916668:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789996317.916671:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e086fcb6a00, rc 0) 00000100:00100000:0.0:1789996317.916746:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0876a05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+50:10413:x1876946927521024:12345-192.168.204.37@tcp:101:lfs.0 Request processed in 1655us (5485us total) trans 4294967347 rc 0/0 00000100:00100000:0.0:1789996317.916755:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 62 00000100:00100000:1.0:1789996317.919473:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996317.919575:0:9163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927521152 00000100:00100000:0.0:1789996317.919584:0:9163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927521152 00000100:00100000:0.0:1789996317.919637:0:9163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 63 00000100:00100000:0.0:1789996317.919645:0:9163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fad9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+50:10413:x1876946927521152:12345-192.168.204.37@tcp:54:lfs.0 00010000:00010000:0.0:1789996317.919705:0:9163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7600/0x4173739f0fc80bd1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996317.919719:0:9163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7600/0x4173739f0fc80bd1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996317.919739:0:9163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7600/0x4173739f0fc80bd1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996317.919762:0:9163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7600/0x4173739f0fc80bd1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996317.919768:0:9163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7600/0x4173739f0fc80bd1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996317.919792:0:9163:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7600/0x4173739f0fc80bd1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996317.919799:0:9163:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e086fcb7600 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:0.0:1789996317.919803:0:9163:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7600/0x4173739f0fc80bd1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996317.919811:0:9163:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7600/0x4173739f0fc80bd1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996317.919833:0:9163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e084601b100) 00010000:00010000:0.0:1789996317.919837:0:9163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789996317.919842:0:9163:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7600/0x4173739f0fc80bd1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996317.919849:0:9163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7600/0x4173739f0fc80bd1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789996317.919922:0:9163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fad9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+50:10413:x1876946927521152:12345-192.168.204.37@tcp:54:lfs.0 Request processed in 277us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996317.919930:0:9163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 63 00000100:00100000:3.0:1789996317.922133:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1789996317.922166:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1789996317.922345:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927521536 00000100:00100000:1.0:1789996317.922354:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927521536 00000100:00100000:1.0:1789996317.922417:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 4 00000100:00100000:1.0:1789996317.922427:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0876a06300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+50:2362:x1876946927521536:12345-192.168.204.37@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789996317.922456:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789996317.922479:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6a00/0x4173739f0fc80bc3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35594 expref: 50 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996317.922499:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e084601b100) 00010000:00010000:1.0:1789996317.922503:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789996317.922578:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0876a06300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+49:2362:x1876946927521536:12345-192.168.204.37@tcp:103:ldlm_bl.0 Request processed in 152us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996317.922585:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 4 00000100:00100000:0.0:1789996317.923869:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927521408 00000100:00100000:0.0:1789996317.923887:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927521408 00000100:00100000:0.0:1789996317.923925:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 17 00000100:00100000:0.0:1789996317.923933:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0876a04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+49:10413:x1876946927521408:12345-192.168.204.37@tcp:35:lfs.0 00000100:00100000:0.0:1789996317.924311:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0876a04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+50:10413:x1876946927521408:12345-192.168.204.37@tcp:35:lfs.0 Request processed in 377us (2187us total) trans 4294967348 rc 0/0 00000100:00100000:0.0:1789996317.924319:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 17 00010000:00010000:3.0:1789996318.056711:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789996318.081669:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996318.081771:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927521792 00000100:00100000:2.0:1789996318.081781:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927521792 00000100:00100000:2.0:1789996318.082031:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 64 00000100:00100000:2.0:1789996318.082041:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0876a05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+50:10431:x1876946927521792:12345-192.168.204.37@tcp:101:cat.0 00010000:00010000:2.0:1789996318.082062:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789996318.082080:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4800/0x4173739f0fc80bd8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b97003095e3559b expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996318.082163:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5800/0x4173739f0fc80bdf lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996318.082173:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5800/0x4173739f0fc80bdf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996318.082194:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5800/0x4173739f0fc80bdf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789996318.082203:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1789996318.082306:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4800/0x4173739f0fc80bd8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e3559b expref: 53 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996318.082325:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5800/0x4173739f0fc80bdf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e3559b expref: 52 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996318.082334:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e084601b100) 00010000:00010000:2.0:1789996318.082337:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1789996318.082341:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e0842de5800, rc 0) 00000100:00100000:2.0:1789996318.082409:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0876a05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+52:10431:x1876946927521792:12345-192.168.204.37@tcp:101:cat.0 Request processed in 369us (750us total) trans 4294967349 rc 0/0 00000100:00100000:2.0:1789996318.082418:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 64 00000100:00100000:3.0:1789996318.109156:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996318.109369:0:9163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927521920 00000100:00100000:0.0:1789996318.109380:0:9163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927521920 00000100:00100000:0.0:1789996318.109506:0:9163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 65 00000100:00100000:0.0:1789996318.109517:0:9163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0876a07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+52:10432:x1876946927521920:12345-192.168.204.37@tcp:101:lfs.0 00010000:00010000:0.0:1789996318.109538:0:9163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789996318.109592:0:9163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7600/0x4173739f0fc80bed lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b97003095e355a2 expref: -99 pid: 9163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996318.109660:0:9163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6000/0x4173739f0fc80bf4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996318.109674:0:9163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6000/0x4173739f0fc80bf4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996318.109686:0:9163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6000/0x4173739f0fc80bf4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789996318.109718:0:9163:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:0.0:1789996318.109722:0:9163:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789996318.109739:0:9163:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6000/0x4173739f0fc80bf4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996318.109764:0:9163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7600/0x4173739f0fc80bed lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e355a2 expref: 54 pid: 9163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996318.109782:0:9163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6000/0x4173739f0fc80bf4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e355a2 expref: 53 pid: 9163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996318.109790:0:9163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e084601b700) 00010000:00010000:0.0:1789996318.109793:0:9163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789996318.109811:0:9163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e086fcb6000, rc 0) 00000100:00100000:0.0:1789996318.109889:0:9163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0876a07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+53:10432:x1876946927521920:12345-192.168.204.37@tcp:101:lfs.0 Request processed in 374us (743us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996318.109897:0:9163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 65 00000100:00100000:3.0:1789996318.113193:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996318.113335:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927522304 00000100:00100000:2.0:1789996318.113345:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927522304 00000100:00100000:2.0:1789996318.113399:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 18 00000100:00100000:2.0:1789996318.113410:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0876a07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+53:10432:x1876946927522304:12345-192.168.204.37@tcp:35:lfs.0 00000100:00100000:2.0:1789996318.114363:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0876a07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+54:10432:x1876946927522304:12345-192.168.204.37@tcp:35:lfs.0 Request processed in 951us (1174us total) trans 4294967350 rc 0/0 00000100:00100000:2.0:1789996318.114372:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 18 00000100:00100000:3.0:1789996318.117735:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996318.117844:0:8520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927522432 00000100:00100000:0.0:1789996318.117854:0:8520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927522432 00000100:00100000:0.0:1789996318.118040:0:8520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 5 00000100:00100000:0.0:1789996318.118052:0:8520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0876a04380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+54:10432:x1876946927522432:12345-192.168.204.37@tcp:103:lfs.0 00010000:00010000:0.0:1789996318.118067:0:8520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1789996318.118092:0:8520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5c00/0x4173739f0fc80b84 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35586 expref: 54 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996318.118112:0:8520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5800/0x4173739f0fc80bdf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e3559b expref: 53 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996318.118123:0:8520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4200/0x4173739f0fc80a8f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35547 expref: 52 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996318.118132:0:8520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e084601b100) 00010000:00010000:0.0:1789996318.118143:0:8520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789996318.118199:0:8520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0876a04380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+51:10432:x1876946927522432:12345-192.168.204.37@tcp:103:lfs.0 Request processed in 150us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996318.118515:0:8520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 5 00000100:00100000:3.0:1789996318.121107:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1789996318.121209:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927522560 00000100:00100000:1.0:1789996318.121218:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927522560 00000100:00100000:1.0:1789996318.121337:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 66 00000100:00100000:1.0:1789996318.121348:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0876a06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+51:10432:x1876946927522560:12345-192.168.204.37@tcp:58:lfs.0 00010000:00010000:1.0:1789996318.121490:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23400/0x4173739f0fc80bfb lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996318.121506:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23400/0x4173739f0fc80bfb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996318.121518:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23400/0x4173739f0fc80bfb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789996318.121950:0:5848:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789996318.122164:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:1.0:1789996318.122230:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:1.0:1789996318.122341:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0876a06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+51:10432:x1876946927522560:12345-192.168.204.37@tcp:58:lfs.0 Request processed in 993us (1373us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996318.122349:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 66 00000100:00100000:3.0:1789996318.152953:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996318.153186:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927522688 00000100:00100000:2.0:1789996318.153195:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927522688 00000100:00100000:2.0:1789996318.154380:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 67 00000100:00100000:2.0:1789996318.154396:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0876a05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+51:10434:x1876946927522688:12345-192.168.204.37@tcp:101:lfs.0 00010000:00010000:2.0:1789996318.154431:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789996318.154453:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4800/0x4173739f0fc80c02 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b97003095e355a9 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996318.154517:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4e00/0x4173739f0fc80c09 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996318.154531:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4e00/0x4173739f0fc80c09 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996318.154558:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4e00/0x4173739f0fc80c09 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996318.154575:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4200/0x4173739f0fc80c10 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996318.154581:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4200/0x4173739f0fc80c10 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996318.154588:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4200/0x4173739f0fc80c10 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996318.154671:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5800/0x4173739f0fc80c17 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996318.154680:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5800/0x4173739f0fc80c17 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996318.154686:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5800/0x4173739f0fc80c17 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789996318.155014:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1789996318.155024:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789996318.155814:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5800/0x4173739f0fc80c17 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996318.155856:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5800/0x4173739f0fc80c17 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996318.155866:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4e00/0x4173739f0fc80c09 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996318.155873:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4e00/0x4173739f0fc80c09 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996318.155879:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4e00/0x4173739f0fc80c09 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996318.155884:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0842de4e00 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:3.0:1789996318.155888:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4e00/0x4173739f0fc80c09 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996318.155895:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4e00/0x4173739f0fc80c09 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996318.155907:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e084601b700) 00010000:00010000:3.0:1789996318.155910:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789996318.155915:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4e00/0x4173739f0fc80c09 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996318.155921:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4e00/0x4173739f0fc80c09 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996318.155936:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4200/0x4173739f0fc80c10 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996318.155942:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4200/0x4173739f0fc80c10 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996318.155954:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4200/0x4173739f0fc80c10 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996318.155960:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0842de4200 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:3.0:1789996318.155974:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4200/0x4173739f0fc80c10 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996318.155981:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4200/0x4173739f0fc80c10 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996318.155998:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8e084601be00) 00010000:00010000:3.0:1789996318.156001:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789996318.156004:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4200/0x4173739f0fc80c10 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996318.156009:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4200/0x4173739f0fc80c10 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996318.156045:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4800/0x4173739f0fc80c02 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e355a9 expref: 53 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996318.156059:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5800/0x4173739f0fc80c17 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e355a9 expref: 52 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996318.156066:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e0861fcf900) 00010000:00010000:3.0:1789996318.156067:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789996318.156070:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e0842de5800, rc 0) 00000100:00100000:3.0:1789996318.156146:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0876a05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+52:10434:x1876946927522688:12345-192.168.204.37@tcp:101:lfs.0 Request processed in 1755us (3203us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996318.156162:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 67 00000040:00080000:2.0:1789996318.184924:0:11698:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789996318.184933:0:11698:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789996318.185124:0:11698:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1789996318.185132:0:11698:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789996318.185268:0:11698:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086d7f1500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11698:1876946942227840:192.168.204.37@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789996318.185369:0:11698:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0845297000 going to sleep for 11 seconds 00000100:00100000:3.0:1789996318.188940:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996318.188942:0:11698:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086d7f1500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11698:1876946942227840:192.168.204.37@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789996318.189368:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927522816 00000100:00100000:0.0:1789996318.189375:0:5858:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927522816 00000100:00100000:0.0:1789996318.189433:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 1 00000100:00100000:0.0:1789996318.189443:0:5858:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0876a07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+52:10439:x1876946927522816:12345-192.168.204.37@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1789996318.189574:0:5858:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0876a07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+52:10439:x1876946927522816:12345-192.168.204.37@tcp:900:lhsmtool_posix.0 Request processed in 100us (611us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996318.189582:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 1 00000100:00100000:3.0:1789996318.191240:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996318.191321:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927522944 00000100:00100000:2.0:1789996318.191328:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927522944 00000100:00100000:2.0:1789996318.191381:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 68 00000100:00100000:2.0:1789996318.191391:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0876a05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+52:10439:x1876946927522944:12345-192.168.204.37@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789996318.191419:0:5847:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789996318.191516:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0876a05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+52:10439:x1876946927522944:12345-192.168.204.37@tcp:53:lhsmtool_posix.0 Request processed in 126us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996318.191524:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 68 00000100:00100000:3.0:1789996318.203725:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996318.204092:0:9163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927523072 00000100:00100000:0.0:1789996318.204103:0:9163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927523072 00000100:00100000:0.0:1789996318.204162:0:9163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 69 00000100:00100000:0.0:1789996318.204173:0:9163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0876a06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+52:10439:x1876946927523072:12345-192.168.204.37@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1789996318.204245:0:9163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7600/0x4173739f0fc80c1e lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996318.204261:0:9163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7600/0x4173739f0fc80c1e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996318.204273:0:9163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7600/0x4173739f0fc80c1e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996318.204341:0:9163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6800/0x4173739f0fc80c25 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996318.204350:0:9163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6800/0x4173739f0fc80c25 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996318.204356:0:9163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6800/0x4173739f0fc80c25 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996318.204384:0:9163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6e00/0x4173739f0fc80c2c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996318.204392:0:9163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6e00/0x4173739f0fc80c2c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996318.204419:0:9163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6e00/0x4173739f0fc80c2c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789996318.204457:0:9163:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1789996318.204462:0:9163:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789996318.204491:0:9163:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6e00/0x4173739f0fc80c2c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996318.204503:0:9163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7600/0x4173739f0fc80c1e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996318.204511:0:9163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7600/0x4173739f0fc80c1e lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996318.204518:0:9163:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7600/0x4173739f0fc80c1e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996318.204524:0:9163:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e086fcb7600 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:0.0:1789996318.204528:0:9163:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7600/0x4173739f0fc80c1e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996318.204536:0:9163:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7600/0x4173739f0fc80c1e lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996318.204577:0:9163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e084601b600) 00010000:00010000:0.0:1789996318.204580:0:9163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789996318.204586:0:9163:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7600/0x4173739f0fc80c1e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996318.204592:0:9163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7600/0x4173739f0fc80c1e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996318.204618:0:9163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6800/0x4173739f0fc80c25 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996318.204625:0:9163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6800/0x4173739f0fc80c25 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996318.204630:0:9163:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6800/0x4173739f0fc80c25 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996318.204635:0:9163:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e086fcb6800 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:0.0:1789996318.204639:0:9163:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6800/0x4173739f0fc80c25 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996318.204644:0:9163:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6800/0x4173739f0fc80c25 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996318.204652:0:9163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff8e0850c28800) 00010000:00010000:0.0:1789996318.204654:0:9163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789996318.204657:0:9163:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6800/0x4173739f0fc80c25 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996318.204663:0:9163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6800/0x4173739f0fc80c25 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996318.204678:0:9163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6e00/0x4173739f0fc80c2c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996318.204685:0:9163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6e00/0x4173739f0fc80c2c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996318.204691:0:9163:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6e00/0x4173739f0fc80c2c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996318.204702:0:9163:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e086fcb6e00 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:0.0:1789996318.204705:0:9163:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6e00/0x4173739f0fc80c2c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996318.204711:0:9163:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6e00/0x4173739f0fc80c2c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996318.204853:0:9163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e0861fcf900) 00010000:00010000:0.0:1789996318.204856:0:9163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789996318.204859:0:9163:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6e00/0x4173739f0fc80c2c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996318.204865:0:9163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6e00/0x4173739f0fc80c2c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789996318.205043:0:9163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0876a06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+52:10439:x1876946927523072:12345-192.168.204.37@tcp:34:lhsmtool_posix.0 Request processed in 870us (1336us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996318.205051:0:9163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 69 00000100:00100000:3.0:1789996318.212490:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996318.212602:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927523328 00000100:00100000:2.0:1789996318.212611:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927523328 00000100:00100000:2.0:1789996318.212671:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 70 00000100:00100000:2.0:1789996318.212681:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0876a05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+52:10439:x1876946927523328:12345-192.168.204.37@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789996318.212701:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789996318.212732:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5a00/0x4173739f0fc80c33 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b97003095e355b0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996318.212846:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5c00/0x4173739f0fc80c3a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996318.212889:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5c00/0x4173739f0fc80c3a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996318.212902:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5c00/0x4173739f0fc80c3a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789996318.212915:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1789996318.213009:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5c00/0x4173739f0fc80c3a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996318.213017:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5c00/0x4173739f0fc80c3a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996318.213024:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5c00/0x4173739f0fc80c3a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996318.213031:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0842de5c00 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:2.0:1789996318.213035:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5c00/0x4173739f0fc80c3a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996318.213041:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5c00/0x4173739f0fc80c3a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996318.213053:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e0861fcf900) 00010000:00010000:2.0:1789996318.213056:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789996318.213061:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5c00/0x4173739f0fc80c3a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996318.213068:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5c00/0x4173739f0fc80c3a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996318.213108:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5a00/0x4173739f0fc80c33 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e355b0 expref: 54 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996318.213126:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e084601b600) 00010000:00010000:2.0:1789996318.213129:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789996318.213133:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5a00/0x4173739f0fc80c33 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e355b0 expref: 54 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996318.213143:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e0842de5a00, rc 0) 00000100:00100000:2.0:1789996318.213207:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0876a05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+53:10439:x1876946927523328:12345-192.168.204.37@tcp:101:lhsmtool_posix.0 Request processed in 528us (727us total) trans 4294967351 rc 301/301 00000100:00100000:2.0:1789996318.213215:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 70 00000100:00100000:3.0:1789996318.215795:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1789996318.215899:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927523456 00000100:00100000:1.0:1789996318.215909:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927523456 00000100:00100000:1.0:1789996318.215968:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 71 00000100:00100000:1.0:1789996318.215979:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0876a04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+53:10439:x1876946927523456:12345-192.168.204.37@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789996318.216013:0:5846:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789996318.216120:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0876a04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+53:10439:x1876946927523456:12345-192.168.204.37@tcp:53:lhsmtool_posix.0 Request processed in 143us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996318.216128:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 71 00000100:00100000:3.0:1789996318.219006:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996318.219307:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927523712 00000100:00100000:2.0:1789996318.219316:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927523712 00000100:00100000:2.0:1789996318.219370:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 72 00000100:00100000:2.0:1789996318.219380:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e084755c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+53:10439:x1876946927523712:12345-192.168.204.37@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789996318.219400:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789996318.219403:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789996318.219428:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6000/0x4173739f0fc80bf4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e355a2 expref: 53 pid: 9163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996318.219448:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e084601b700) 00010000:00010000:2.0:1789996318.219453:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789996318.219466:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4800/0x4173739f0fc80c48 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b97003095e355b7 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789996318.219906:0:5847:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:2.0:1789996318.220113:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4200/0x4173739f0fc80c4f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996318.220137:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4200/0x4173739f0fc80c4f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996318.220147:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4200/0x4173739f0fc80c4f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996318.221704:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4800/0x4173739f0fc80c48 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e355b7 expref: 55 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996318.221727:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4200/0x4173739f0fc80c4f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e355b7 expref: 54 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996318.221735:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8e084601bf00) 00010000:00010000:2.0:1789996318.221738:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789996318.221741:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e0842de4200, rc 0) 00000100:00100000:2.0:1789996318.223207:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e084755c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+54:10439:x1876946927523712:12345-192.168.204.37@tcp:101:lhsmtool_posix.0 Request processed in 3821us (4202us total) trans 4294967352 rc 0/0 00000100:00100000:2.0:1789996318.223218:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 72 00000100:00100000:3.0:1789996318.226067:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1789996318.226156:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927523968 00000100:00100000:1.0:1789996318.226165:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927523968 00000100:00100000:1.0:1789996318.226264:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 73 00000100:00100000:1.0:1789996318.226274:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e084755e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+54:10439:x1876946927523968:12345-192.168.204.37@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789996318.226328:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789996318.226352:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4200/0x4173739f0fc80c4f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e355b7 expref: 54 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996318.226371:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8e084601bf00) 00010000:00010000:1.0:1789996318.226382:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789996318.226404:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22600/0x4173739f0fc80c5d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996318.226418:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22600/0x4173739f0fc80c5d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996318.226428:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22600/0x4173739f0fc80c5d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996318.226479:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23e00/0x4173739f0fc80c64 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x52ee78bd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996318.226500:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23e00/0x4173739f0fc80c64 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x52ee78bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996318.226508:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23e00/0x4173739f0fc80c64 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x52ee78bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996318.226606:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22600/0x4173739f0fc80c5d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996318.226614:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22600/0x4173739f0fc80c5d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996318.226621:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22600/0x4173739f0fc80c5d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996318.226628:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0876a22600 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:1.0:1789996318.226632:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22600/0x4173739f0fc80c5d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996318.226640:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22600/0x4173739f0fc80c5d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996318.226649:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e084601b700) 00010000:00010000:1.0:1789996318.226652:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789996318.226656:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22600/0x4173739f0fc80c5d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996318.226661:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22600/0x4173739f0fc80c5d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996318.226671:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23e00/0x4173739f0fc80c64 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x52ee78bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996318.226684:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23e00/0x4173739f0fc80c64 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x52ee78bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996318.226690:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23e00/0x4173739f0fc80c64 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x52ee78bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996318.226695:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0876a23e00 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:1.0:1789996318.226698:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23e00/0x4173739f0fc80c64 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x52ee78bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996318.226705:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23e00/0x4173739f0fc80c64 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x52ee78bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996318.226713:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x52ee78bd (ffff8e0861fcfe00) 00010000:00010000:1.0:1789996318.226716:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789996318.226719:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23e00/0x4173739f0fc80c64 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x52ee78bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996318.226726:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23e00/0x4173739f0fc80c64 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x52ee78bd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789996318.226922:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e084755e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+53:10439:x1876946927523968:12345-192.168.204.37@tcp:36:lhsmtool_posix.0 Request processed in 649us (865us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789996318.226930:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 73 00000100:00100000:2.0:1789996318.229679:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1789996318.229954:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927524096 00000100:00100000:1.0:1789996318.229964:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927524096 00000100:00100000:1.0:1789996318.230020:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 74 00000100:00100000:1.0:1789996318.230030:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086d7f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+53:10439:x1876946927524096:12345-192.168.204.37@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789996318.230050:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789996318.230086:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22200/0x4173739f0fc80c6b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b97003095e355be expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996318.230160:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22a00/0x4173739f0fc80c72 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996318.230173:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22a00/0x4173739f0fc80c72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996318.230186:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22a00/0x4173739f0fc80c72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996318.230277:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22200/0x4173739f0fc80c6b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e355be expref: 55 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996318.230294:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22a00/0x4173739f0fc80c72 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e355be expref: 54 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996318.230301:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8e0861fcfa00) 00010000:00010000:1.0:1789996318.230303:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789996318.230306:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e0876a22a00, rc 0) 00000100:00100000:1.0:1789996318.230419:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086d7f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+54:10439:x1876946927524096:12345-192.168.204.37@tcp:101:lhsmtool_posix.0 Request processed in 390us (747us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996318.230426:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 74 00000100:00100000:3.0:1789996318.235171:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996318.235424:0:9163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927524352 00000100:00100000:0.0:1789996318.235436:0:9163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927524352 00000100:00100000:0.0:1789996318.235495:0:9163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 75 00000100:00100000:0.0:1789996318.235505:0:9163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e084755dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+54:10439:x1876946927524352:12345-192.168.204.37@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789996318.235620:0:9163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6e00/0x4173739f0fc80c79 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996318.235638:0:9163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6e00/0x4173739f0fc80c79 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996318.235651:0:9163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6e00/0x4173739f0fc80c79 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789996318.236030:0:9163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:0.0:1789996318.236041:0:9163:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 359955497858ns, next at 360955495373ns, rc = 0 00000004:00010000:0.0:1789996318.236139:0:9163:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000046d77c7c reply state 000000002658a055 transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6e00/0x4173739f0fc80c79 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789996318.236148:0:9163:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789996318.236243:0:9163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e084755dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+56:10439:x1876946927524352:12345-192.168.204.37@tcp:36:lhsmtool_posix.0 Request processed in 738us (1080us total) trans 4294967353 rc 0/0 00000100:00100000:0.0:1789996318.236250:0:9163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 75 00010000:00010000:1.0:1789996318.237982:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6e00/0x4173739f0fc80c79 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996318.237997:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6e00/0x4173739f0fc80c79 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996318.238005:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6e00/0x4173739f0fc80c79 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996318.238026:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e086fcb6e00 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:1.0:1789996318.238031:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6e00/0x4173739f0fc80c79 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996318.238038:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6e00/0x4173739f0fc80c79 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996318.238054:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8e0861fcfa00) 00010000:00010000:1.0:1789996318.238057:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789996318.238062:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6e00/0x4173739f0fc80c79 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996318.238068:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6e00/0x4173739f0fc80c79 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789996318.239477:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996318.240496:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927524480 00000100:00100000:0.0:1789996318.240507:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927524480 00000100:00100000:0.0:1789996318.240702:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 76 00000100:00100000:0.0:1789996318.240723:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e084755f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+55:10439:x1876946927524480:12345-192.168.204.37@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789996318.240746:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789996318.240765:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6800/0x4173739f0fc80c80 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b97003095e355c5 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996318.240845:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6800/0x4173739f0fc80c80 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e355c5 expref: 56 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996318.240860:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6800/0x4173739f0fc80c80 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e355c5 expref: 56 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996318.240890:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8e0861fcfa00) 00010000:00010000:0.0:1789996318.240893:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789996318.240897:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e086fcb6800, rc 0) 00000100:00100000:0.0:1789996318.240965:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e084755f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+56:10439:x1876946927524480:12345-192.168.204.37@tcp:101:lhsmtool_posix.0 Request processed in 254us (1495us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996318.240973:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 76 00000100:00100000:3.0:1789996318.243073:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996318.243158:0:8222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927524608 00000100:00100000:2.0:1789996318.243164:0:8222:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927524608 00000100:00100000:2.0:1789996318.243204:0:8222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 24 00000100:00100000:2.0:1789996318.243211:0:8222:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e084755fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2361:x1876946927524608:12345-192.168.204.37@tcp:8:lhsmtool_posix.0 00010000:00080000:2.0:1789996318.243239:0:8222:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 189efa8a-c7eb-4b69-9afa-1dd36d6775f1@192.168.204.37@tcp t0 exp 0000000000000000 cur 359 last 0 00000020:00000080:2.0:1789996318.243269:0:8222:0:(genops.c:1384:class_connect()) connect: client 189efa8a-c7eb-4b69-9afa-1dd36d6775f1, cookie 0x4173739f0fc80c87 00002000:00100000:2.0:1789996318.243280:0:8222:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 189efa8a-c7eb-4b69-9afa-1dd36d6775f1/ffff8e087f961000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a3f ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789996318.243315:0:8222:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789996318.243566:0:8222:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789996318.243595:0:8222:0:(import.c:65:import_set_state_nolock()) ffff8e087f960000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789996318.243654:0:8222:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e084755fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+6:2361:x1876946927524608:12345-192.168.204.37@tcp:8:lhsmtool_posix.0 Request processed in 442us (588us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996318.243663:0:8222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 24 00000100:00100000:2.0:1789996318.248812:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996318.248880:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927524736 00000100:00100000:0.0:1789996318.248890:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927524736 00000100:00100000:0.0:1789996318.248970:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 25 00000100:00100000:0.0:1789996318.248982:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086d7f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+6:0:x1876946927524736:12345-192.168.204.37@tcp:2:lhsmtool_posix.0 00000100:00080000:2.0:1789996318.249371:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:0.0:1789996318.279525:0:7659:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000001:00100000:0.0:1789996318.279563:0:7659:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 189efa8a-c7eb-4b69-9afa-1dd36d6775f1 00000100:00100000:1.0:1789996318.279719:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086d7f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+5:0:x1876946927524736:12345-192.168.204.37@tcp:2:lhsmtool_posix.0 Request processed in 30733us (30914us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1789996318.279730:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 25 00000100:00100000:3.0:1789996318.283173:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996318.283255:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927524992 00000100:00100000:0.0:1789996318.283265:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927524992 00000100:00100000:0.0:1789996318.283323:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 19 00000100:00100000:0.0:1789996318.283335:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e084755c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+56:10439:x1876946927524992:12345-192.168.204.37@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789996318.284183:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e084755c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+57:10439:x1876946927524992:12345-192.168.204.37@tcp:35:lhsmtool_posix.0 Request processed in 845us (1012us total) trans 4294967354 rc 0/0 00000100:00100000:0.0:1789996318.284192:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 19 00000100:00100000:0.0:1789996318.286639:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1789996318.286907:0:9163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927525248 00000100:00100000:3.0:1789996318.286916:0:9163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927525248 00000100:00100000:3.0:1789996318.287080:0:9163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 77 00000100:00100000:3.0:1789996318.287091:0:9163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0741835500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+57:10439:x1876946927525248:12345-192.168.204.37@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789996318.287234:0:9163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0741835500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+57:10439:x1876946927525248:12345-192.168.204.37@tcp:57:lhsmtool_posix.0 Request processed in 144us (604us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996318.287242:0:9163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 77 00000100:00100000:0.0:1789996318.289769:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1789996318.289865:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927525376 00000100:00100000:1.0:1789996318.289874:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927525376 00000100:00100000:1.0:1789996318.289960:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 78 00000100:00100000:1.0:1789996318.289971:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0741835f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+57:10439:x1876946927525376:12345-192.168.204.37@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789996318.289989:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789996318.290008:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22200/0x4173739f0fc80c8e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b97003095e355cc expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996318.290073:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23e00/0x4173739f0fc80c95 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996318.290099:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23e00/0x4173739f0fc80c95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996318.290111:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23e00/0x4173739f0fc80c95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789996318.290143:0:5848:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789996318.290160:0:5848:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23e00/0x4173739f0fc80c95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996318.290185:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22200/0x4173739f0fc80c8e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e355cc expref: 59 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996318.290201:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23e00/0x4173739f0fc80c95 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e355cc expref: 58 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996318.290209:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8e0861fcfa00) 00010000:00010000:1.0:1789996318.290212:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1789996318.290215:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e0876a23e00, rc 0) 00000100:00100000:1.0:1789996318.290271:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0741835f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+58:10439:x1876946927525376:12345-192.168.204.37@tcp:101:lhsmtool_posix.0 Request processed in 302us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996318.290278:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 78 00000100:00100000:0.0:1789996318.292744:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1789996318.292859:0:8222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927525504 00000100:00100000:3.0:1789996318.292868:0:8222:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927525504 00000100:00100000:3.0:1789996318.292956:0:8222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 26 00000100:00100000:3.0:1789996318.292965:0:8222:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0877b7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+5:2362:x1876946927525504:12345-192.168.204.37@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789996318.292980:0:8222:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789996318.293000:0:8222:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bc277d92/0x4173739f0fc80c9c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1b97003095e355d3 expref: -99 pid: 8222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789996318.293037:0:8222:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6ab12d1e, blocks: 0x1 00010000:00010000:3.0:1789996318.293053:0:8222:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=360s v=(0 0) 00010000:00010000:3.0:1789996318.293058:0:8222:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789996318.293066:0:8222:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bc277d92/0x4173739f0fc80c9c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e355d3 expref: 6 pid: 8222 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996318.293086:0:8222:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000bc277d92/0x4173739f0fc80c9c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e355d3 expref: 6 pid: 8222 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996318.293100:0:8222:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e087f857600, rc 0) 00000100:00100000:3.0:1789996318.293155:0:8222:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0877b7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+6:2362:x1876946927525504:12345-192.168.204.37@tcp:101:lhsmtool_posix.0 Request processed in 191us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996318.293162:0:8222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 26 00000100:00100000:3.0:1789996318.295361:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996318.295483:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927525760 00000100:00100000:2.0:1789996318.295492:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927525760 00000100:00100000:2.0:1789996318.295624:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 79 00000100:00100000:2.0:1789996318.295635:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e084755ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+58:10439:x1876946927525760:12345-192.168.204.37@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789996318.295737:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e084755ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+58:10439:x1876946927525760:12345-192.168.204.37@tcp:57:lhsmtool_posix.0 Request processed in 104us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996318.295745:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 79 00000100:00100000:0.0:1789996318.298012:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1789996318.298264:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927525888 00000100:00100000:3.0:1789996318.298272:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927525888 00000100:00100000:3.0:1789996318.298360:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 27 00000100:00100000:3.0:1789996318.298370:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0877b7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+6:10439:x1876946927525888:12345-192.168.204.37@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789996318.298386:0:6690:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789996318.298403:0:6690:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000726d4047/0x4173739f0fc80ca3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1b97003095e355da expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996318.298433:0:6690:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000bc277d92/0x4173739f0fc80c9c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e355d3 expref: 7 pid: 8222 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996318.298454:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789996318.298459:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789996318.298465:0:6690:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000726d4047/0x4173739f0fc80ca3 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e355da expref: 7 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996318.298498:0:6690:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000bc277d92/0x4173739f0fc80c9c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e355d3 expref: 7 pid: 8222 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996318.298511:0:6690:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000bc277d92/0x4173739f0fc80c9c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e355d3 expref: 7 pid: 8222 timeout: 460 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789996318.298526:0:6690:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e084755d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6690:1876946942227968:192.168.204.37@tcp:104: 00000100:00100000:3.0:1789996318.298635:0:6690:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e084314db40 going to sleep for 11 seconds 00000100:00100000:0.0:1789996318.306153:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1789996318.306242:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927526016 00000100:00100000:1.0:1789996318.306251:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927526016 00010000:00010000:1.0:1789996318.306289:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000bc277d92/0x4173739f0fc80c9c lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e355d3 expref: 8 pid: 8222 timeout: 460 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789996318.306340:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 42 00000100:00100000:1.0:1789996318.306357:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0848c1d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+8:2362:x1876946927526016:12345-192.168.204.37@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789996318.306371:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789996318.306394:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000bc277d92/0x4173739f0fc80c9c lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e355d3 expref: 8 pid: 8222 timeout: 460 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996318.306408:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000bc277d92/0x4173739f0fc80c9c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e355d3 expref: 8 pid: 8222 timeout: 460 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996318.306436:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789996318.306441:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789996318.306449:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000726d4047/0x4173739f0fc80ca3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e355da expref: 8 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996318.306460:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000726d4047/0x4173739f0fc80ca3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e355da expref: 8 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996318.306494:0:5831:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000726d4047/0x4173739f0fc80ca3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e355da expref: 8 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789996318.306509:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fad8700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5831:1876946942228096:192.168.204.37@tcp:105: 00000100:00100000:1.0:1789996318.306613:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0842b5eb40 going to sleep for 11 seconds 00010000:00010000:3.0:1789996318.307451:0:6690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bc277d92/0x4173739f0fc80c9c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e355d3 expref: 8 pid: 8222 timeout: 460 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789996318.307467:0:6690:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e084755d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6690:1876946942227968:192.168.204.37@tcp:104: 00010000:00010000:3.0:1789996318.307497:0:6690:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000726d4047/0x4173739f0fc80ca3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.37@tcp remote: 0x1b97003095e355da expref: 7 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996318.307508:0:6690:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e087f856e00, rc 0) 00000100:00100000:3.0:1789996318.307942:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0877b7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+7:10439:x1876946927525888:12345-192.168.204.37@tcp:101:lhsmtool_posix.0 Request processed in 9572us (9938us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996318.307963:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 27 00000100:00100000:3.0:1789996318.308765:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fad8700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5831:1876946942228096:192.168.204.37@tcp:105: 00010000:00010000:3.0:1789996318.308785:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789996318.308832:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0848c1d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+6:2362:x1876946927526016:12345-192.168.204.37@tcp:103:ldlm_bl.0 Request processed in 2477us (2760us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996318.308840:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 42 00000100:00100000:3.0:1789996318.311705:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996318.311796:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927526144 00000100:00100000:0.0:1789996318.311805:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927526144 00002000:00100000:0.0:1789996318.311859:0:6695:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff8e084755d180 x1876946927526144/t0(0) o4->189efa8a-c7eb-4b69-9afa-1dd36d6775f1@192.168.204.37@tcp:49/0 lens 504/0 e 0 to 0 dl 1789996329 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789996318.311931:0:6695:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8e084755d180 with x1876946927526144 ext(0->8) 00002000:00010000:0.0:1789996318.311950:0:6695:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8e084755d180 00000100:00100000:0.0:1789996318.312020:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 0 00000100:00100000:0.0:1789996318.312032:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e084755d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+6:2363:x1876946927526144:12345-192.168.204.37@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1789996318.313129:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e084755d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+8:2363:x1876946927526144:12345-192.168.204.37@tcp:4:lhsmtool_posix.0 Request processed in 1096us (1430us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1789996318.313139:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 0 00002000:00100000:0.0:1789996318.313146:0:6695:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff8e084755d180 x1876946927526144/t4294967302(0) o4->189efa8a-c7eb-4b69-9afa-1dd36d6775f1@192.168.204.37@tcp:49/0 lens 504/448 e 0 to 0 dl 1789996329 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789996318.313155:0:6695:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8e084755d180 with x1876946927526144 ext(0->8) 00002000:00010000:0.0:1789996318.313160:0:6695:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8e084755d180 00000100:00100000:0.0:1789996318.318395:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996318.318430:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927526272 00000100:00100000:0.0:1789996318.318439:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927526272 00000100:00100000:0.0:1789996318.318482:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 80 00000100:00100000:0.0:1789996318.318491:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0877b7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+58:10439:x1876946927526272:12345-192.168.204.37@tcp:44:lhsmtool_posix.0 00000100:00100000:0.0:1789996318.388268:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0877b7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+58:10439:x1876946927526272:12345-192.168.204.37@tcp:44:lhsmtool_posix.0 Request processed in 69766us (69869us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996318.388282:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 80 00000001:00080000:3.0:1789996318.389342:0:5868:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000004:00080000:3.0:1789996318.389359:0:5868:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000004:00080000:3.0:1789996318.389405:0:5868:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000004:00080000:3.0:1789996318.389448:0:5868:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000020:00080000:3.0:1789996318.389461:0:5868:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8e0845297900 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:3.0:1789996318.389465:0:5868:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8e0852a93100 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8e0845297c00 00000020:00080000:3.0:1789996318.389469:0:5868:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8e0852a93200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8e086fee7800 00000020:00080000:3.0:1789996318.389504:0:5879:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:3.0:1789996318.389651:0:5879:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:3.0:1789996318.390054:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0877b7d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876946942228224:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1789996318.390115:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996318.390236:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942228224 00000100:00100000:0.0:1789996318.390243:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942228224 00000100:00100000:0.0:1789996318.390304:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789996318.390313:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e084755f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1876946942228224:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1789996318.390455:0:6688:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1789996318.390459:0:6688:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1789996318 00002000:00010000:0.0:1789996318.390461:0:6688:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1789996318.390476:0:6688:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1789996318 -> 1789996318 00002000:00010000:0.0:1789996318.390478:0:6688:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1789996318.390519:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e084755f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3314:x1876946942228224:12345-0@lo:2:osp-syn-1-0.0 Request processed in 207us (403us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1789996318.390527:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:3.0:1789996318.390628:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:3.0:1789996318.390671:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e0877b7d500/2, rc 0, transno 4294967303 00000100:00100000:3.0:1789996318.390677:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0877b7d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876946942228224:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1789996318.391382:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0877b7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876946942228352:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1789996318.391422:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996318.391566:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942228352 00000100:00100000:0.0:1789996318.391573:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942228352 00000100:00080000:3.0:1789996318.391678:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789996318.391794:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789996318.391804:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e084755d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3315:x1876946942228352:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1789996318.391860:0:6689:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:0.0:1789996318.391898:0:6689:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 13, mtime: 0x6ab12d1c, atime: 0x6ab12d1d, ctime: 0x6ab12d1c, blocks: 0x1 00010000:00010000:0.0:1789996318.391906:0:6689:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b2db54a/0x4173739f0fc80caa lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996318.391923:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=360s v=(0 0) 00010000:00010000:0.0:1789996318.391928:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789996318.391934:0:6689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003b2db54a/0x4173739f0fc80caa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996318.391950:0:6689:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003b2db54a/0x4173739f0fc80caa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996318.392151:0:6689:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b2db54a/0x4173739f0fc80caa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996318.392161:0:6689:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003b2db54a/0x4173739f0fc80caa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996318.392197:0:6689:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789996318.392766:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e084755d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3315:x1876946942228352:12345-0@lo:6:osp-syn-0-0.0 Request processed in 962us (1341us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1789996318.392774:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789996318.393496:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00010000:00010000:2.0:1789996318.393555:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789996318.393563:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003b2db54a/0x4173739f0fc80caa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996318.393574:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e086fcb7400 already unused, calling callback (ffffffffc1595910) 00010000:00010000:2.0:1789996318.393578:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003b2db54a/0x4173739f0fc80caa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996318.393589:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003b2db54a/0x4173739f0fc80caa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996318.393625:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003b2db54a/0x4173739f0fc80caa lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996318.393634:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003b2db54a/0x4173739f0fc80caa lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996318.393656:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789996318.393658:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789996318.393660:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1789996318.394524:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e0877b7e680/2, rc 0, transno 4294967301 00000100:00100000:3.0:1789996318.394533:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0877b7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876946942228352:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1789996318.395691:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927526400 00000100:00100000:1.0:1789996318.395701:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927526400 00000100:00100000:1.0:1789996318.395949:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 30 00000100:00100000:1.0:1789996318.396069:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e084755ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+8:2365:x1876946927526400:12345-192.168.204.37@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1789996318.437385:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e084755ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+8:2365:x1876946927526400:12345-192.168.204.37@tcp:16:lhsmtool_posix.0 Request processed in 41415us (43881us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996318.437398:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 30 00000001:00080000:0.0:1789996318.437440:0:7659:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000001:00080000:0.0:1789996318.437449:0:7659:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000100:00100000:1.0:1789996318.444914:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996318.445061:0:9163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927526656 00000100:00100000:0.0:1789996318.445071:0:9163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927526656 00000100:00100000:0.0:1789996318.445139:0:9163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 81 00000100:00100000:0.0:1789996318.445151:0:9163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fadb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+13:10439:x1876946927526656:12345-192.168.204.37@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789996318.445203:0:9163:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789996318.445230:0:9163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23e00/0x4173739f0fc80c95 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e355cc expref: 13 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996318.445249:0:9163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8e0861fcfa00) 00010000:00010000:0.0:1789996318.445255:0:9163:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789996318.445289:0:9163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7800/0x4173739f0fc80cb1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996318.445304:0:9163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7800/0x4173739f0fc80cb1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996318.445314:0:9163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7800/0x4173739f0fc80cb1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789996318.445594:0:9163:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005057da4a reply state 00000000c035b199 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7800/0x4173739f0fc80cb1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789996318.445604:0:9163:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789996318.445842:0:9163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fadb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+14:10439:x1876946927526656:12345-192.168.204.37@tcp:36:lhsmtool_posix.0 Request processed in 692us (938us total) trans 4294967355 rc 0/0 00000100:00100000:0.0:1789996318.445850:0:9163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 81 00010000:00010000:2.0:1789996318.447347:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7800/0x4173739f0fc80cb1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996318.447365:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7800/0x4173739f0fc80cb1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996318.447373:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7800/0x4173739f0fc80cb1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996318.447380:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e086fcb7800 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:2.0:1789996318.447385:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7800/0x4173739f0fc80cb1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996318.447393:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7800/0x4173739f0fc80cb1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996318.447408:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8e0861fcfa00) 00010000:00010000:2.0:1789996318.447411:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789996318.447416:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7800/0x4173739f0fc80cb1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996318.447435:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7800/0x4173739f0fc80cb1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789996318.452520:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1789996318.454056:0:8222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927526784 00000100:00100000:3.0:1789996318.454068:0:8222:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927526784 00000100:00100000:3.0:1789996318.454308:0:8222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 31 00000100:00100000:3.0:1789996318.454322:0:8222:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fad8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+6:2363:x1876946927526784:12345-192.168.204.37@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1789996318.454844:0:8222:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1789996318.454848:0:8222:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1789996318 -> 1789996318 00002000:00010000:3.0:1789996318.454851:0:8222:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1789996317 00002000:00010000:3.0:1789996318.454853:0:8222:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1789996318 -> 1789996318 00002000:00010000:3.0:1789996318.454855:0:8222:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1789996318.454911:0:8222:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fad8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+7:2363:x1876946927526784:12345-192.168.204.37@tcp:2:lhsmtool_posix.0 Request processed in 592us (2401us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1789996318.454919:0:8222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 31 00000100:00100000:1.0:1789996318.457243:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996318.457321:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927527040 00000100:00100000:0.0:1789996318.457331:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927527040 00000100:00100000:0.0:1789996318.457388:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 82 00000100:00100000:0.0:1789996318.457397:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fad8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+13:10439:x1876946927527040:12345-192.168.204.37@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1789996318.457459:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6600/0x4173739f0fc80cb8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996318.457476:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22a00/0x4173739f0fc80c72 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e355be expref: 13 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996318.457486:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6600/0x4173739f0fc80cb8 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996318.457518:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22a00/0x4173739f0fc80c72 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e355be expref: 13 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996318.457531:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22a00/0x4173739f0fc80c72 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e355be expref: 13 pid: 5848 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789996318.457581:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0877b7ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5848:1876946942228480:192.168.204.37@tcp:104: 00000100:00100000:0.0:1789996318.457786:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e084892af00 going to sleep for 11 seconds 00000100:00100000:1.0:1789996318.475992:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996318.476108:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0877b7ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5848:1876946942228480:192.168.204.37@tcp:104: 00010000:00010000:0.0:1789996318.476152:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6600/0x4173739f0fc80cb8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789996318.476266:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927527168 00000100:00100000:2.0:1789996318.476273:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927527168 00010000:00010000:2.0:1789996318.476311:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22a00/0x4173739f0fc80c72 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e355be expref: 14 pid: 5848 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789996318.476352:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 43 00000100:00100000:2.0:1789996318.476362:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fada680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+14:2363:x1876946927527168:12345-192.168.204.37@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789996318.476376:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789996318.476383:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22a00/0x4173739f0fc80c72 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e355be expref: 14 pid: 5848 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996318.476395:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22a00/0x4173739f0fc80c72 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e355be expref: 14 pid: 5848 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996318.476417:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22a00/0x4173739f0fc80c72 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e355be expref: 14 pid: 5848 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996318.476431:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8e0861fcfa00) 00010000:00010000:2.0:1789996318.476436:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6600/0x4173739f0fc80cb8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996318.476445:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6600/0x4173739f0fc80cb8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996318.476452:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6600/0x4173739f0fc80cb8 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996318.476490:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789996318.476567:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fada680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+13:2363:x1876946927527168:12345-192.168.204.37@tcp:103:ldlm_bl.0 Request processed in 179us (557us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996318.476576:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 43 00010000:00010000:3.0:1789996318.476888:0:5848:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6600/0x4173739f0fc80cb8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996318.476897:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6600/0x4173739f0fc80cb8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996318.476923:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6600/0x4173739f0fc80cb8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996318.476930:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6600/0x4173739f0fc80cb8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996318.476938:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6600/0x4173739f0fc80cb8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996318.476955:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e086fcb6600 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:3.0:1789996318.476969:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6600/0x4173739f0fc80cb8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996318.476978:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6600/0x4173739f0fc80cb8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996318.476988:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8e0861fcfa00) 00010000:00010000:3.0:1789996318.476991:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1789996318.476994:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6600/0x4173739f0fc80cb8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996318.477000:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6600/0x4173739f0fc80cb8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789996318.477045:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fad8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+12:10439:x1876946927527040:12345-192.168.204.37@tcp:55:lhsmtool_posix.0 Request processed in 19648us (19809us total) trans 0 rc -22/-22 00000100:00100000:3.0:1789996318.477052:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 82 00000100:00100000:3.0:1789996318.483337:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996318.486856:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927527296 00000100:00100000:0.0:1789996318.486871:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927527296 00000100:00100000:0.0:1789996318.486940:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 32 00000100:00100000:0.0:1789996318.486951:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e084755df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+7:2365:x1876946927527296:12345-192.168.204.37@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1789996318.487006:0:6689:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c255d220/0x4173739f0fc80cbf lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996318.487027:0:6689:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000726d4047/0x4173739f0fc80ca3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.37@tcp remote: 0x1b97003095e355da expref: 7 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996318.487036:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789996318.487041:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789996318.487045:0:6689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c255d220/0x4173739f0fc80cbf lrc: 4/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996318.487080:0:6689:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000726d4047/0x4173739f0fc80ca3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.37@tcp remote: 0x1b97003095e355da expref: 7 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996318.487094:0:6689:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000726d4047/0x4173739f0fc80ca3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.37@tcp remote: 0x1b97003095e355da expref: 7 pid: 6690 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789996318.487108:0:6689:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0877b7ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6689:1876946942228608:192.168.204.37@tcp:104: 00000100:00100000:0.0:1789996318.487209:0:6689:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e084892af00 going to sleep for 11 seconds 00000100:00100000:2.0:1789996318.492746:0:6689:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0877b7ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6689:1876946942228608:192.168.204.37@tcp:104: 00010000:00010000:2.0:1789996318.492776:0:6689:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c255d220/0x4173739f0fc80cbf lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789996318.493928:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996318.494109:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927527424 00000100:00100000:0.0:1789996318.494118:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927527424 00010000:00010000:0.0:1789996318.494166:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000726d4047/0x4173739f0fc80ca3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.37@tcp remote: 0x1b97003095e355da expref: 8 pid: 6690 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789996318.494202:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 44 00000100:00100000:0.0:1789996318.494212:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e084755c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+8:2363:x1876946927527424:12345-192.168.204.37@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789996318.494227:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789996318.494251:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000726d4047/0x4173739f0fc80ca3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.37@tcp remote: 0x1b97003095e355da expref: 8 pid: 6690 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996318.494263:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000726d4047/0x4173739f0fc80ca3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.37@tcp remote: 0x1b97003095e355da expref: 8 pid: 6690 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996318.494284:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000726d4047/0x4173739f0fc80ca3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.37@tcp remote: 0x1b97003095e355da expref: 8 pid: 6690 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996318.494297:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789996318.494301:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789996318.494306:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c255d220/0x4173739f0fc80cbf lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996318.494315:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c255d220/0x4173739f0fc80cbf lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996318.494342:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789996318.494403:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e084755c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+7:2363:x1876946927527424:12345-192.168.204.37@tcp:103:ldlm_bl.0 Request processed in 191us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996318.494410:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 44 00010000:00010000:0.0:1789996318.494439:0:6689:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c255d220/0x4173739f0fc80cbf lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996318.494447:0:6689:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c255d220/0x4173739f0fc80cbf lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996318.494470:0:6689:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c255d220/0x4173739f0fc80cbf lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996318.494479:0:6689:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c255d220/0x4173739f0fc80cbf lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996318.494488:0:6689:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c255d220/0x4173739f0fc80cbf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996318.494495:0:6689:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e086fcb6600 already unused, calling callback (ffffffffc1595910) 00010000:00010000:0.0:1789996318.494499:0:6689:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c255d220/0x4173739f0fc80cbf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996318.494508:0:6689:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c255d220/0x4173739f0fc80cbf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996318.494521:0:6689:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c255d220/0x4173739f0fc80cbf lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996318.494557:0:6689:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c255d220/0x4173739f0fc80cbf lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789996318.494604:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e084755df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+6:2365:x1876946927527296:12345-192.168.204.37@tcp:1:lhsmtool_posix.0 Request processed in 7656us (11279us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996318.494613:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 32 00000100:00100000:3.0:1789996318.497008:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1789996318.497078:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927527680 00000100:00100000:1.0:1789996318.497088:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927527680 00000100:00100000:1.0:1789996318.497153:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 83 00000100:00100000:1.0:1789996318.497164:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e084755f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+12:10439:x1876946927527680:12345-192.168.204.37@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1789996318.497242:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22800/0x4173739f0fc80cc6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996318.497259:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22800/0x4173739f0fc80cc6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996318.497270:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22800/0x4173739f0fc80cc6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996318.497462:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22000/0x4173739f0fc80ccd lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996318.497473:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6800/0x4173739f0fc80c80 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e355c5 expref: 13 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996318.497482:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22000/0x4173739f0fc80ccd lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996318.497512:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6800/0x4173739f0fc80c80 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e355c5 expref: 13 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996318.497577:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6800/0x4173739f0fc80c80 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e355c5 expref: 13 pid: 5847 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789996318.497592:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fad9880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5846:1876946942228736:192.168.204.37@tcp:104: 00000100:00100000:1.0:1789996318.497673:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e086fd99480 going to sleep for 11 seconds 00000100:00100000:1.0:1789996318.501796:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fad9880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5846:1876946942228736:192.168.204.37@tcp:104: 00010000:00010000:1.0:1789996318.501840:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22000/0x4173739f0fc80ccd lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789996318.507705:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1789996318.507930:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927527808 00000100:00100000:1.0:1789996318.507941:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927527808 00010000:00010000:1.0:1789996318.507997:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6800/0x4173739f0fc80c80 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e355c5 expref: 14 pid: 5847 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789996318.508038:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 45 00000100:00100000:1.0:1789996318.508049:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e084755ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+14:2363:x1876946927527808:12345-192.168.204.37@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789996318.508064:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789996318.508072:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6800/0x4173739f0fc80c80 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e355c5 expref: 14 pid: 5847 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996318.508084:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6800/0x4173739f0fc80c80 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e355c5 expref: 14 pid: 5847 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996318.508105:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6800/0x4173739f0fc80c80 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e355c5 expref: 14 pid: 5847 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996318.508334:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8e0861fcfa00) 00010000:00010000:1.0:1789996318.508342:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22000/0x4173739f0fc80ccd lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996318.508351:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22000/0x4173739f0fc80ccd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996318.508358:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22000/0x4173739f0fc80ccd lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996318.508448:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789996318.508508:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e084755ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+13:2363:x1876946927527808:12345-192.168.204.37@tcp:103:ldlm_bl.0 Request processed in 459us (811us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996318.508516:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 45 00010000:00010000:1.0:1789996318.508680:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22000/0x4173739f0fc80ccd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996318.508688:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22000/0x4173739f0fc80ccd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789996318.508878:0:5846:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:0.0:1789996318.509292:0:5846:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:0.0:1789996318.509347:0:5846:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:0.0:1789996318.509454:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0877b7ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5846:1876946942228864:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1789996318.509514:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996318.509567:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e084892a6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789996318.509680:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942228864 00000100:00100000:3.0:1789996318.509687:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942228864 00000100:00100000:3.0:1789996318.509748:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789996318.509759:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0849c75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5846:x1876946942228864:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1789996318.509879:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0849c75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5846:x1876946942228864:12345-0@lo:1000:mdt00_000.0 Request processed in 122us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996318.509897:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789996318.510057:0:5846:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:0.0:1789996318.510062:0:5846:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e0877b7d500, transno 4294967303 00000100:00100000:0.0:1789996318.510085:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0877b7ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5846:1876946942228864:0@lo:1000:mdt00_000.0 00000001:00080000:0.0:1789996318.510758:0:5846:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:0.0:1789996318.510827:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0877b7d500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5846:1876946942228992:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1789996318.510865:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996318.510889:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e084892a780 going to sleep for 11 seconds 00000100:00100000:3.0:1789996318.511059:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942228992 00000100:00100000:3.0:1789996318.511065:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942228992 00000100:00100000:3.0:1789996318.511106:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789996318.511114:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0877b7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5846:x1876946942228992:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1789996318.511278:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0877b7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5846:x1876946942228992:12345-0@lo:1000:mdt00_000.0 Request processed in 165us (411us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1789996318.511285:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789996318.511482:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0877b7d500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5846:1876946942228992:0@lo:1000:mdt00_000.0 00010000:00010000:1.0:1789996318.511513:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22000/0x4173739f0fc80ccd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996318.511523:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22000/0x4173739f0fc80ccd lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996318.511531:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22000/0x4173739f0fc80ccd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996318.511536:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0876a22000 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:1.0:1789996318.511573:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22000/0x4173739f0fc80ccd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996318.511592:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22000/0x4173739f0fc80ccd lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996318.511606:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8e0861fcfa00) 00010000:00010000:1.0:1789996318.511609:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789996318.511614:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22000/0x4173739f0fc80ccd lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996318.511631:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22000/0x4173739f0fc80ccd lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996318.511667:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23400/0x4173739f0fc80bfb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996318.511673:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23400/0x4173739f0fc80bfb lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996318.511679:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23400/0x4173739f0fc80bfb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996318.511684:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0876a23400 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:1.0:1789996318.511686:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23400/0x4173739f0fc80bfb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996318.511691:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23400/0x4173739f0fc80bfb lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996318.511699:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e0861fcf900) 00010000:00010000:1.0:1789996318.511701:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789996318.511705:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23400/0x4173739f0fc80bfb lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996318.511721:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23400/0x4173739f0fc80bfb lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996318.511742:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22e00/0x4173739f0fc80cd4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996318.511755:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5800/0x4173739f0fc80c17 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e355a9 expref: 16 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996318.511763:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22e00/0x4173739f0fc80cd4 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996318.511788:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5800/0x4173739f0fc80c17 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e355a9 expref: 16 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996318.511801:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5800/0x4173739f0fc80c17 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e355a9 expref: 16 pid: 5846 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789996318.511822:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fad9880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5846:1876946942229120:192.168.204.37@tcp:104: 00000100:00100000:1.0:1789996318.511892:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e086fd99e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789996318.513591:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1789996318.513632:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1789996318.513660:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1789996318.513686:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927528192 00000100:00100000:3.0:1789996318.513695:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927528192 00000100:00100000:0.0:1789996318.513715:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927528064 00000100:00100000:0.0:1789996318.513726:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927528064 00000100:00100000:3.0:1789996318.513779:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 124 00000100:00100000:0.0:1789996318.513782:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 69 00000100:00100000:3.0:1789996318.513794:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e084755ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cfc759a1-09a6-40ba-80a8-7399de51b555+5:2363:x1876946927528192:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:0.0:1789996318.513803:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e084755e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+7:2362:x1876946927528064:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:1.0:1789996318.514043:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927527936 00000100:00100000:1.0:1789996318.514048:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927527936 00000100:00100000:1.0:1789996318.514078:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 282 00000100:00100000:1.0:1789996318.514086:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852ba0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f78f7903-47ba-48a7-bb82-1f616cb85fc0+13:2363:x1876946927527936:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:0.0:1789996318.514200:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e084755e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+7:2362:x1876946927528064:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 401us (538us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996318.514208:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 69 00000100:00100000:3.0:1789996318.518082:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e084755ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cfc759a1-09a6-40ba-80a8-7399de51b555+5:2363:x1876946927528192:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 4283us (4441us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996318.518095:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 124 00000100:00080000:3.0:1789996318.518139:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789996318.518145:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789996318.520090:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852ba0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f78f7903-47ba-48a7-bb82-1f616cb85fc0+13:2363:x1876946927527936:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 5994us (6495us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996318.520103:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 282 00000100:00100000:3.0:1789996318.520839:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996318.521085:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fad9880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5846:1876946942229120:192.168.204.37@tcp:104: 00010000:00010000:2.0:1789996318.521111:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22e00/0x4173739f0fc80cd4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789996318.522951:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927528320 00000100:00100000:0.0:1789996318.523193:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927528320 00010000:00010000:0.0:1789996318.523236:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5800/0x4173739f0fc80c17 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e355a9 expref: 17 pid: 5846 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789996318.523323:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 46 00000100:00100000:0.0:1789996318.523333:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e084755d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+17:2363:x1876946927528320:12345-192.168.204.37@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789996318.523348:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789996318.523356:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5800/0x4173739f0fc80c17 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e355a9 expref: 17 pid: 5846 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996318.523368:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5800/0x4173739f0fc80c17 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e355a9 expref: 17 pid: 5846 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996318.523389:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5800/0x4173739f0fc80c17 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e355a9 expref: 17 pid: 5846 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996318.523403:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e0861fcf900) 00010000:00010000:0.0:1789996318.523408:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22e00/0x4173739f0fc80cd4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996318.523418:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22e00/0x4173739f0fc80cd4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996318.523439:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22e00/0x4173739f0fc80cd4 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996318.523473:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789996318.523519:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e084755d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+16:2363:x1876946927528320:12345-192.168.204.37@tcp:103:ldlm_bl.0 Request processed in 187us (2691us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996318.523527:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 46 00010000:00010000:1.0:1789996318.523658:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22e00/0x4173739f0fc80cd4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996318.523667:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22e00/0x4173739f0fc80cd4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996318.523684:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22e00/0x4173739f0fc80cd4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996318.523690:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22e00/0x4173739f0fc80cd4 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996318.523696:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22e00/0x4173739f0fc80cd4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996318.523703:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0876a22e00 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:1.0:1789996318.523707:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22e00/0x4173739f0fc80cd4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996318.523713:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22e00/0x4173739f0fc80cd4 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996318.523721:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e0861fcf900) 00010000:00010000:1.0:1789996318.523724:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789996318.523727:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22e00/0x4173739f0fc80cd4 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996318.523734:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22e00/0x4173739f0fc80cd4 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996318.523744:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22800/0x4173739f0fc80cc6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996318.523760:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22800/0x4173739f0fc80cc6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996318.523766:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22800/0x4173739f0fc80cc6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996318.523771:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0876a22800 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:1.0:1789996318.523774:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22800/0x4173739f0fc80cc6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996318.523780:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22800/0x4173739f0fc80cc6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996318.523788:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e0861fcf900) 00010000:00010000:1.0:1789996318.523790:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789996318.523793:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22800/0x4173739f0fc80cc6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996318.523797:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22800/0x4173739f0fc80cc6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789996318.525071:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e084755f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+15:10439:x1876946927527680:12345-192.168.204.37@tcp:57:lhsmtool_posix.0 Request processed in 27903us (28065us total) trans 4294967360 rc 0/0 00000100:00100000:1.0:1789996318.525082:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 83 00000020:00080000:1.0:1789996318.525086:0:5846:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1789996318.527097:0:11698:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789996318.527105:0:11698:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789996318.527139:0:11698:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1789996318.527146:0:11698:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789996318.529130:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996318.529169:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927528576 00000100:00100000:0.0:1789996318.529178:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927528576 00000100:00100000:0.0:1789996318.529228:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 20 00000100:00100000:0.0:1789996318.529238:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0876618380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+15:10439:x1876946927528576:12345-192.168.204.37@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1789996318.531273:0:5849:0:(mdd_object.c:4178:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1789996318.531388:0:5849:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:0.0:1789996318.531448:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6400/0x4173739f0fc80cdb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996318.531466:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6400/0x4173739f0fc80cdb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996318.531477:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6400/0x4173739f0fc80cdb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996318.531485:0:5849:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6400/0x4173739f0fc80cdb lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996318.531491:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6400/0x4173739f0fc80cdb lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996318.531497:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6400/0x4173739f0fc80cdb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996318.531525:0:5849:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789996318.532555:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0876618380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+17:10439:x1876946927528576:12345-192.168.204.37@tcp:35:lhsmtool_posix.0 Request processed in 3296us (3410us total) trans 4294967362 rc 0/0 00000100:00100000:0.0:1789996318.532568:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 20 00000020:00080000:0.0:1789996318.532575:0:5849:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789996318.532606:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789996318.532612:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6400/0x4173739f0fc80cdb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996318.532632:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e086fcb6400 already unused, calling callback (ffffffffc1595910) 00010000:00010000:0.0:1789996318.532636:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6400/0x4173739f0fc80cdb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996318.532645:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6400/0x4173739f0fc80cdb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996318.532663:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8e0850c28b00) 00010000:00010000:0.0:1789996318.532667:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789996318.532672:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6400/0x4173739f0fc80cdb lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996318.532678:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6400/0x4173739f0fc80cdb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996318.532693:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789996318.532695:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789996318.532696:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789996318.697382:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fad8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e0c28cd8-555e-481f-bd03-c3b02aee51c5:3316:1876946942229248:0@lo:400:kworker.0 00000100:00100000:3.0:1789996318.697460:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789996318.697525:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789996318.697532:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fad9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3316:1876946942229632:0@lo:400:kworker.0 00000100:00100000:3.0:1789996318.697585:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789996318.697629:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fad9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3314:1876946942229504:0@lo:400:kworker.0 00000100:00100000:3.0:1789996318.697652:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789996318.697672:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789996318.697678:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fada300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876946942229376:0@lo:400:kworker.0 00000100:00100000:3.0:1789996318.697700:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789996318.697746:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942229632 00000100:00100000:3.0:1789996318.697754:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942229632 00000100:00100000:3.0:1789996318.697804:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942229504 00000100:00100000:3.0:1789996318.697817:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942229504 00000100:00100000:3.0:1789996318.697835:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942229376 00000100:00100000:3.0:1789996318.697838:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942229376 00000100:00100000:3.0:1789996318.697854:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1789996318.697875:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0876a04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1876946942229632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789996318.697933:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0876a04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1876946942229632:12345-0@lo:400:kworker.0 Request processed in 60us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996318.697941:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1789996318.698253:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1789996318.698262:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0876a06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876946942229504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789996318.698302:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0876a06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876946942229504:12345-0@lo:400:kworker.0 Request processed in 42us (649us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996318.698308:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1789996318.698321:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1789996318.698327:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0876a04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876946942229376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789996318.698356:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0876a04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876946942229376:12345-0@lo:400:kworker.0 Request processed in 29us (655us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996318.698362:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00080000:3.0:1789996318.698384:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789996318.698423:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fada300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876946942229376:0@lo:400:kworker.0 00000100:00100000:3.0:1789996318.698436:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fad9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3314:1876946942229504:0@lo:400:kworker.0 00000100:00100000:3.0:1789996318.698468:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fad9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3316:1876946942229632:0@lo:400:kworker.0 00000100:00100000:1.0:1789996318.698653:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942229248 00000100:00100000:1.0:1789996318.698659:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942229248 00000100:00100000:1.0:1789996318.698686:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:1.0:1789996318.698694:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852ba3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0c28cd8-555e-481f-bd03-c3b02aee51c5+19:3316:x1876946942229248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789996318.698767:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852ba3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0c28cd8-555e-481f-bd03-c3b02aee51c5+19:3316:x1876946942229248:12345-0@lo:400:kworker.0 Request processed in 74us (1306us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996318.698774:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:0.0:1789996318.699085:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fad8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e0c28cd8-555e-481f-bd03-c3b02aee51c5:3316:1876946942229248:0@lo:400:kworker.0 00000040:00080000:2.0:1789996318.963893:0:12017:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789996318.963904:0:12017:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789996318.963940:0:12017:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1789996318.963947:0:12017:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1789996319.081069:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789996319.102090:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996319.102167:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927528832 00000100:00100000:2.0:1789996319.102177:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927528832 00000100:00100000:2.0:1789996319.102258:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 84 00000100:00100000:2.0:1789996319.102270:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fadb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+17:10455:x1876946927528832:12345-192.168.204.37@tcp:101:lfs.0 00010000:00010000:2.0:1789996319.102295:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789996319.102324:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4800/0x4173739f0fc80ce2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b97003095e355e1 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996319.102423:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5800/0x4173739f0fc80ce9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996319.102438:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5800/0x4173739f0fc80ce9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996319.102449:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5800/0x4173739f0fc80ce9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789996319.102460:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000100:00080000:0.0:1789996319.103059:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789996319.103829:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4800/0x4173739f0fc80ce2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e355e1 expref: 20 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996319.104093:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5800/0x4173739f0fc80ce9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e355e1 expref: 19 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996319.104103:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e084601b700) 00010000:00010000:2.0:1789996319.104107:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789996319.104110:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e0842de5800, rc 0) 00000100:00100000:2.0:1789996319.104177:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fadb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+19:10455:x1876946927528832:12345-192.168.204.37@tcp:101:lfs.0 Request processed in 1910us (2098us total) trans 4294967363 rc 0/0 00000100:00100000:2.0:1789996319.104185:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 84 00000100:00100000:2.0:1789996319.110061:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1789996319.110673:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927528960 00000100:00100000:1.0:1789996319.110685:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927528960 00000100:00100000:1.0:1789996319.110755:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 85 00000100:00100000:1.0:1789996319.110766:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086d7f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+19:10455:x1876946927528960:12345-192.168.204.37@tcp:34:lfs.0 00010000:00010000:1.0:1789996319.110868:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23400/0x4173739f0fc80cf7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996319.110888:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23400/0x4173739f0fc80cf7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996319.110902:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23400/0x4173739f0fc80cf7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996319.110918:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22000/0x4173739f0fc80cfe lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996319.110925:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22000/0x4173739f0fc80cfe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996319.110932:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22000/0x4173739f0fc80cfe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996319.111181:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22c00/0x4173739f0fc80d05 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996319.111190:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22c00/0x4173739f0fc80d05 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996319.111205:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22c00/0x4173739f0fc80d05 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789996319.111247:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22c00/0x4173739f0fc80d05 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996319.111260:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23400/0x4173739f0fc80cf7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996319.111267:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23400/0x4173739f0fc80cf7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996319.111275:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23400/0x4173739f0fc80cf7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996319.111281:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0876a23400 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:1.0:1789996319.111286:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23400/0x4173739f0fc80cf7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996319.111293:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23400/0x4173739f0fc80cf7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996319.111304:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e084601b700) 00010000:00010000:1.0:1789996319.111307:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789996319.111312:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23400/0x4173739f0fc80cf7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996319.111318:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23400/0x4173739f0fc80cf7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996319.111328:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22000/0x4173739f0fc80cfe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996319.111340:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22000/0x4173739f0fc80cfe lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996319.111346:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22000/0x4173739f0fc80cfe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996319.111351:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0876a22000 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:1.0:1789996319.111354:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22000/0x4173739f0fc80cfe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996319.111361:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22000/0x4173739f0fc80cfe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996319.111368:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8e0861fcfa00) 00010000:00010000:1.0:1789996319.111370:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789996319.111373:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22000/0x4173739f0fc80cfe lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996319.111379:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22000/0x4173739f0fc80cfe lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996319.111393:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22c00/0x4173739f0fc80d05 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996319.111399:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22c00/0x4173739f0fc80d05 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996319.111405:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22c00/0x4173739f0fc80d05 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996319.111410:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0876a22c00 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:1.0:1789996319.111418:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22c00/0x4173739f0fc80d05 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996319.111424:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22c00/0x4173739f0fc80d05 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996319.111432:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e0861fcfd00) 00010000:00010000:1.0:1789996319.111434:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789996319.111437:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22c00/0x4173739f0fc80d05 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996319.111443:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22c00/0x4173739f0fc80d05 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789996319.111525:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086d7f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+19:10455:x1876946927528960:12345-192.168.204.37@tcp:34:lfs.0 Request processed in 759us (1472us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996319.111533:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 85 00000100:00100000:2.0:1789996319.181724:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1789996319.182592:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927529216 00000100:00100000:1.0:1789996319.182762:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927529216 00000100:00100000:1.0:1789996319.183407:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 86 00000100:00100000:1.0:1789996319.183419:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086d7f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+19:10458:x1876946927529216:12345-192.168.204.37@tcp:101:lfs.0 00010000:00010000:1.0:1789996319.183439:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789996319.183471:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22c00/0x4173739f0fc80d0c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b97003095e355e8 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996319.183562:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22000/0x4173739f0fc80d13 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996319.183576:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22000/0x4173739f0fc80d13 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996319.183598:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22000/0x4173739f0fc80d13 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996319.183917:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23400/0x4173739f0fc80d1a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996319.183925:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23400/0x4173739f0fc80d1a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996319.183932:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23400/0x4173739f0fc80d1a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996319.184232:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22600/0x4173739f0fc80d21 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996319.184241:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22600/0x4173739f0fc80d21 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996319.184249:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22600/0x4173739f0fc80d21 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789996319.184259:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:1.0:1789996319.184342:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22000/0x4173739f0fc80d13 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996319.184349:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22000/0x4173739f0fc80d13 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996319.184356:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22000/0x4173739f0fc80d13 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996319.184362:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0876a22000 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:1.0:1789996319.184372:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22000/0x4173739f0fc80d13 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996319.184380:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22000/0x4173739f0fc80d13 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996319.184392:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e084601b700) 00010000:00010000:1.0:1789996319.184395:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789996319.184401:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22000/0x4173739f0fc80d13 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996319.184408:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22000/0x4173739f0fc80d13 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996319.184418:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23400/0x4173739f0fc80d1a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996319.184424:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23400/0x4173739f0fc80d1a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996319.184429:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23400/0x4173739f0fc80d1a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996319.184433:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0876a23400 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:1.0:1789996319.184436:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23400/0x4173739f0fc80d1a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996319.184440:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23400/0x4173739f0fc80d1a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996319.184446:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8e0861fcfd00) 00010000:00010000:1.0:1789996319.184448:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789996319.184456:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23400/0x4173739f0fc80d1a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996319.186123:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23400/0x4173739f0fc80d1a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996319.186194:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22c00/0x4173739f0fc80d0c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e355e8 expref: 22 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996319.186210:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22600/0x4173739f0fc80d21 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e355e8 expref: 21 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996319.186219:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e0861fcfa00) 00010000:00010000:1.0:1789996319.186693:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789996319.187130:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e0876a22600, rc 0) 00000100:00100000:1.0:1789996319.187207:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086d7f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+21:10458:x1876946927529216:12345-192.168.204.37@tcp:101:lfs.0 Request processed in 3787us (5487us total) trans 4294967364 rc 0/0 00000100:00100000:1.0:1789996319.187216:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 86 00000100:00100000:1.0:1789996319.198434:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1789996319.199921:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927529344 00000100:00100000:1.0:1789996319.199940:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927529344 00000100:00100000:1.0:1789996319.200720:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 87 00000100:00100000:1.0:1789996319.200732:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fad8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+21:10458:x1876946927529344:12345-192.168.204.37@tcp:54:lfs.0 00010000:00010000:1.0:1789996319.200811:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22e00/0x4173739f0fc80d2f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996319.200829:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22e00/0x4173739f0fc80d2f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996319.200840:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22e00/0x4173739f0fc80d2f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996319.201202:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22e00/0x4173739f0fc80d2f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996319.201210:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22e00/0x4173739f0fc80d2f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996319.201217:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22e00/0x4173739f0fc80d2f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996319.201223:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0876a22e00 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:1.0:1789996319.201226:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22e00/0x4173739f0fc80d2f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996319.201234:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22e00/0x4173739f0fc80d2f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996319.201245:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e0861fcfa00) 00010000:00010000:1.0:1789996319.201248:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789996319.201254:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22e00/0x4173739f0fc80d2f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996319.201260:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22e00/0x4173739f0fc80d2f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789996319.201346:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fad8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+21:10458:x1876946927529344:12345-192.168.204.37@tcp:54:lfs.0 Request processed in 616us (2921us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996319.201354:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 87 00000100:00100000:3.0:1789996319.215433:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0876618e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876946942229760:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789996319.215530:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996319.216259:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942229760 00000100:00100000:1.0:1789996319.216271:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942229760 00000100:00100000:1.0:1789996319.216327:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789996319.216344:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fabd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3316:x1876946942229760:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789996319.216367:0:6691:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3856662528 00000100:00100000:1.0:1789996319.216842:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fabd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3316:x1876946942229760:12345-0@lo:13:osp-pre-1-0.0 Request processed in 498us (1310us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996319.216850:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789996319.216916:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0876618e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876946942229760:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789996319.231612:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1789996319.232617:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927529600 00000100:00100000:3.0:1789996319.232629:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927529600 00000100:00100000:3.0:1789996319.232693:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 21 00000100:00100000:3.0:1789996319.232704:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0850a22450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+21:10458:x1876946927529600:12345-192.168.204.37@tcp:35:lfs.0 00000100:00100000:3.0:1789996319.232935:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0850a22450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+22:10458:x1876946927529600:12345-192.168.204.37@tcp:35:lfs.0 Request processed in 233us (1331us total) trans 4294967365 rc 0/0 00000100:00100000:3.0:1789996319.232944:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 21 00000100:00100000:1.0:1789996319.278338:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996319.278451:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927529856 00000100:00100000:2.0:1789996319.278475:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927529856 00000100:00100000:2.0:1789996319.278586:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 88 00000100:00100000:2.0:1789996319.278598:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fadbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+22:9986:x1876946927529856:12345-192.168.204.37@tcp:101:bash.0 00010000:00010000:2.0:1789996319.278623:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789996319.278644:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4800/0x4173739f0fc80d36 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b97003095e355ef expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996319.278746:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5a00/0x4173739f0fc80d3d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996319.278763:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22600/0x4173739f0fc80d21 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e355e8 expref: 23 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996319.278772:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5a00/0x4173739f0fc80d3d lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996319.278824:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22600/0x4173739f0fc80d21 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e355e8 expref: 23 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996319.278837:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22600/0x4173739f0fc80d21 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e355e8 expref: 23 pid: 5848 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789996319.278850:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086d7f3800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5847:1876946942229888:192.168.204.37@tcp:104: 00000100:00100000:2.0:1789996319.278952:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0847518600 going to sleep for 11 seconds 00000100:00100000:3.0:1789996319.303391:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996319.303594:0:8520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927529984 00000100:00100000:0.0:1789996319.303605:0:8520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927529984 00010000:00010000:0.0:1789996319.303650:0:8520:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22600/0x4173739f0fc80d21 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e355e8 expref: 24 pid: 5848 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789996319.303686:0:8520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 47 00000100:00100000:0.0:1789996319.303697:0:8520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fabed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+24:2362:x1876946927529984:12345-192.168.204.37@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789996319.303713:0:8520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789996319.303720:0:8520:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22600/0x4173739f0fc80d21 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e355e8 expref: 24 pid: 5848 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996319.303733:0:8520:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22600/0x4173739f0fc80d21 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e355e8 expref: 24 pid: 5848 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996319.303758:0:8520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e0861fcfa00) 00010000:00010000:0.0:1789996319.303764:0:8520:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5a00/0x4173739f0fc80d3d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996319.303774:0:8520:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5a00/0x4173739f0fc80d3d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996319.303783:0:8520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5a00/0x4173739f0fc80d3d lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996319.303815:0:8520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789996319.303880:0:8520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fabed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+24:2362:x1876946927529984:12345-192.168.204.37@tcp:103:ldlm_bl.0 Request processed in 184us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996319.303888:0:8520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 47 00010000:00010000:2.0:1789996319.304044:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22600/0x4173739f0fc80d21 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e355e8 expref: 23 pid: 5848 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789996319.304062:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086d7f3800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5847:1876946942229888:192.168.204.37@tcp:104: 00010000:00010000:2.0:1789996319.304083:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5a00/0x4173739f0fc80d3d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996319.304102:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5a00/0x4173739f0fc80d3d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996319.304109:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5a00/0x4173739f0fc80d3d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789996319.304127:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:2.0:1789996319.304269:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4800/0x4173739f0fc80d36 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e355ef expref: 24 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996319.304285:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5a00/0x4173739f0fc80d3d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e355ef expref: 23 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996319.304292:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e0861fcfa00) 00010000:00010000:2.0:1789996319.304295:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789996319.304298:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e0842de5a00, rc 0) 00000100:00100000:2.0:1789996319.304342:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fadbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+23:9986:x1876946927529856:12345-192.168.204.37@tcp:101:bash.0 Request processed in 25746us (26013us total) trans 4294967366 rc 0/0 00000100:00100000:2.0:1789996319.304349:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 88 00000100:00100000:3.0:1789996319.309433:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1789996319.309593:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927530240 00000100:00100000:1.0:1789996319.309605:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927530240 00000100:00100000:1.0:1789996319.309676:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 89 00000100:00100000:1.0:1789996319.309687:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fabdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+23:9986:x1876946927530240:12345-192.168.204.37@tcp:36:bash.0 00010000:00010000:1.0:1789996319.309990:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22e00/0x4173739f0fc80d4b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996319.310007:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22e00/0x4173739f0fc80d4b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996319.310017:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22e00/0x4173739f0fc80d4b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789996319.310067:0:5846:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:1.0:1789996319.310092:0:5846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ec5fed17 reply state 000000009b7f1b72 transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22e00/0x4173739f0fc80d4b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789996319.310100:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1789996319.310147:0:5846:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:1.0:1789996319.310257:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fabdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+27:9986:x1876946927530240:12345-192.168.204.37@tcp:36:bash.0 Request processed in 571us (832us total) trans 4294967369 rc 0/0 00000100:00100000:1.0:1789996319.310264:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 89 00000020:00080000:1.0:1789996319.310269:0:5846:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:1.0:1789996319.315639:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22e00/0x4173739f0fc80d4b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996319.315659:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22e00/0x4173739f0fc80d4b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996319.315667:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22e00/0x4173739f0fc80d4b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996319.315673:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0876a22e00 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:1.0:1789996319.315678:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22e00/0x4173739f0fc80d4b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996319.315686:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22e00/0x4173739f0fc80d4b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996319.315704:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e0861fcfa00) 00010000:00010000:1.0:1789996319.315708:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789996319.315713:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22e00/0x4173739f0fc80d4b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996319.315719:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22e00/0x4173739f0fc80d4b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789996319.317164:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1789996319.317228:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927530368 00000100:00100000:1.0:1789996319.317240:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927530368 00000100:00100000:1.0:1789996319.317301:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 90 00000100:00100000:1.0:1789996319.317311:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fabc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+26:9986:x1876946927530368:12345-192.168.204.37@tcp:101:bash.0 00010000:00010000:1.0:1789996319.317334:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789996319.317354:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22c00/0x4173739f0fc80d52 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b97003095e355f6 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996319.317441:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22c00/0x4173739f0fc80d52 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e355f6 expref: 27 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996319.319726:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22c00/0x4173739f0fc80d52 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e355f6 expref: 27 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996319.319783:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e0861fcfa00) 00010000:00010000:1.0:1789996319.319786:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789996319.319790:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e0876a22c00, rc 0) 00000100:00100000:1.0:1789996319.319887:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fabc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+27:9986:x1876946927530368:12345-192.168.204.37@tcp:101:bash.0 Request processed in 2573us (2728us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996319.319896:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 90 00000100:00100000:2.0:1789996319.323401:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996319.323499:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927530496 00000100:00100000:0.0:1789996319.323521:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927530496 00000100:00100000:0.0:1789996319.323610:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 33 00000100:00100000:0.0:1789996319.323621:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086d7f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+6:9986:x1876946927530496:12345-192.168.204.37@tcp:101:bash.0 00010000:00010000:0.0:1789996319.323638:0:6690:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789996319.323661:0:6690:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000359ca922/0x4173739f0fc80d59 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1b97003095e355fd expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789996319.323688:0:6690:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6ab12d1e, atime: 0x6ab12d1d, ctime: 0x6ab12d1e, blocks: 0xb 00010000:00010000:0.0:1789996319.323710:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=361s v=(0 0) 00010000:00010000:0.0:1789996319.323715:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789996319.323723:0:6690:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000359ca922/0x4173739f0fc80d59 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e355fd expref: 7 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996319.323741:0:6690:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000359ca922/0x4173739f0fc80d59 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e355fd expref: 7 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996319.323754:0:6690:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e086fcb7200, rc 0) 00000100:00100000:0.0:1789996319.323823:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086d7f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+7:9986:x1876946927530496:12345-192.168.204.37@tcp:101:bash.0 Request processed in 204us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996319.323831:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 33 00000100:00100000:3.0:1789996319.326878:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996319.326979:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927530624 00000100:00100000:2.0:1789996319.326988:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927530624 00002000:00010000:2.0:1789996319.327030:0:6693:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:2.0:1789996319.327035:0:6693:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8e086fabf800 with x1876946927530624 ext(0->18446744073709551615) 00002000:00010000:2.0:1789996319.327045:0:6693:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8e086fabf800. 00000100:00100000:2.0:1789996319.327085:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 1 00000100:00100000:2.0:1789996319.327095:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fabf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+7:2363:x1876946927530624:12345-192.168.204.37@tcp:10:bash.0 00002000:00010000:2.0:1789996319.327404:0:6693:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1789996319.327408:0:6693:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1789996318 -> 1789996319 00002000:00010000:2.0:1789996319.327410:0:6693:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 1789996317 -> 1789996317 00002000:00010000:2.0:1789996319.327412:0:6693:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1789996318 -> 1789996319 00002000:00010000:2.0:1789996319.327414:0:6693:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1789996319.327484:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fabf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+8:2363:x1876946927530624:12345-192.168.204.37@tcp:10:bash.0 Request processed in 388us (613us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1789996319.327492:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 1 00002000:00010000:2.0:1789996319.327497:0:6693:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:2.0:1789996319.327499:0:6693:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8e086fabf800 with x1876946927530624 ext(0->18446744073709551615) 00002000:00010000:2.0:1789996319.327504:0:6693:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8e086fabf800. 00000100:00100000:3.0:1789996319.419927:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1789996319.420899:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927530752 00000100:00100000:1.0:1789996319.420912:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927530752 00000100:00100000:1.0:1789996319.420976:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 91 00000100:00100000:1.0:1789996319.420986:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fabce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+27:10472:x1876946927530752:12345-192.168.204.37@tcp:34:lfs.0 00010000:00010000:1.0:1789996319.421053:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22e00/0x4173739f0fc80d60 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996319.421069:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22e00/0x4173739f0fc80d60 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996319.421079:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22e00/0x4173739f0fc80d60 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996319.421093:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23400/0x4173739f0fc80d67 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996319.421116:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23400/0x4173739f0fc80d67 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996319.421123:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23400/0x4173739f0fc80d67 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996319.421334:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22000/0x4173739f0fc80d6e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996319.421344:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22000/0x4173739f0fc80d6e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996319.421351:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22000/0x4173739f0fc80d6e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789996319.421388:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22000/0x4173739f0fc80d6e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996319.421398:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22e00/0x4173739f0fc80d60 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996319.421404:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22e00/0x4173739f0fc80d60 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996319.421410:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22e00/0x4173739f0fc80d60 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996319.421415:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0876a22e00 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:1.0:1789996319.421418:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22e00/0x4173739f0fc80d60 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996319.421426:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22e00/0x4173739f0fc80d60 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996319.421445:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e084601b700) 00010000:00010000:1.0:1789996319.421447:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789996319.421453:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22e00/0x4173739f0fc80d60 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996319.421459:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22e00/0x4173739f0fc80d60 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996319.421472:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23400/0x4173739f0fc80d67 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996319.421478:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23400/0x4173739f0fc80d67 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996319.421483:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23400/0x4173739f0fc80d67 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996319.421488:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0876a23400 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:1.0:1789996319.421491:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23400/0x4173739f0fc80d67 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996319.421496:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23400/0x4173739f0fc80d67 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996319.421503:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8e0861fcfd00) 00010000:00010000:1.0:1789996319.421505:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789996319.421508:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23400/0x4173739f0fc80d67 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996319.421514:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23400/0x4173739f0fc80d67 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996319.421538:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22000/0x4173739f0fc80d6e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996319.421590:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22000/0x4173739f0fc80d6e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996319.421596:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22000/0x4173739f0fc80d6e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996319.421601:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0876a22000 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:1.0:1789996319.421604:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22000/0x4173739f0fc80d6e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996319.421610:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22000/0x4173739f0fc80d6e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996319.421617:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e0861fcfa00) 00010000:00010000:1.0:1789996319.421620:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789996319.421623:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22000/0x4173739f0fc80d6e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996319.421630:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22000/0x4173739f0fc80d6e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789996319.421702:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fabce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+27:10472:x1876946927530752:12345-192.168.204.37@tcp:34:lfs.0 Request processed in 716us (1783us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996319.421710:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 91 00000100:00100000:0.0:1789996319.489595:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996319.489709:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927531008 00000100:00100000:2.0:1789996319.489718:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927531008 00000100:00100000:2.0:1789996319.489776:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 92 00000100:00100000:2.0:1789996319.489785:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e087661b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+27:10475:x1876946927531008:12345-192.168.204.37@tcp:101:lfs.0 00010000:00010000:2.0:1789996319.489817:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789996319.489837:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5c00/0x4173739f0fc80d75 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b97003095e35604 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996319.490027:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4e00/0x4173739f0fc80d7c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996319.490042:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4e00/0x4173739f0fc80d7c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996319.490053:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4e00/0x4173739f0fc80d7c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996319.490089:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4800/0x4173739f0fc80d83 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996319.490097:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4800/0x4173739f0fc80d83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996319.490103:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4800/0x4173739f0fc80d83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996319.490360:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4200/0x4173739f0fc80d8a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996319.490370:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4200/0x4173739f0fc80d8a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996319.490377:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4200/0x4173739f0fc80d8a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789996319.490387:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1789996319.490477:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4e00/0x4173739f0fc80d7c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996319.490485:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4e00/0x4173739f0fc80d7c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996319.490491:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4e00/0x4173739f0fc80d7c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996319.490496:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0842de4e00 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:2.0:1789996319.490500:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4e00/0x4173739f0fc80d7c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996319.490517:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4e00/0x4173739f0fc80d7c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996319.490529:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e084601b700) 00010000:00010000:2.0:1789996319.490532:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789996319.490538:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4e00/0x4173739f0fc80d7c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996319.490568:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4e00/0x4173739f0fc80d7c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996319.490581:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4800/0x4173739f0fc80d83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996319.490587:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4800/0x4173739f0fc80d83 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996319.490593:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4800/0x4173739f0fc80d83 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996319.490599:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0842de4800 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:2.0:1789996319.490602:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4800/0x4173739f0fc80d83 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996319.490608:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4800/0x4173739f0fc80d83 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996319.490615:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8e084601bf00) 00010000:00010000:2.0:1789996319.490618:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789996319.490620:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4800/0x4173739f0fc80d83 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996319.490637:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4800/0x4173739f0fc80d83 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996319.490679:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5c00/0x4173739f0fc80d75 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35604 expref: 30 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996319.494009:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4200/0x4173739f0fc80d8a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35604 expref: 29 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996319.494024:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e0861fcfa00) 00010000:00010000:2.0:1789996319.494027:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789996319.494030:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e0842de4200, rc 0) 00000100:00100000:2.0:1789996319.494115:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e087661b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+29:10475:x1876946927531008:12345-192.168.204.37@tcp:101:lfs.0 Request processed in 4330us (4528us total) trans 4294967370 rc 0/0 00000100:00100000:2.0:1789996319.494126:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 92 00000100:00100000:3.0:1789996319.499269:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1789996319.499373:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927531136 00000100:00100000:1.0:1789996319.499383:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927531136 00000100:00100000:1.0:1789996319.499450:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 93 00000100:00100000:1.0:1789996319.499475:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fabca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+29:10475:x1876946927531136:12345-192.168.204.37@tcp:54:lfs.0 00010000:00010000:1.0:1789996319.499579:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22000/0x4173739f0fc80d98 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996319.499596:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5a00/0x4173739f0fc80d3d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e355ef expref: 29 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996319.499606:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22000/0x4173739f0fc80d98 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996319.499640:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5a00/0x4173739f0fc80d3d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e355ef expref: 29 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996319.499654:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5a00/0x4173739f0fc80d3d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e355ef expref: 29 pid: 5847 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789996319.499669:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fadad80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5846:1876946942230016:192.168.204.37@tcp:104: 00000100:00100000:1.0:1789996319.499754:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e084314d300 going to sleep for 11 seconds 00000100:00100000:1.0:1789996319.503217:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fadad80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5846:1876946942230016:192.168.204.37@tcp:104: 00010000:00010000:1.0:1789996319.503252:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22000/0x4173739f0fc80d98 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789996319.503734:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996319.503867:0:11495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927531392 00000100:00100000:0.0:1789996319.503875:0:11495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927531392 00000100:00100000:0.0:1789996319.503929:0:11495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 22 00000100:00100000:0.0:1789996319.503938:0:11495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fabe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+30:5598:x1876946927531392:12345-192.168.204.37@tcp:35:ldlm_bl.0 00000001:00080000:0.0:1789996319.504192:0:11495:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967371 00000100:00100000:0.0:1789996319.504329:0:11495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fabe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+32:5598:x1876946927531392:12345-192.168.204.37@tcp:35:ldlm_bl.0 Request processed in 390us (595us total) trans 4294967372 rc 0/0 00000100:00100000:0.0:1789996319.504338:0:11495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 22 00000020:00080000:0.0:1789996319.504343:0:11495:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789996319.509265:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996319.509377:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927531520 00000100:00100000:0.0:1789996319.509388:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927531520 00010000:00010000:0.0:1789996319.509428:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5a00/0x4173739f0fc80d3d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e355ef expref: 32 pid: 5847 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789996319.509479:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 48 00000100:00100000:0.0:1789996319.509489:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fabd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+32:2362:x1876946927531520:12345-192.168.204.37@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789996319.509504:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789996319.509511:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5a00/0x4173739f0fc80d3d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e355ef expref: 32 pid: 5847 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996319.509525:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5a00/0x4173739f0fc80d3d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e355ef expref: 32 pid: 5847 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996319.509576:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5a00/0x4173739f0fc80d3d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e355ef expref: 32 pid: 5847 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996319.509594:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e0861fcfa00) 00010000:00010000:0.0:1789996319.509600:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22000/0x4173739f0fc80d98 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996319.509610:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22000/0x4173739f0fc80d98 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996319.509617:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22000/0x4173739f0fc80d98 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996319.509667:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789996319.509740:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fabd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+31:2362:x1876946927531520:12345-192.168.204.37@tcp:103:ldlm_bl.0 Request processed in 252us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996319.509749:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 48 00010000:00010000:1.0:1789996319.509833:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22000/0x4173739f0fc80d98 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996319.509853:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22000/0x4173739f0fc80d98 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996319.509884:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22000/0x4173739f0fc80d98 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996319.509899:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22000/0x4173739f0fc80d98 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996319.509905:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22000/0x4173739f0fc80d98 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996319.509911:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0876a22000 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:1.0:1789996319.509916:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22000/0x4173739f0fc80d98 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996319.509924:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22000/0x4173739f0fc80d98 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996319.509933:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e0861fcfa00) 00010000:00010000:1.0:1789996319.509936:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789996319.509940:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22000/0x4173739f0fc80d98 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996319.509946:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22000/0x4173739f0fc80d98 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789996319.509984:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fabca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+30:10475:x1876946927531136:12345-192.168.204.37@tcp:54:lfs.0 Request processed in 10513us (10724us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996319.509992:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 93 00000100:00100000:2.0:1789996319.513728:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1789996319.513829:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927531776 00000100:00100000:3.0:1789996319.513838:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927531776 00000100:00100000:3.0:1789996319.513899:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 23 00000100:00100000:3.0:1789996319.513908:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086d7f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+30:10475:x1876946927531776:12345-192.168.204.37@tcp:35:lfs.0 00000100:00100000:3.0:1789996319.514143:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086d7f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+31:10475:x1876946927531776:12345-192.168.204.37@tcp:35:lfs.0 Request processed in 235us (422us total) trans 4294967373 rc 0/0 00000100:00100000:3.0:1789996319.514151:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 23 00000100:00100000:3.0:1789996319.644244:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1789996319.644703:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927532032 00000100:00100000:1.0:1789996319.644713:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927532032 00000100:00100000:1.0:1789996319.644780:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 94 00000100:00100000:1.0:1789996319.644802:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fabc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+31:10486:x1876946927532032:12345-192.168.204.37@tcp:101:cat.0 00010000:00010000:1.0:1789996319.644826:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789996319.644984:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22000/0x4173739f0fc80d9f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b97003095e3560b expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996319.645061:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23400/0x4173739f0fc80da6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996319.645075:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23400/0x4173739f0fc80da6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996319.645088:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23400/0x4173739f0fc80da6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996319.645102:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22e00/0x4173739f0fc80dad lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996319.645109:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22e00/0x4173739f0fc80dad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996319.645115:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22e00/0x4173739f0fc80dad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996319.645361:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22a00/0x4173739f0fc80db4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996319.645370:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22a00/0x4173739f0fc80db4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996319.645377:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22a00/0x4173739f0fc80db4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789996319.645387:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:1.0:1789996319.645935:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23400/0x4173739f0fc80da6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996319.645953:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23400/0x4173739f0fc80da6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996319.645960:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23400/0x4173739f0fc80da6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996319.645966:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0876a23400 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:1.0:1789996319.645971:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23400/0x4173739f0fc80da6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996319.645979:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23400/0x4173739f0fc80da6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996319.645991:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e084601b700) 00010000:00010000:1.0:1789996319.645994:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789996319.645999:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23400/0x4173739f0fc80da6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996319.646006:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23400/0x4173739f0fc80da6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996319.646020:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22e00/0x4173739f0fc80dad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996319.646026:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22e00/0x4173739f0fc80dad lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996319.646032:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22e00/0x4173739f0fc80dad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996319.646037:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0876a22e00 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:1.0:1789996319.646047:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22e00/0x4173739f0fc80dad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996319.646054:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22e00/0x4173739f0fc80dad lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996319.646062:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8e0861fcfd00) 00010000:00010000:1.0:1789996319.646065:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789996319.646068:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22e00/0x4173739f0fc80dad lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996319.646074:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22e00/0x4173739f0fc80dad lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996319.646121:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22000/0x4173739f0fc80d9f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e3560b expref: 34 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996319.646134:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22a00/0x4173739f0fc80db4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e3560b expref: 33 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996319.646142:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e0861fcfa00) 00010000:00010000:1.0:1789996319.646145:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789996319.646147:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e0876a22a00, rc 0) 00000100:00100000:1.0:1789996319.646273:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fabc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+33:10486:x1876946927532032:12345-192.168.204.37@tcp:101:cat.0 Request processed in 1484us (2037us total) trans 4294967374 rc 0/0 00000100:00100000:1.0:1789996319.646281:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 94 00000100:00100000:2.0:1789996319.663611:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996319.663833:0:11495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927532288 00000100:00100000:0.0:1789996319.663853:0:11495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927532288 00000100:00100000:0.0:1789996319.663909:0:11495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 24 00000100:00100000:0.0:1789996319.663920:0:11495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086d7f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+33:10486:x1876946927532288:12345-192.168.204.37@tcp:35:cat.0 00000100:00100000:0.0:1789996319.664166:0:11495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086d7f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+34:10486:x1876946927532288:12345-192.168.204.37@tcp:35:cat.0 Request processed in 248us (564us total) trans 4294967375 rc 0/0 00000100:00100000:0.0:1789996319.664173:0:11495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 24 00000100:00100000:2.0:1789996319.706732:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1789996319.707058:0:9163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927532544 00000100:00100000:3.0:1789996319.707069:0:9163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927532544 00000100:00100000:3.0:1789996319.707182:0:9163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 95 00000100:00100000:3.0:1789996319.707193:0:9163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086d7f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+34:10487:x1876946927532544:12345-192.168.204.37@tcp:36:rm.0 00010000:00010000:3.0:1789996319.707271:0:9163:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1789996319.707298:0:9163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22a00/0x4173739f0fc80db4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e3560b expref: 34 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996319.707322:0:9163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4200/0x4173739f0fc80d8a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35604 expref: 33 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996319.707335:0:9163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22c00/0x4173739f0fc80d52 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e355f6 expref: 32 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996319.707346:0:9163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e0861fcfa00) 00010000:00010000:3.0:1789996319.707359:0:9163:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789996319.707381:0:9163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857200/0x4173739f0fc80dc2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996319.707394:0:9163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857200/0x4173739f0fc80dc2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996319.707404:0:9163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857200/0x4173739f0fc80dc2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996319.707436:0:9163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857600/0x4173739f0fc80dc9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996319.707445:0:9163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857600/0x4173739f0fc80dc9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996319.707452:0:9163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857600/0x4173739f0fc80dc9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996319.707742:0:9163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857000/0x4173739f0fc80dd0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996319.707751:0:9163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857000/0x4173739f0fc80dd0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996319.707759:0:9163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857000/0x4173739f0fc80dd0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789996319.708350:0:9163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00000004:00080000:3.0:1789996319.708361:0:9163:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 361427817282ns, next at 362427814768ns, rc = 0 00010000:00010000:3.0:1789996319.708418:0:9163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856e00/0x4173739f0fc80dd7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996319.708429:0:9163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856e00/0x4173739f0fc80dd7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996319.708437:0:9163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856e00/0x4173739f0fc80dd7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996319.708444:0:9163:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856e00/0x4173739f0fc80dd7 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996319.708460:0:9163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856e00/0x4173739f0fc80dd7 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996319.708465:0:9163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856e00/0x4173739f0fc80dd7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996319.708478:0:9163:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789996319.708496:0:9163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857000/0x4173739f0fc80dd0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996319.708502:0:9163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857000/0x4173739f0fc80dd0 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996319.708507:0:9163:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857000/0x4173739f0fc80dd0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996319.708513:0:9163:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e087f857000 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:3.0:1789996319.708517:0:9163:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857000/0x4173739f0fc80dd0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996319.708524:0:9163:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857000/0x4173739f0fc80dd0 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996319.708533:0:9163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e0846583300) 00010000:00010000:3.0:1789996319.708536:0:9163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1789996319.708539:0:9163:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857000/0x4173739f0fc80dd0 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996319.708574:0:9163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857000/0x4173739f0fc80dd0 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996319.708590:0:9163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857200/0x4173739f0fc80dc2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996319.708602:0:9163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857200/0x4173739f0fc80dc2 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996319.708608:0:9163:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857200/0x4173739f0fc80dc2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996319.708613:0:9163:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e087f857200 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:3.0:1789996319.708616:0:9163:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857200/0x4173739f0fc80dc2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996319.708622:0:9163:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857200/0x4173739f0fc80dc2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996319.708631:0:9163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e084601b700) 00010000:00010000:3.0:1789996319.708634:0:9163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789996319.708637:0:9163:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857200/0x4173739f0fc80dc2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996319.708643:0:9163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857200/0x4173739f0fc80dc2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789996319.708654:0:9163:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e9c0dc96 reply state 00000000f2429080 transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857600/0x4173739f0fc80dc9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789996319.708663:0:9163:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789996319.708737:0:9163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086d7f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+33:10487:x1876946927532544:12345-192.168.204.37@tcp:36:rm.0 Request processed in 1545us (2014us total) trans 4294967376 rc 0/0 00000100:00100000:3.0:1789996319.708746:0:9163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 95 00010000:00010000:0.0:1789996319.708841:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789996319.708848:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856e00/0x4173739f0fc80dd7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996319.708855:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e087f856e00 already unused, calling callback (ffffffffc1595910) 00010000:00010000:0.0:1789996319.708858:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856e00/0x4173739f0fc80dd7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996319.708865:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856e00/0x4173739f0fc80dd7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996319.708874:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e0846583300) 00010000:00010000:0.0:1789996319.708876:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789996319.708880:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856e00/0x4173739f0fc80dd7 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996319.708886:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856e00/0x4173739f0fc80dd7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996319.708909:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789996319.708911:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789996319.708912:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789996319.711177:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857600/0x4173739f0fc80dc9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996319.711195:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857600/0x4173739f0fc80dc9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996319.711202:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857600/0x4173739f0fc80dc9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996319.711208:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e087f857600 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:2.0:1789996319.711226:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857600/0x4173739f0fc80dc9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996319.711233:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857600/0x4173739f0fc80dc9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996319.711248:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8e0846583100) 00010000:00010000:2.0:1789996319.711251:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789996319.711256:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857600/0x4173739f0fc80dc9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996319.711262:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857600/0x4173739f0fc80dc9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789996319.746498:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1789996319.746607:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927532800 00000100:00100000:3.0:1789996319.746617:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927532800 00000100:00100000:3.0:1789996319.746709:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 96 00000100:00100000:3.0:1789996319.746722:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086d7f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+32:10493:x1876946927532800:12345-192.168.204.37@tcp:101:bash.0 00010000:00010000:3.0:1789996319.746751:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789996319.746774:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857200/0x4173739f0fc80dde lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b97003095e35612 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996319.746916:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857000/0x4173739f0fc80de5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996319.746933:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857000/0x4173739f0fc80de5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996319.746946:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857000/0x4173739f0fc80de5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996319.746959:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856c00/0x4173739f0fc80dec lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996319.746967:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856c00/0x4173739f0fc80dec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996319.746973:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856c00/0x4173739f0fc80dec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789996319.748052:0:5847:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:3.0:1789996319.748247:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856a00/0x4173739f0fc80df3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996319.748260:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856a00/0x4173739f0fc80df3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996319.748270:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856a00/0x4173739f0fc80df3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996319.748319:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857000/0x4173739f0fc80de5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996319.748327:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857000/0x4173739f0fc80de5 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996319.748334:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857000/0x4173739f0fc80de5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996319.748341:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e087f857000 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:3.0:1789996319.748345:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857000/0x4173739f0fc80de5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996319.748353:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857000/0x4173739f0fc80de5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996319.748365:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e084601b700) 00010000:00010000:3.0:1789996319.748369:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789996319.748374:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857000/0x4173739f0fc80de5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996319.748381:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857000/0x4173739f0fc80de5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789996319.748396:0:5847:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a9a7743d reply state 0000000035c35550 transno 4294967377 ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856c00/0x4173739f0fc80dec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789996319.748404:0:5847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789996319.748435:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857200/0x4173739f0fc80dde lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35612 expref: 35 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996319.748460:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856a00/0x4173739f0fc80df3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35612 expref: 34 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996319.748468:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e0846583000) 00010000:00010000:3.0:1789996319.748470:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789996319.748473:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e087f856a00, rc 0) 00000100:00100000:3.0:1789996319.748585:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086d7f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+35:10493:x1876946927532800:12345-192.168.204.37@tcp:101:bash.0 Request processed in 1866us (2097us total) trans 4294967377 rc 0/0 00000100:00100000:3.0:1789996319.748594:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 96 00010000:00010000:3.0:1789996319.752538:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856c00/0x4173739f0fc80dec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996319.752574:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856c00/0x4173739f0fc80dec lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996319.752587:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856c00/0x4173739f0fc80dec lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996319.752594:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e087f856c00 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:3.0:1789996319.752599:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856c00/0x4173739f0fc80dec lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996319.752606:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856c00/0x4173739f0fc80dec lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996319.752627:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8e0846583700) 00010000:00010000:3.0:1789996319.752630:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789996319.752635:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856c00/0x4173739f0fc80dec lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996319.752655:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856c00/0x4173739f0fc80dec lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789996319.756944:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996319.757319:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927532928 00000100:00100000:0.0:1789996319.757329:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927532928 00000100:00100000:0.0:1789996319.757390:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 34 00000100:00100000:0.0:1789996319.757400:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086d7f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+7:2362:x1876946927532928:12345-192.168.204.37@tcp:101:bash.0 00010000:00010000:0.0:1789996319.757418:0:6688:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789996319.757439:0:6688:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c023b5b0/0x4173739f0fc80e01 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1b97003095e35619 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789996319.757468:0:6688:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789996319.757488:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=361s v=(0 0) 00010000:00010000:0.0:1789996319.757493:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789996319.757502:0:6688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c023b5b0/0x4173739f0fc80e01 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35619 expref: 8 pid: 6688 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996319.757521:0:6688:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c023b5b0/0x4173739f0fc80e01 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35619 expref: 8 pid: 6688 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996319.757535:0:6688:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e086fcb6000, rc 0) 00000100:00100000:0.0:1789996319.757625:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086d7f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+8:2362:x1876946927532928:12345-192.168.204.37@tcp:101:bash.0 Request processed in 226us (692us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996319.757632:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 34 00000100:00100000:1.0:1789996319.764490:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996319.764722:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927533056 00000100:00100000:0.0:1789996319.764732:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927533056 00000100:00100000:0.0:1789996319.764818:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 35 00000100:00100000:0.0:1789996319.764827:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fadad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+8:10493:x1876946927533056:12345-192.168.204.37@tcp:101:bash.0 00010000:00010000:0.0:1789996319.764853:0:6690:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789996319.764872:0:6690:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000018022673/0x4173739f0fc80e08 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1b97003095e35620 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996319.764904:0:6690:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c023b5b0/0x4173739f0fc80e01 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35619 expref: 9 pid: 6688 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996319.764914:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789996319.764918:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789996319.764923:0:6690:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000018022673/0x4173739f0fc80e08 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35620 expref: 9 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996319.764955:0:6690:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c023b5b0/0x4173739f0fc80e01 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35619 expref: 9 pid: 6688 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996319.764969:0:6690:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c023b5b0/0x4173739f0fc80e01 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35619 expref: 9 pid: 6688 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789996319.764983:0:6690:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e087661b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6690:1876946942230144:192.168.204.37@tcp:104: 00000100:00100000:0.0:1789996319.765273:0:6690:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e084892ac00 going to sleep for 11 seconds 00000100:00100000:2.0:1789996319.779173:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996319.780755:0:6690:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e087661b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6690:1876946942230144:192.168.204.37@tcp:104: 00010000:00010000:0.0:1789996319.780800:0:6690:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000018022673/0x4173739f0fc80e08 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35620 expref: 9 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996319.780850:0:6690:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e086fcb6a00, rc 0) 00000100:00100000:0.0:1789996319.780920:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fadad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+9:10493:x1876946927533056:12345-192.168.204.37@tcp:101:bash.0 Request processed in 16093us (16438us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996319.780929:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 35 00000100:00100000:3.0:1789996319.784283:0:8520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927533184 00000100:00100000:3.0:1789996319.784299:0:8520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927533184 00010000:00010000:3.0:1789996319.784348:0:8520:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c023b5b0/0x4173739f0fc80e01 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35619 expref: 9 pid: 6688 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789996319.784401:0:8520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 49 00000100:00100000:3.0:1789996319.784411:0:8520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e087059b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+9:2362:x1876946927533184:12345-192.168.204.37@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789996319.784426:0:8520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789996319.784449:0:8520:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c023b5b0/0x4173739f0fc80e01 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35619 expref: 9 pid: 6688 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996319.784464:0:8520:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c023b5b0/0x4173739f0fc80e01 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35619 expref: 9 pid: 6688 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996319.784487:0:8520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c023b5b0/0x4173739f0fc80e01 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35619 expref: 9 pid: 6688 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996319.784504:0:8520:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789996319.784509:0:8520:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789996319.784516:0:8520:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000018022673/0x4173739f0fc80e08 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35620 expref: 8 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996319.784527:0:8520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000018022673/0x4173739f0fc80e08 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35620 expref: 8 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996319.786028:0:8520:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000018022673/0x4173739f0fc80e08 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35620 expref: 8 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789996319.786044:0:8520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fabe300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8520:1876946942230272:192.168.204.37@tcp:105: 00000100:00100000:3.0:1789996319.786120:0:8520:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0845297540 going to sleep for 11 seconds 00000100:00100000:2.0:1789996319.791730:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996319.791888:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927533440 00000100:00100000:0.0:1789996319.791898:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927533440 00000100:00100000:0.0:1789996319.791964:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 25 00000100:00100000:0.0:1789996319.791975:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e087f9bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+34:10493:x1876946927533440:12345-192.168.204.37@tcp:35:bash.0 00000100:00100000:0.0:1789996319.792319:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e087f9bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+35:10493:x1876946927533440:12345-192.168.204.37@tcp:35:bash.0 Request processed in 345us (598us total) trans 4294967378 rc 0/0 00000100:00100000:0.0:1789996319.792328:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 25 00000100:00100000:3.0:1789996319.793909:0:8520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fabe300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8520:1876946942230272:192.168.204.37@tcp:105: 00010000:00010000:3.0:1789996319.793941:0:8520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789996319.794156:0:8520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e087059b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+8:2362:x1876946927533184:12345-192.168.204.37@tcp:103:ldlm_bl.0 Request processed in 9746us (14997us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996319.794167:0:8520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 49 00000100:00100000:2.0:1789996319.984376:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1789996319.984657:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927533568 00000100:00100000:1.0:1789996319.984667:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927533568 00000100:00100000:1.0:1789996319.984730:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 97 00000100:00100000:1.0:1789996319.984754:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e087f9b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+35:10509:x1876946927533568:12345-192.168.204.37@tcp:101:lfs.0 00010000:00010000:1.0:1789996319.984779:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789996319.984808:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23e00/0x4173739f0fc80e0f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b97003095e35627 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996319.984886:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23800/0x4173739f0fc80e16 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996319.984900:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23800/0x4173739f0fc80e16 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996319.984912:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23800/0x4173739f0fc80e16 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789996319.984943:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:1.0:1789996319.984947:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789996319.984962:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23800/0x4173739f0fc80e16 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996319.984983:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23e00/0x4173739f0fc80e0f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35627 expref: 37 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996319.985000:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23800/0x4173739f0fc80e16 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35627 expref: 36 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996319.985008:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e084601b700) 00010000:00010000:1.0:1789996319.985011:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789996319.985014:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e0876a23800, rc 0) 00000100:00100000:1.0:1789996319.986675:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e087f9b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+36:10509:x1876946927533568:12345-192.168.204.37@tcp:101:lfs.0 Request processed in 1914us (2299us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996319.986704:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 97 00000100:00100000:1.0:1789996319.994174:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1789996319.994299:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927533824 00000100:00100000:3.0:1789996319.994309:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927533824 00000100:00100000:3.0:1789996319.994368:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 98 00000100:00100000:3.0:1789996319.994380:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fad8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+36:10509:x1876946927533824:12345-192.168.204.37@tcp:101:lfs.0 00010000:00010000:3.0:1789996319.994401:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789996319.994425:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856c00/0x4173739f0fc80e1d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b97003095e3562e expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996319.994518:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857200/0x4173739f0fc80e24 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996319.994532:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857200/0x4173739f0fc80e24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996319.994816:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857200/0x4173739f0fc80e24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789996319.994856:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1789996319.994985:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856c00/0x4173739f0fc80e1d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e3562e expref: 39 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996319.995238:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857200/0x4173739f0fc80e24 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e3562e expref: 38 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996319.995248:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e0846583000) 00010000:00010000:3.0:1789996319.995251:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789996319.995255:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e087f857200, rc 0) 00000100:00100000:3.0:1789996319.995321:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fad8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+38:10509:x1876946927533824:12345-192.168.204.37@tcp:101:lfs.0 Request processed in 944us (1156us total) trans 4294967379 rc 0/0 00000100:00100000:3.0:1789996319.995330:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 98 00000100:00100000:2.0:1789996320.007525:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996320.007934:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927533952 00000100:00100000:0.0:1789996320.007945:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927533952 00000100:00100000:0.0:1789996320.008022:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 6 00000100:00100000:0.0:1789996320.008032:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e087f9baa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+38:2362:x1876946927533952:12345-192.168.204.37@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789996320.008048:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789996320.008073:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857200/0x4173739f0fc80e24 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e3562e expref: 38 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996320.008093:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e0846583000) 00010000:00010000:0.0:1789996320.008098:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789996320.008162:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e087f9baa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+37:2362:x1876946927533952:12345-192.168.204.37@tcp:103:ldlm_bl.0 Request processed in 131us (648us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996320.008170:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 6 00000100:00100000:2.0:1789996320.020643:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1789996320.021171:0:9163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927534208 00000100:00100000:3.0:1789996320.021181:0:9163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927534208 00000100:00100000:3.0:1789996320.021294:0:9163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 99 00000100:00100000:3.0:1789996320.021304:0:9163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e087f9b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+37:10509:x1876946927534208:12345-192.168.204.37@tcp:101:lfs.0 00010000:00010000:3.0:1789996320.021329:0:9163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789996320.021349:0:9163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856c00/0x4173739f0fc80e32 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b97003095e35635 expref: -99 pid: 9163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996320.021434:0:9163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857000/0x4173739f0fc80e39 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996320.021448:0:9163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857000/0x4173739f0fc80e39 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996320.021478:0:9163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857000/0x4173739f0fc80e39 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789996320.021492:0:9163:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1789996320.021660:0:9163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856c00/0x4173739f0fc80e32 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35635 expref: 40 pid: 9163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996320.022891:0:9163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857000/0x4173739f0fc80e39 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35635 expref: 39 pid: 9163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996320.022906:0:9163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e0846583000) 00010000:00010000:3.0:1789996320.022910:0:9163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1789996320.022914:0:9163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e087f857000, rc 0) 00000100:00100000:3.0:1789996320.022991:0:9163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e087f9b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+39:10509:x1876946927534208:12345-192.168.204.37@tcp:101:lfs.0 Request processed in 1685us (2354us total) trans 4294967380 rc 0/0 00000100:00100000:3.0:1789996320.022999:0:9163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 99 00000100:00100000:1.0:1789996320.031424:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996320.031508:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927534336 00000100:00100000:0.0:1789996320.031518:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927534336 00000100:00100000:0.0:1789996320.031622:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 36 00000100:00100000:0.0:1789996320.031633:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fad9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+8:2363:x1876946927534336:12345-192.168.204.37@tcp:1:lfs.0 00010000:00010000:0.0:1789996320.031805:0:6688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005c66cbf9/0x4173739f0fc80e47 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996320.031828:0:6688:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000018022673/0x4173739f0fc80e08 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35620 expref: 8 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996320.031910:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789996320.031915:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789996320.031920:0:6688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005c66cbf9/0x4173739f0fc80e47 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996320.031955:0:6688:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000018022673/0x4173739f0fc80e08 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35620 expref: 8 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996320.031969:0:6688:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000018022673/0x4173739f0fc80e08 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35620 expref: 8 pid: 6690 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789996320.031984:0:6688:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e087661b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6688:1876946942230400:192.168.204.37@tcp:104: 00000100:00080000:3.0:1789996320.032650:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789996320.032731:0:6688:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e084892ac00 going to sleep for 11 seconds 00000100:00100000:2.0:1789996320.052854:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1789996320.052946:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927534464 00000100:00100000:1.0:1789996320.052956:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927534464 00002000:00100000:1.0:1789996320.053019:0:6695:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff8e087f9bb480 x1876946927534464/t0(0) o4->189efa8a-c7eb-4b69-9afa-1dd36d6775f1@192.168.204.37@tcp:51/0 lens 504/0 e 0 to 0 dl 1789996331 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789996320.053031:0:6695:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8e087f9bb480 with x1876946927534464 ext(0->8) 00010000:00010000:1.0:1789996320.053040:0:6695:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000018022673/0x4173739f0fc80e08 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35620 expref: 9 pid: 6690 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.053059:0:6695:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000018022673/0x4173739f0fc80e08 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35620 expref: 9 pid: 6690 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789996320.053067:0:6695:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8e087f9bb480 00000100:00100000:1.0:1789996320.053103:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 1 00000100:00100000:1.0:1789996320.053113:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e087f9bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+9:2363:x1876946927534464:12345-192.168.204.37@tcp:4:lfs.0 00000100:00100000:1.0:1789996320.053609:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e087f9bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+11:2363:x1876946927534464:12345-192.168.204.37@tcp:4:lfs.0 Request processed in 496us (764us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1789996320.053618:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 1 00002000:00100000:1.0:1789996320.053625:0:6695:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff8e087f9bb480 x1876946927534464/t4294967302(0) o4->189efa8a-c7eb-4b69-9afa-1dd36d6775f1@192.168.204.37@tcp:51/0 lens 504/448 e 0 to 0 dl 1789996331 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789996320.053634:0:6695:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8e087f9bb480 with x1876946927534464 ext(0->8) 00010000:00010000:1.0:1789996320.053640:0:6695:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000018022673/0x4173739f0fc80e08 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35620 expref: 11 pid: 6690 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.053659:0:6695:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000018022673/0x4173739f0fc80e08 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35620 expref: 11 pid: 6690 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789996320.053667:0:6695:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8e087f9bb480 00000100:00100000:0.0:1789996320.055676:0:6688:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e087661b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6688:1876946942230400:192.168.204.37@tcp:104: 00010000:00010000:0.0:1789996320.055709:0:6688:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005c66cbf9/0x4173739f0fc80e47 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789996320.059013:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996320.059245:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927534592 00000100:00100000:0.0:1789996320.059256:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927534592 00010000:00010000:0.0:1789996320.059300:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000018022673/0x4173739f0fc80e08 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35620 expref: 11 pid: 6690 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789996320.059349:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 50 00000100:00100000:0.0:1789996320.059359:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e087f9b9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+11:2364:x1876946927534592:12345-192.168.204.37@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789996320.059374:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1789996320.059392:0:5832:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1789996320.059395:0:5832:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1789996320 00002000:00010000:0.0:1789996320.059398:0:5832:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1789996320 00002000:00010000:0.0:1789996320.059400:0:5832:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1789996320 00010000:00010000:0.0:1789996320.059406:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000018022673/0x4173739f0fc80e08 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35620 expref: 11 pid: 6690 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996320.059421:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000018022673/0x4173739f0fc80e08 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35620 expref: 11 pid: 6690 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996320.059444:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000018022673/0x4173739f0fc80e08 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35620 expref: 11 pid: 6690 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996320.059460:0:5832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789996320.059465:0:5832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789996320.059471:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005c66cbf9/0x4173739f0fc80e47 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996320.059497:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005c66cbf9/0x4173739f0fc80e47 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996320.059535:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789996320.059698:0:6688:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005c66cbf9/0x4173739f0fc80e47 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.059709:0:6688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005c66cbf9/0x4173739f0fc80e47 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.059733:0:6688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005c66cbf9/0x4173739f0fc80e47 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.059741:0:6688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005c66cbf9/0x4173739f0fc80e47 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.059748:0:6688:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005c66cbf9/0x4173739f0fc80e47 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.059755:0:6688:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e086fcb7e00 already unused, calling callback (ffffffffc1595910) 00010000:00010000:1.0:1789996320.059759:0:6688:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005c66cbf9/0x4173739f0fc80e47 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.059768:0:6688:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005c66cbf9/0x4173739f0fc80e47 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.059805:0:6688:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005c66cbf9/0x4173739f0fc80e47 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.059812:0:6688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005c66cbf9/0x4173739f0fc80e47 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789996320.059890:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fad9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+10:2363:x1876946927534336:12345-192.168.204.37@tcp:1:lfs.0 Request processed in 28258us (28475us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996320.059899:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 36 00000100:00100000:0.0:1789996320.060132:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e087f9b9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+9:2364:x1876946927534592:12345-192.168.204.37@tcp:103:ldlm_bl.0 Request processed in 774us (1128us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996320.060140:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 50 00000100:00100000:2.0:1789996320.062615:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1789996320.062823:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927534848 00000100:00100000:3.0:1789996320.062844:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927534848 00000100:00100000:3.0:1789996320.062897:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 26 00000100:00100000:3.0:1789996320.062908:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0850a20850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+39:10509:x1876946927534848:12345-192.168.204.37@tcp:35:lfs.0 00000004:00010000:3.0:1789996320.062967:0:5849:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857000/0x4173739f0fc80e39 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35635 expref: 39 pid: 9163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789996320.063207:0:5849:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:3.0:1789996320.063250:0:5849:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967382 00000001:00080000:3.0:1789996320.063587:0:5849:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967383 00010000:00010000:3.0:1789996320.063665:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856c00/0x4173739f0fc80e4e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996320.064820:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856a00/0x4173739f0fc80df3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35612 expref: 43 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996320.064910:0:5849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856c00/0x4173739f0fc80e4e lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996320.064955:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856a00/0x4173739f0fc80df3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35612 expref: 43 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996320.064972:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856a00/0x4173739f0fc80df3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35612 expref: 43 pid: 5847 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789996320.064987:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fabed80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5849:1876946942230528:192.168.204.37@tcp:104: 00000100:00100000:3.0:1789996320.065087:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e086fd99180 going to sleep for 11 seconds 00000100:00100000:3.0:1789996320.067809:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fabed80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5849:1876946942230528:192.168.204.37@tcp:104: 00010000:00010000:3.0:1789996320.067855:0:5849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856c00/0x4173739f0fc80e4e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789996320.068044:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996320.068235:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927534976 00000100:00100000:0.0:1789996320.068243:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927534976 00010000:00010000:0.0:1789996320.068280:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856a00/0x4173739f0fc80df3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35612 expref: 44 pid: 5847 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789996320.068320:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 51 00000100:00100000:0.0:1789996320.068330:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e087f9bad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+44:2362:x1876946927534976:12345-192.168.204.37@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789996320.068364:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789996320.068372:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856a00/0x4173739f0fc80df3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35612 expref: 44 pid: 5847 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996320.068385:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856a00/0x4173739f0fc80df3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35612 expref: 44 pid: 5847 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996320.068407:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856a00/0x4173739f0fc80df3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35612 expref: 44 pid: 5847 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996320.068422:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e0846583000) 00010000:00010000:0.0:1789996320.068434:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856c00/0x4173739f0fc80e4e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996320.068444:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856c00/0x4173739f0fc80e4e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996320.068452:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856c00/0x4173739f0fc80e4e lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996320.068477:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789996320.068539:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e087f9bad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+43:2362:x1876946927534976:12345-192.168.204.37@tcp:103:ldlm_bl.0 Request processed in 209us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996320.068584:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 51 00010000:00010000:3.0:1789996320.069316:0:5849:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856c00/0x4173739f0fc80e4e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996320.069328:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856c00/0x4173739f0fc80e4e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789996320.069461:0:5849:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967384 00000001:00080000:2.0:1789996320.070096:0:5849:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:2.0:1789996320.070219:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e087f9b9f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5849:1876946942230656:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1789996320.070278:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996320.070313:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0851e2b300 going to sleep for 11 seconds 00000100:00100000:3.0:1789996320.072981:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942230656 00000100:00100000:3.0:1789996320.072995:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942230656 00000100:00100000:3.0:1789996320.073093:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789996320.073103:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e087f9b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5849:x1876946942230656:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1789996320.073221:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e087f9b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5849:x1876946942230656:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 120us (2943us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996320.073228:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789996320.073716:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e087f9b9f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5849:1876946942230656:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1789996320.074325:0:5849:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967386 00000100:00100000:2.0:1789996320.074404:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e087f9b9f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5849:1876946942230784:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1789996320.074458:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996320.074481:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e087fa28180 going to sleep for 11 seconds 00000100:00080000:0.0:1789996320.074566:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789996320.074635:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942230784 00000100:00100000:1.0:1789996320.074641:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942230784 00000100:00100000:1.0:1789996320.074673:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789996320.074681:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e087f9bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5849:x1876946942230784:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1789996320.075097:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e087f9bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:5849:x1876946942230784:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 416us (638us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1789996320.075104:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789996320.077019:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e087f9b9f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5849:1876946942230784:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1789996320.077109:0:5849:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:2.0:1789996320.077168:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856c00/0x4173739f0fc80e4e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996320.077180:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856c00/0x4173739f0fc80e4e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996320.077189:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856c00/0x4173739f0fc80e4e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996320.077196:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e087f856c00 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:2.0:1789996320.077201:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856c00/0x4173739f0fc80e4e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996320.077209:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856c00/0x4173739f0fc80e4e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996320.077226:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e0846583000) 00010000:00010000:2.0:1789996320.077229:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1789996320.077235:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856c00/0x4173739f0fc80e4e lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996320.077242:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856c00/0x4173739f0fc80e4e lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789996320.077435:0:5849:0:(mdd_object.c:4178:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1789996320.077596:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:2.0:1789996320.077607:0:5849:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 361797063725ns, next at 362797061662ns, rc = 0 00000001:00080000:2.0:1789996320.077614:0:5849:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967388 00010000:00010000:2.0:1789996320.077649:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e0846583000) 00010000:00010000:2.0:1789996320.077653:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789996320.077660:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857000/0x4173739f0fc80e39 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35635 expref: 47 pid: 9163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789996320.077774:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0850a20850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+46:10509:x1876946927534848:12345-192.168.204.37@tcp:35:lfs.0 Request processed in 14868us (15168us total) trans 4294967389 rc 0/0 00000100:00100000:2.0:1789996320.077796:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 26 00000020:00080000:2.0:1789996320.077801:0:5849:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1789996320.082351:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1789996320.082440:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927535104 00000100:00100000:1.0:1789996320.082450:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927535104 00000100:00100000:1.0:1789996320.082510:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 100 00000100:00100000:1.0:1789996320.082521:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e087f9bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+46:10509:x1876946927535104:12345-192.168.204.37@tcp:101:lfs.0 00010000:00010000:1.0:1789996320.083119:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789996320.083143:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23a00/0x4173739f0fc80e55 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b97003095e3563c expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.083205:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23a00/0x4173739f0fc80e55 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e3563c expref: 47 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.083236:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23a00/0x4173739f0fc80e55 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e3563c expref: 47 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.083255:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e0861fcfd00) 00010000:00010000:1.0:1789996320.083259:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789996320.083263:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e0876a23a00, rc 0) 00000100:00100000:1.0:1789996320.083330:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e087f9bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+47:10509:x1876946927535104:12345-192.168.204.37@tcp:101:lfs.0 Request processed in 810us (989us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996320.083337:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 100 00000100:00100000:3.0:1789996320.085845:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1789996320.086202:0:11495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927535360 00000100:00100000:1.0:1789996320.086212:0:11495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927535360 00000100:00100000:1.0:1789996320.086270:0:11495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 27 00000100:00100000:1.0:1789996320.086280:0:11495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fabed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+47:10509:x1876946927535360:12345-192.168.204.37@tcp:35:lfs.0 00000100:00100000:1.0:1789996320.087611:0:11495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fabed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+48:10509:x1876946927535360:12345-192.168.204.37@tcp:35:lfs.0 Request processed in 1324us (1768us total) trans 4294967390 rc 0/0 00000100:00100000:1.0:1789996320.087622:0:11495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 27 00010000:00010000:2.0:1789996320.104758:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789996320.174587:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1789996320.174703:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927535488 00000100:00100000:1.0:1789996320.174714:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927535488 00000100:00100000:1.0:1789996320.174773:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 101 00000100:00100000:1.0:1789996320.174798:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e087f9b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+48:10519:x1876946927535488:12345-192.168.204.37@tcp:34:lfs.0 00010000:00010000:1.0:1789996320.174888:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23400/0x4173739f0fc80e5c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.174905:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23400/0x4173739f0fc80e5c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.174936:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23400/0x4173739f0fc80e5c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.174952:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22e00/0x4173739f0fc80e63 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.174960:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22e00/0x4173739f0fc80e63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.174967:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22e00/0x4173739f0fc80e63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996320.175243:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6a00/0x4173739f0fc80e6a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996320.175256:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6a00/0x4173739f0fc80e6a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996320.175264:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6a00/0x4173739f0fc80e6a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789996320.175310:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6a00/0x4173739f0fc80e6a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996320.175322:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23400/0x4173739f0fc80e5c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996320.175330:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23400/0x4173739f0fc80e5c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996320.175337:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23400/0x4173739f0fc80e5c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996320.175351:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0876a23400 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:0.0:1789996320.175356:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23400/0x4173739f0fc80e5c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996320.175363:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23400/0x4173739f0fc80e5c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996320.175377:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e084601b700) 00010000:00010000:0.0:1789996320.175380:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789996320.175385:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23400/0x4173739f0fc80e5c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996320.175392:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23400/0x4173739f0fc80e5c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996320.175406:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22e00/0x4173739f0fc80e63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996320.175412:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22e00/0x4173739f0fc80e63 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996320.175417:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22e00/0x4173739f0fc80e63 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996320.175421:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0876a22e00 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:0.0:1789996320.175424:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22e00/0x4173739f0fc80e63 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996320.175429:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22e00/0x4173739f0fc80e63 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996320.175447:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8e0861fcfe00) 00010000:00010000:0.0:1789996320.175450:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789996320.175453:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22e00/0x4173739f0fc80e63 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996320.175459:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22e00/0x4173739f0fc80e63 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996320.175475:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6a00/0x4173739f0fc80e6a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996320.175480:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6a00/0x4173739f0fc80e6a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996320.175485:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6a00/0x4173739f0fc80e6a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996320.175490:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e086fcb6a00 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:0.0:1789996320.175493:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6a00/0x4173739f0fc80e6a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996320.175499:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6a00/0x4173739f0fc80e6a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996320.175507:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e0861fcfd00) 00010000:00010000:0.0:1789996320.175509:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789996320.175512:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6a00/0x4173739f0fc80e6a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996320.175518:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6a00/0x4173739f0fc80e6a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789996320.176844:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e087f9b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+48:10519:x1876946927535488:12345-192.168.204.37@tcp:34:lfs.0 Request processed in 2052us (2297us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996320.176858:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 101 00000100:00100000:2.0:1789996320.214221:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1789996320.214446:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927535744 00000100:00100000:3.0:1789996320.214457:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927535744 00000100:00100000:3.0:1789996320.214526:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 102 00000100:00100000:3.0:1789996320.214536:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e087f9b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+48:10522:x1876946927535744:12345-192.168.204.37@tcp:101:lfs.0 00010000:00010000:3.0:1789996320.214591:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789996320.214614:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856400/0x4173739f0fc80e71 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b97003095e35643 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996320.214684:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857800/0x4173739f0fc80e78 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996320.214699:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857800/0x4173739f0fc80e78 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996320.214710:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857800/0x4173739f0fc80e78 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996320.214727:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856200/0x4173739f0fc80e7f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996320.214735:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856200/0x4173739f0fc80e7f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996320.214742:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856200/0x4173739f0fc80e7f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996320.216067:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5c00/0x4173739f0fc80e86 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996320.216084:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5c00/0x4173739f0fc80e86 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996320.216093:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5c00/0x4173739f0fc80e86 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789996320.216104:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1789996320.216299:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857800/0x4173739f0fc80e78 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996320.216307:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857800/0x4173739f0fc80e78 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996320.216330:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857800/0x4173739f0fc80e78 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996320.216336:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e087f857800 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:2.0:1789996320.216341:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857800/0x4173739f0fc80e78 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996320.216349:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857800/0x4173739f0fc80e78 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996320.216362:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e084601b700) 00010000:00010000:2.0:1789996320.216365:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789996320.216369:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857800/0x4173739f0fc80e78 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996320.216376:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857800/0x4173739f0fc80e78 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996320.216390:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856200/0x4173739f0fc80e7f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996320.216397:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856200/0x4173739f0fc80e7f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996320.216402:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856200/0x4173739f0fc80e7f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996320.216408:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e087f856200 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:2.0:1789996320.216411:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856200/0x4173739f0fc80e7f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996320.216428:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856200/0x4173739f0fc80e7f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996320.216437:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8e0846583700) 00010000:00010000:2.0:1789996320.216439:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789996320.216443:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856200/0x4173739f0fc80e7f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996320.216449:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856200/0x4173739f0fc80e7f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996320.216501:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856400/0x4173739f0fc80e71 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35643 expref: 51 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996320.216517:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5c00/0x4173739f0fc80e86 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35643 expref: 50 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996320.216524:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e0861fcfd00) 00010000:00010000:2.0:1789996320.216527:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789996320.216529:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e0842de5c00, rc 0) 00000100:00100000:2.0:1789996320.216720:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e087f9b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+50:10522:x1876946927535744:12345-192.168.204.37@tcp:101:lfs.0 Request processed in 2184us (2507us total) trans 4294967391 rc 0/0 00000100:00100000:2.0:1789996320.216730:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 102 00000100:00100000:2.0:1789996320.220331:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1789996320.220425:0:9163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927535872 00000100:00100000:3.0:1789996320.220437:0:9163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927535872 00000100:00100000:3.0:1789996320.220532:0:9163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 103 00000100:00100000:3.0:1789996320.220573:0:9163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e087f9ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+50:10522:x1876946927535872:12345-192.168.204.37@tcp:54:lfs.0 00010000:00010000:3.0:1789996320.220644:0:9163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856600/0x4173739f0fc80e94 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996320.220662:0:9163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856600/0x4173739f0fc80e94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996320.220686:0:9163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856600/0x4173739f0fc80e94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996320.220711:0:9163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856600/0x4173739f0fc80e94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996320.220718:0:9163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856600/0x4173739f0fc80e94 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996320.220725:0:9163:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856600/0x4173739f0fc80e94 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996320.220731:0:9163:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e087f856600 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:3.0:1789996320.220735:0:9163:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856600/0x4173739f0fc80e94 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996320.220743:0:9163:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856600/0x4173739f0fc80e94 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996320.220755:0:9163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e0861fcfd00) 00010000:00010000:3.0:1789996320.220774:0:9163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789996320.220790:0:9163:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856600/0x4173739f0fc80e94 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996320.220797:0:9163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856600/0x4173739f0fc80e94 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789996320.220877:0:9163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e087f9ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+50:10522:x1876946927535872:12345-192.168.204.37@tcp:54:lfs.0 Request processed in 336us (557us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996320.220885:0:9163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 103 00000100:00100000:1.0:1789996320.223131:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996320.223278:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927536128 00000100:00100000:2.0:1789996320.223289:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927536128 00000100:00100000:2.0:1789996320.223342:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 28 00000100:00100000:2.0:1789996320.223352:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fad9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+50:10522:x1876946927536128:12345-192.168.204.37@tcp:35:lfs.0 00000100:00100000:2.0:1789996320.223902:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fad9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+51:10522:x1876946927536128:12345-192.168.204.37@tcp:35:lfs.0 Request processed in 549us (779us total) trans 4294967392 rc 0/0 00000100:00100000:2.0:1789996320.223911:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 28 00000100:00100000:2.0:1789996320.303387:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1789996320.303580:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927536384 00000100:00100000:1.0:1789996320.303591:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927536384 00000100:00100000:1.0:1789996320.303691:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 104 00000100:00100000:1.0:1789996320.303703:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e087f9b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+51:10532:x1876946927536384:12345-192.168.204.37@tcp:101:bash.0 00010000:00010000:1.0:1789996320.303728:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789996320.303732:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789996320.303771:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23800/0x4173739f0fc80e16 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35627 expref: 51 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.303805:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e084601b700) 00010000:00010000:1.0:1789996320.303811:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789996320.303825:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22a00/0x4173739f0fc80e9b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b97003095e3564a expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.303929:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22000/0x4173739f0fc80ea2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.303956:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5c00/0x4173739f0fc80e86 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35643 expref: 51 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.303964:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22000/0x4173739f0fc80ea2 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.303998:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5c00/0x4173739f0fc80e86 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35643 expref: 51 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.304010:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5c00/0x4173739f0fc80e86 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35643 expref: 51 pid: 5847 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789996320.304024:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fada300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5848:1876946942230912:192.168.204.37@tcp:104: 00000100:00100000:1.0:1789996320.304126:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e084314d300 going to sleep for 11 seconds 00000100:00100000:1.0:1789996320.307074:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fada300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5848:1876946942230912:192.168.204.37@tcp:104: 00010000:00010000:1.0:1789996320.307109:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22000/0x4173739f0fc80ea2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789996320.308417:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996320.308630:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927536512 00000100:00100000:0.0:1789996320.308640:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927536512 00010000:00010000:0.0:1789996320.308993:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5c00/0x4173739f0fc80e86 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35643 expref: 52 pid: 5847 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789996320.309044:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 52 00000100:00100000:0.0:1789996320.309054:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e087f9b8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+52:2362:x1876946927536512:12345-192.168.204.37@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789996320.309069:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789996320.309077:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5c00/0x4173739f0fc80e86 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35643 expref: 52 pid: 5847 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996320.309089:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5c00/0x4173739f0fc80e86 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35643 expref: 52 pid: 5847 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996320.309111:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5c00/0x4173739f0fc80e86 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35643 expref: 52 pid: 5847 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996320.309128:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e0861fcfd00) 00010000:00010000:0.0:1789996320.309133:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22000/0x4173739f0fc80ea2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996320.309142:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22000/0x4173739f0fc80ea2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996320.309170:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22000/0x4173739f0fc80ea2 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996320.309279:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789996320.309341:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e087f9b8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+51:2362:x1876946927536512:12345-192.168.204.37@tcp:103:ldlm_bl.0 Request processed in 288us (931us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996320.309349:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 52 00010000:00010000:1.0:1789996320.309403:0:5848:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22000/0x4173739f0fc80ea2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.309412:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22000/0x4173739f0fc80ea2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789996320.309431:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1789996320.309989:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22a00/0x4173739f0fc80e9b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e3564a expref: 52 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.310027:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22000/0x4173739f0fc80ea2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e3564a expref: 51 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.310034:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e0861fcfd00) 00010000:00010000:1.0:1789996320.310037:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789996320.310040:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e0876a22000, rc 0) 00000100:00100000:1.0:1789996320.310080:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e087f9b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+51:10532:x1876946927536384:12345-192.168.204.37@tcp:101:bash.0 Request processed in 6379us (6703us total) trans 4294967393 rc 0/0 00000100:00100000:1.0:1789996320.310086:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 104 00000100:00100000:2.0:1789996320.314188:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996320.314290:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927536768 00000100:00100000:0.0:1789996320.314301:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927536768 00000100:00100000:0.0:1789996320.314426:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 105 00000100:00100000:0.0:1789996320.314439:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e087f9ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+51:10532:x1876946927536768:12345-192.168.204.37@tcp:36:bash.0 00010000:00010000:0.0:1789996320.314755:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6a00/0x4173739f0fc80eb0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996320.314774:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6a00/0x4173739f0fc80eb0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996320.314796:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6a00/0x4173739f0fc80eb0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789996320.314850:0:5846:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967394 00000004:00010000:0.0:1789996320.314876:0:5846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001fc13c3f reply state 00000000d0209ce4 transno 4294967395 ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6a00/0x4173739f0fc80eb0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789996320.314885:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789996320.314979:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e087f9ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+54:10532:x1876946927536768:12345-192.168.204.37@tcp:36:bash.0 Request processed in 542us (800us total) trans 4294967395 rc 0/0 00000100:00100000:0.0:1789996320.314987:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 105 00000020:00080000:0.0:1789996320.314992:0:5846:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789996320.316704:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6a00/0x4173739f0fc80eb0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996320.316720:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6a00/0x4173739f0fc80eb0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996320.316728:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6a00/0x4173739f0fc80eb0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996320.316913:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e086fcb6a00 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:2.0:1789996320.316920:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6a00/0x4173739f0fc80eb0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996320.316930:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6a00/0x4173739f0fc80eb0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996320.316946:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e0861fcfd00) 00010000:00010000:2.0:1789996320.316948:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789996320.316954:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6a00/0x4173739f0fc80eb0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996320.316960:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6a00/0x4173739f0fc80eb0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789996320.320414:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996320.320499:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927536896 00000100:00100000:0.0:1789996320.320511:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927536896 00000100:00100000:0.0:1789996320.320608:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 106 00000100:00100000:0.0:1789996320.320619:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e087f9b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+53:10532:x1876946927536896:12345-192.168.204.37@tcp:101:bash.0 00010000:00010000:0.0:1789996320.320649:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789996320.320673:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6c00/0x4173739f0fc80eb7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b97003095e35651 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996320.320754:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6200/0x4173739f0fc80ebe lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996320.320768:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22000/0x4173739f0fc80ea2 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e3564a expref: 54 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996320.320787:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6200/0x4173739f0fc80ebe lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996320.320819:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22000/0x4173739f0fc80ea2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e3564a expref: 54 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996320.320832:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22000/0x4173739f0fc80ea2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e3564a expref: 54 pid: 5848 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789996320.320846:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e087661b480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5847:1876946942231040:192.168.204.37@tcp:104: 00000100:00100000:0.0:1789996320.320933:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e084892ac00 going to sleep for 11 seconds 00000100:00100000:0.0:1789996320.323004:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e087661b480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5847:1876946942231040:192.168.204.37@tcp:104: 00010000:00010000:0.0:1789996320.323032:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6200/0x4173739f0fc80ebe lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789996320.324242:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996320.324528:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927537024 00000100:00100000:0.0:1789996320.324537:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927537024 00010000:00010000:0.0:1789996320.324613:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22000/0x4173739f0fc80ea2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e3564a expref: 55 pid: 5848 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789996320.324653:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 53 00000100:00100000:0.0:1789996320.324664:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e087f9bb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+55:2363:x1876946927537024:12345-192.168.204.37@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789996320.324691:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789996320.324700:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22000/0x4173739f0fc80ea2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e3564a expref: 55 pid: 5848 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996320.324713:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22000/0x4173739f0fc80ea2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e3564a expref: 55 pid: 5848 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996320.324736:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22000/0x4173739f0fc80ea2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e3564a expref: 55 pid: 5848 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996320.324766:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e0861fcfd00) 00010000:00010000:0.0:1789996320.324772:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6200/0x4173739f0fc80ebe lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996320.324792:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6200/0x4173739f0fc80ebe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996320.324800:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6200/0x4173739f0fc80ebe lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996320.324836:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789996320.324905:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e087f9bb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+54:2363:x1876946927537024:12345-192.168.204.37@tcp:103:ldlm_bl.0 Request processed in 242us (669us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996320.324913:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 53 00010000:00010000:1.0:1789996320.324994:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6200/0x4173739f0fc80ebe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.325002:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6200/0x4173739f0fc80ebe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789996320.325051:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1789996320.325056:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789996320.325077:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6200/0x4173739f0fc80ebe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.325108:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6c00/0x4173739f0fc80eb7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35651 expref: 54 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.325124:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6200/0x4173739f0fc80ebe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35651 expref: 53 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.325131:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e0861fcfd00) 00010000:00010000:1.0:1789996320.325142:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789996320.325145:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e086fcb6200, rc 0) 00000100:00100000:1.0:1789996320.325171:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e087f9b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+53:10532:x1876946927536896:12345-192.168.204.37@tcp:101:bash.0 Request processed in 4554us (4778us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996320.325178:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 106 00000100:00100000:3.0:1789996320.329135:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1789996320.329220:0:11495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927537280 00000100:00100000:1.0:1789996320.329229:0:11495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927537280 00000100:00100000:1.0:1789996320.329282:0:11495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 29 00000100:00100000:1.0:1789996320.329293:0:11495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fabd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+53:10532:x1876946927537280:12345-192.168.204.37@tcp:35:bash.0 00000100:00100000:1.0:1789996320.329573:0:11495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fabd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+54:10532:x1876946927537280:12345-192.168.204.37@tcp:35:bash.0 Request processed in 281us (446us total) trans 4294967396 rc 0/0 00000100:00100000:1.0:1789996320.329581:0:11495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 29 00000100:00100000:3.0:1789996320.384262:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996320.384382:0:9163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927537408 00000100:00100000:0.0:1789996320.384392:0:9163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927537408 00000100:00100000:0.0:1789996320.384460:0:9163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 107 00000100:00100000:0.0:1789996320.384471:0:9163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fabe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+54:10538:x1876946927537408:12345-192.168.204.37@tcp:101:lfs.0 00010000:00010000:0.0:1789996320.384495:0:9163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789996320.384516:0:9163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7c00/0x4173739f0fc80ec5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b97003095e35658 expref: -99 pid: 9163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996320.384623:0:9163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6c00/0x4173739f0fc80ecc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996320.384641:0:9163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6c00/0x4173739f0fc80ecc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996320.384653:0:9163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6c00/0x4173739f0fc80ecc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789996320.384974:0:9163:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:0.0:1789996320.384978:0:9163:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789996320.384996:0:9163:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6c00/0x4173739f0fc80ecc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996320.385021:0:9163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7c00/0x4173739f0fc80ec5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35658 expref: 56 pid: 9163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996320.385042:0:9163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6c00/0x4173739f0fc80ecc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35658 expref: 55 pid: 9163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996320.385070:0:9163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e084601b700) 00010000:00010000:0.0:1789996320.385073:0:9163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789996320.385077:0:9163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e086fcb6c00, rc 0) 00000100:00100000:0.0:1789996320.385195:0:9163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fabe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+55:10538:x1876946927537408:12345-192.168.204.37@tcp:101:lfs.0 Request processed in 724us (943us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996320.385203:0:9163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 107 00000100:00100000:2.0:1789996320.388102:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1789996320.388235:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927537536 00000100:00100000:1.0:1789996320.388245:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927537536 00000100:00100000:1.0:1789996320.388304:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 108 00000100:00100000:1.0:1789996320.388314:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086d7f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+55:10538:x1876946927537536:12345-192.168.204.37@tcp:101:lfs.0 00010000:00010000:1.0:1789996320.388333:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789996320.388351:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22a00/0x4173739f0fc80ed3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b97003095e3565f expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.388500:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22600/0x4173739f0fc80eda lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.388515:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22600/0x4173739f0fc80eda lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.388535:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22600/0x4173739f0fc80eda lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.388597:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22800/0x4173739f0fc80ee1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.388604:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22800/0x4173739f0fc80ee1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.388611:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22800/0x4173739f0fc80ee1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.388694:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22200/0x4173739f0fc80ee8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.388702:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22200/0x4173739f0fc80ee8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.388708:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22200/0x4173739f0fc80ee8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789996320.388755:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1789996320.388759:0:5848:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789996320.388786:0:5848:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22200/0x4173739f0fc80ee8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.388798:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22200/0x4173739f0fc80ee8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.388805:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22600/0x4173739f0fc80eda lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.388811:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22600/0x4173739f0fc80eda lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.388838:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22600/0x4173739f0fc80eda lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.388844:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0876a22600 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:1.0:1789996320.388849:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22600/0x4173739f0fc80eda lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.388857:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22600/0x4173739f0fc80eda lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.388869:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e084601b700) 00010000:00010000:1.0:1789996320.388873:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789996320.388877:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22600/0x4173739f0fc80eda lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.388884:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22600/0x4173739f0fc80eda lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.388897:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22800/0x4173739f0fc80ee1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.388902:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22800/0x4173739f0fc80ee1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.388907:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22800/0x4173739f0fc80ee1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.388912:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0876a22800 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:1.0:1789996320.388914:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22800/0x4173739f0fc80ee1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.388928:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22800/0x4173739f0fc80ee1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.388935:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8e0861fcf600) 00010000:00010000:1.0:1789996320.388937:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789996320.388940:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22800/0x4173739f0fc80ee1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.388945:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22800/0x4173739f0fc80ee1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.388972:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22a00/0x4173739f0fc80ed3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e3565f expref: 57 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.388983:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22200/0x4173739f0fc80ee8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e3565f expref: 56 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.388989:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e0861fcfd00) 00010000:00010000:1.0:1789996320.388991:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789996320.388993:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e0876a22200, rc 0) 00000100:00100000:1.0:1789996320.389054:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086d7f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+56:10538:x1876946927537536:12345-192.168.204.37@tcp:101:lfs.0 Request processed in 742us (961us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996320.389060:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 108 00000100:00100000:3.0:1789996320.393184:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1789996320.393441:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927537792 00000100:00100000:1.0:1789996320.393452:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927537792 00000100:00100000:1.0:1789996320.393518:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 109 00000100:00100000:1.0:1789996320.393528:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fabdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+56:10538:x1876946927537792:12345-192.168.204.37@tcp:101:lfs.0 00010000:00010000:1.0:1789996320.393593:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789996320.393617:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22000/0x4173739f0fc80eef lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b97003095e35666 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.393755:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23800/0x4173739f0fc80ef6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.393771:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6200/0x4173739f0fc80ebe lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35651 expref: 57 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.393791:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22200/0x4173739f0fc80ee8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e3565f expref: 57 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.393799:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23800/0x4173739f0fc80ef6 lrc: 5/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.394095:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22200/0x4173739f0fc80ee8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e3565f expref: 57 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.394110:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22200/0x4173739f0fc80ee8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e3565f expref: 57 pid: 5848 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789996320.394123:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fada300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5846:1876946942231168:192.168.204.37@tcp:104: 00010000:00010000:1.0:1789996320.394279:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6200/0x4173739f0fc80ebe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35651 expref: 57 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.394289:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6200/0x4173739f0fc80ebe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35651 expref: 57 pid: 5847 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789996320.394313:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fada680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5846:1876946942231296:192.168.204.37@tcp:104: 00000100:00100000:1.0:1789996320.394343:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e084314d300 going to sleep for 11 seconds 00000100:00100000:2.0:1789996320.398101:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1789996320.399269:0:8520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927537920 00000100:00100000:1.0:1789996320.399282:0:8520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927537920 00010000:00010000:1.0:1789996320.399335:0:8520:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22200/0x4173739f0fc80ee8 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e3565f expref: 58 pid: 5848 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789996320.399387:0:8520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 54 00000100:00100000:1.0:1789996320.399413:0:8520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086d7f3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+58:2364:x1876946927537920:12345-192.168.204.37@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789996320.399429:0:8520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789996320.399437:0:8520:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22200/0x4173739f0fc80ee8 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e3565f expref: 58 pid: 5848 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.399451:0:8520:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22200/0x4173739f0fc80ee8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e3565f expref: 58 pid: 5848 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.399475:0:8520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e0861fcfd00) 00010000:00010000:1.0:1789996320.399481:0:8520:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23800/0x4173739f0fc80ef6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.399491:0:8520:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23800/0x4173739f0fc80ef6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.399499:0:8520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789996320.399571:0:8520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086d7f3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+58:2364:x1876946927537920:12345-192.168.204.37@tcp:103:ldlm_bl.0 Request processed in 173us (1479us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996320.399598:0:8520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 54 00010000:00010000:1.0:1789996320.411041:0:5846:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.204.37@tcp) returned -22 from blocking AST (req@00000000f09c442f x1876946942231168) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22200/0x4173739f0fc80ee8 lrc: 1/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e3565f expref: 57 pid: 5848 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.411068:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22200/0x4173739f0fc80ee8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e3565f expref: 57 pid: 5848 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789996320.411087:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fada300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5846:1876946942231168:192.168.204.37@tcp:104: 00000100:00100000:1.0:1789996320.411102:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fada680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5846:1876946942231296:192.168.204.37@tcp:104: 00010000:00010000:1.0:1789996320.411130:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e0861fcfd00) 00010000:00010000:1.0:1789996320.411135:0:5846:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23800/0x4173739f0fc80ef6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.411144:0:5846:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23800/0x4173739f0fc80ef6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.411153:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23800/0x4173739f0fc80ef6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789996320.412047:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996320.412231:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927538048 00000100:00100000:0.0:1789996320.412240:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927538048 00010000:00010000:0.0:1789996320.412277:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6200/0x4173739f0fc80ebe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35651 expref: 57 pid: 5847 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789996320.412331:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 55 00000100:00100000:0.0:1789996320.412344:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0870599c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+57:2363:x1876946927538048:12345-192.168.204.37@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789996320.412365:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789996320.412374:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6200/0x4173739f0fc80ebe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35651 expref: 57 pid: 5847 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996320.412389:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6200/0x4173739f0fc80ebe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35651 expref: 57 pid: 5847 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996320.412420:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6200/0x4173739f0fc80ebe lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35651 expref: 57 pid: 5847 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996320.412438:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e0861fcfd00) 00010000:00010000:0.0:1789996320.412442:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23800/0x4173739f0fc80ef6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996320.412465:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23800/0x4173739f0fc80ef6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996320.412472:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23800/0x4173739f0fc80ef6 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996320.412507:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789996320.412613:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0870599c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+56:2363:x1876946927538048:12345-192.168.204.37@tcp:103:ldlm_bl.0 Request processed in 270us (574us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996320.412624:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 55 00010000:00010000:1.0:1789996320.414100:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23800/0x4173739f0fc80ef6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.414115:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23800/0x4173739f0fc80ef6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789996320.414139:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1789996320.414325:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22000/0x4173739f0fc80eef lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35666 expref: 57 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.414359:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23800/0x4173739f0fc80ef6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35666 expref: 56 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.414367:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e0861fcfd00) 00010000:00010000:1.0:1789996320.414370:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789996320.414373:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e0876a23800, rc 0) 00000100:00100000:1.0:1789996320.414454:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fabdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+56:10538:x1876946927537792:12345-192.168.204.37@tcp:101:lfs.0 Request processed in 20926us (21279us total) trans 4294967397 rc 0/0 00000100:00100000:1.0:1789996320.414463:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 109 00000100:00100000:3.0:1789996320.419069:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1789996320.419153:0:8520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927538304 00000100:00100000:1.0:1789996320.419165:0:8520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927538304 00000100:00100000:1.0:1789996320.419241:0:8520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 7 00000100:00100000:1.0:1789996320.419252:0:8520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fabf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+56:10538:x1876946927538304:12345-192.168.204.37@tcp:103:lfs.0 00010000:00010000:1.0:1789996320.419270:0:8520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789996320.419308:0:8520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23a00/0x4173739f0fc80e55 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e3563c expref: 56 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.419330:0:8520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e0861fcfd00) 00010000:00010000:1.0:1789996320.419335:0:8520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789996320.419404:0:8520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fabf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+55:10538:x1876946927538304:12345-192.168.204.37@tcp:103:lfs.0 Request processed in 154us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996320.419412:0:8520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 7 00000100:00100000:3.0:1789996320.422474:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996320.423166:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927538432 00000100:00100000:0.0:1789996320.423178:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927538432 00000100:00100000:0.0:1789996320.423248:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 110 00000100:00100000:0.0:1789996320.423260:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fabfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+55:10538:x1876946927538432:12345-192.168.204.37@tcp:58:lfs.0 00010000:00010000:0.0:1789996320.423401:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6200/0x4173739f0fc80f04 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996320.423419:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6200/0x4173739f0fc80f04 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996320.423432:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6200/0x4173739f0fc80f04 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789996320.425190:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:0.0:1789996320.425313:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fabfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+55:10538:x1876946927538432:12345-192.168.204.37@tcp:58:lfs.0 Request processed in 2051us (2843us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996320.425325:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 110 00000100:00100000:2.0:1789996320.431019:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996320.432919:0:9163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927538560 00000100:00100000:0.0:1789996320.432934:0:9163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927538560 00000100:00100000:0.0:1789996320.433123:0:9163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 111 00000100:00100000:0.0:1789996320.433134:0:9163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086d7f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+55:10538:x1876946927538560:12345-192.168.204.37@tcp:101:lfs.0 00010000:00010000:0.0:1789996320.433156:0:9163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789996320.433178:0:9163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7c00/0x4173739f0fc80f0b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b97003095e3566d expref: -99 pid: 9163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996320.433236:0:9163:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6200/0x4173739f0fc80f04 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996320.433248:0:9163:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7c00/0x4173739f0fc80f0b lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e3566d expref: 56 pid: 9163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996320.433269:0:9163:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6200/0x4173739f0fc80f04 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996320.433281:0:9163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7c00/0x4173739f0fc80f0b lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e3566d expref: 56 pid: 9163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996320.433296:0:9163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e0861fcfd00) 00010000:00010000:0.0:1789996320.433299:0:9163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789996320.433302:0:9163:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7c00/0x4173739f0fc80f0b lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e3566d expref: 56 pid: 9163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996320.433310:0:9163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e086fcb7c00, rc 0) 00000100:00100000:0.0:1789996320.433382:0:9163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086d7f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+56:10538:x1876946927538560:12345-192.168.204.37@tcp:101:lfs.0 Request processed in 249us (2371us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996320.433389:0:9163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 111 00000040:00080000:2.0:1789996320.553861:0:11698:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789996320.553871:0:11698:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789996320.554127:0:11698:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:2.0:1789996320.554134:0:11698:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789996320.554289:0:11698:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0877abd880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11698:1876946942231424:192.168.204.37@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789996320.554415:0:11698:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e087fa28000 going to sleep for 11 seconds 00000100:00100000:0.0:1789996320.562138:0:11698:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0877abd880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11698:1876946942231424:192.168.204.37@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789996320.564430:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1789996320.566215:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927538688 00000100:00100000:1.0:1789996320.566229:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927538688 00000100:00100000:1.0:1789996320.566306:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 112 00000100:00100000:1.0:1789996320.566331:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fabc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+56:10540:x1876946927538688:12345-192.168.204.37@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789996320.566369:0:5848:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789996320.566483:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fabc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+56:10540:x1876946927538688:12345-192.168.204.37@tcp:53:lhsmtool_posix.0 Request processed in 153us (2062us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996320.566490:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 112 00000100:00100000:2.0:1789996320.573269:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1789996320.573721:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927538816 00000100:00100000:1.0:1789996320.573733:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927538816 00000100:00100000:1.0:1789996320.573810:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 113 00000100:00100000:1.0:1789996320.573831:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0877abc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+56:10540:x1876946927538816:12345-192.168.204.37@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1789996320.573906:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23a00/0x4173739f0fc80f12 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.573924:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23a00/0x4173739f0fc80f12 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.573935:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23a00/0x4173739f0fc80f12 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.573951:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22000/0x4173739f0fc80f19 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.573958:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22000/0x4173739f0fc80f19 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.573964:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22000/0x4173739f0fc80f19 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.573985:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22200/0x4173739f0fc80f20 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.574011:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22200/0x4173739f0fc80f20 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.574019:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22200/0x4173739f0fc80f20 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789996320.574272:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1789996320.574277:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789996320.574290:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22200/0x4173739f0fc80f20 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.574301:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23a00/0x4173739f0fc80f12 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.574308:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23a00/0x4173739f0fc80f12 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.574314:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23a00/0x4173739f0fc80f12 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.574321:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0876a23a00 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:1.0:1789996320.574325:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23a00/0x4173739f0fc80f12 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.574332:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23a00/0x4173739f0fc80f12 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.574344:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e084601b600) 00010000:00010000:1.0:1789996320.574347:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789996320.574353:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23a00/0x4173739f0fc80f12 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.574370:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23a00/0x4173739f0fc80f12 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.574386:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22000/0x4173739f0fc80f19 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.574392:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22000/0x4173739f0fc80f19 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.574398:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22000/0x4173739f0fc80f19 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.574403:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0876a22000 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:1.0:1789996320.574405:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22000/0x4173739f0fc80f19 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.574412:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22000/0x4173739f0fc80f19 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.574420:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff8e0861fcf600) 00010000:00010000:1.0:1789996320.574423:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789996320.574426:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22000/0x4173739f0fc80f19 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.574431:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22000/0x4173739f0fc80f19 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.574445:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22200/0x4173739f0fc80f20 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.574451:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22200/0x4173739f0fc80f20 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.574463:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22200/0x4173739f0fc80f20 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.574468:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0876a22200 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:1.0:1789996320.574471:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22200/0x4173739f0fc80f20 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.574477:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22200/0x4173739f0fc80f20 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.574485:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e0861fcfd00) 00010000:00010000:1.0:1789996320.574487:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789996320.574490:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22200/0x4173739f0fc80f20 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.574496:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22200/0x4173739f0fc80f20 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789996320.574744:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0877abc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+56:10540:x1876946927538816:12345-192.168.204.37@tcp:34:lhsmtool_posix.0 Request processed in 922us (1488us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996320.574753:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 113 00000100:00100000:1.0:1789996320.581042:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1789996320.581644:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927539072 00000100:00100000:3.0:1789996320.581657:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927539072 00000100:00100000:3.0:1789996320.581731:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 114 00000100:00100000:3.0:1789996320.581742:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fada680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+56:10540:x1876946927539072:12345-192.168.204.37@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789996320.581763:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789996320.581801:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856600/0x4173739f0fc80f27 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b97003095e35674 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996320.582093:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857c00/0x4173739f0fc80f2e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996320.582110:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857c00/0x4173739f0fc80f2e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996320.582135:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857c00/0x4173739f0fc80f2e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789996320.582148:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1789996320.582240:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857c00/0x4173739f0fc80f2e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996320.582248:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857c00/0x4173739f0fc80f2e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996320.582254:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857c00/0x4173739f0fc80f2e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996320.582260:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e087f857c00 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:3.0:1789996320.582264:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857c00/0x4173739f0fc80f2e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996320.582271:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857c00/0x4173739f0fc80f2e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996320.582282:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e0861fcfd00) 00010000:00010000:3.0:1789996320.582284:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789996320.582289:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857c00/0x4173739f0fc80f2e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996320.582295:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857c00/0x4173739f0fc80f2e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996320.582334:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856600/0x4173739f0fc80f27 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35674 expref: 58 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996320.582354:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e084601b600) 00010000:00010000:3.0:1789996320.582357:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789996320.582362:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856600/0x4173739f0fc80f27 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35674 expref: 58 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996320.582371:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e087f856600, rc 0) 00000100:00100000:3.0:1789996320.582440:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fada680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+57:10540:x1876946927539072:12345-192.168.204.37@tcp:101:lhsmtool_posix.0 Request processed in 700us (1410us total) trans 4294967398 rc 301/301 00000100:00100000:3.0:1789996320.582448:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 114 00000100:00100000:2.0:1789996320.586389:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996320.586638:0:9163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927539200 00000100:00100000:0.0:1789996320.586655:0:9163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927539200 00000100:00100000:0.0:1789996320.586758:0:9163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 115 00000100:00100000:0.0:1789996320.586770:0:9163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0877abe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+57:10540:x1876946927539200:12345-192.168.204.37@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789996320.586825:0:9163:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789996320.586927:0:9163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0877abe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+57:10540:x1876946927539200:12345-192.168.204.37@tcp:53:lhsmtool_posix.0 Request processed in 159us (548us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996320.586935:0:9163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 115 00000100:00100000:0.0:1789996320.594089:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1789996320.602890:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927539456 00000100:00100000:1.0:1789996320.602907:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927539456 00000100:00100000:0.0:1789996320.607672:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 116 00000100:00100000:0.0:1789996320.607689:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e087661b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+57:10540:x1876946927539456:12345-192.168.204.37@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789996320.607712:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789996320.607716:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789996320.607745:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6c00/0x4173739f0fc80ecc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35658 expref: 57 pid: 9163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996320.608382:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e084601b700) 00010000:00010000:0.0:1789996320.608388:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789996320.608405:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7e00/0x4173739f0fc80f3c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b97003095e3567b expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789996320.610108:0:5847:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:0.0:1789996320.610381:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6000/0x4173739f0fc80f43 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996320.610399:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6000/0x4173739f0fc80f43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996320.610424:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6000/0x4173739f0fc80f43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996320.611312:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7e00/0x4173739f0fc80f3c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e3567b expref: 59 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996320.611337:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6000/0x4173739f0fc80f43 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e3567b expref: 58 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996320.611347:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8e0850c28c00) 00010000:00010000:0.0:1789996320.611351:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789996320.611354:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e086fcb6000, rc 0) 00000100:00100000:0.0:1789996320.611565:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e087661b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+58:10540:x1876946927539456:12345-192.168.204.37@tcp:101:lhsmtool_posix.0 Request processed in 3857us (17464us total) trans 4294967399 rc 0/0 00000100:00100000:0.0:1789996320.611573:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 116 00000100:00100000:3.0:1789996320.617191:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1789996320.617352:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927539712 00000100:00100000:1.0:1789996320.617363:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927539712 00000100:00100000:1.0:1789996320.617425:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 117 00000100:00100000:1.0:1789996320.617435:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fabea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+58:10540:x1876946927539712:12345-192.168.204.37@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789996320.617643:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789996320.617686:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6000/0x4173739f0fc80f43 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e3567b expref: 58 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.617705:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8e0850c28c00) 00010000:00010000:1.0:1789996320.617729:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789996320.617762:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22200/0x4173739f0fc80f51 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.617788:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22200/0x4173739f0fc80f51 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.617799:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22200/0x4173739f0fc80f51 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.617840:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22000/0x4173739f0fc80f58 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xb28c7e14 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.617849:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22000/0x4173739f0fc80f58 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xb28c7e14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.617855:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22000/0x4173739f0fc80f58 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xb28c7e14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.618296:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22200/0x4173739f0fc80f51 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.618305:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22200/0x4173739f0fc80f51 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.618312:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22200/0x4173739f0fc80f51 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.618317:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0876a22200 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:1.0:1789996320.618329:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22200/0x4173739f0fc80f51 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.618336:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22200/0x4173739f0fc80f51 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.618345:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e084601b700) 00010000:00010000:1.0:1789996320.618348:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789996320.618352:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22200/0x4173739f0fc80f51 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.618357:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22200/0x4173739f0fc80f51 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.618367:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22000/0x4173739f0fc80f58 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xb28c7e14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.618373:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22000/0x4173739f0fc80f58 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xb28c7e14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.618378:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22000/0x4173739f0fc80f58 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xb28c7e14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.618382:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0876a22000 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:1.0:1789996320.618385:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22000/0x4173739f0fc80f58 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xb28c7e14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.618391:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22000/0x4173739f0fc80f58 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xb28c7e14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.618398:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xb28c7e14 (ffff8e0861fcf600) 00010000:00010000:1.0:1789996320.618401:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789996320.618412:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22000/0x4173739f0fc80f58 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xb28c7e14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.618418:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22000/0x4173739f0fc80f58 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xb28c7e14 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789996320.618768:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fabea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+57:10540:x1876946927539712:12345-192.168.204.37@tcp:36:lhsmtool_posix.0 Request processed in 1331us (1583us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789996320.618786:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 117 00000100:00100000:3.0:1789996320.620835:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1789996320.622285:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927539840 00000100:00100000:1.0:1789996320.622298:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927539840 00000100:00100000:1.0:1789996320.622358:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 118 00000100:00100000:1.0:1789996320.622369:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fabd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+57:10540:x1876946927539840:12345-192.168.204.37@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789996320.622388:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789996320.622410:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23a00/0x4173739f0fc80f5f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b97003095e35682 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.622456:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22a00/0x4173739f0fc80f66 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.622470:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22a00/0x4173739f0fc80f66 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.622482:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22a00/0x4173739f0fc80f66 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.622616:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23a00/0x4173739f0fc80f5f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35682 expref: 59 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.622635:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22a00/0x4173739f0fc80f66 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35682 expref: 58 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.622651:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8e0861fcf200) 00010000:00010000:1.0:1789996320.622654:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789996320.622658:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e0876a22a00, rc 0) 00000100:00100000:1.0:1789996320.622724:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fabd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+58:10540:x1876946927539840:12345-192.168.204.37@tcp:101:lhsmtool_posix.0 Request processed in 356us (1898us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996320.622730:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 118 00000100:00100000:0.0:1789996320.628089:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1789996320.628296:0:9163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927540096 00000100:00100000:3.0:1789996320.628307:0:9163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927540096 00000100:00100000:3.0:1789996320.628414:0:9163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 119 00000100:00100000:3.0:1789996320.628425:0:9163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0876618700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+58:10540:x1876946927540096:12345-192.168.204.37@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789996320.628524:0:9163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857e00/0x4173739f0fc80f6d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996320.628572:0:9163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857e00/0x4173739f0fc80f6d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996320.628586:0:9163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857e00/0x4173739f0fc80f6d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789996320.628867:0:9163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00010000:3.0:1789996320.629343:0:9163:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005d1c63f2 reply state 000000002ad242c0 transno 4294967400 ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857e00/0x4173739f0fc80f6d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789996320.629375:0:9163:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789996320.629720:0:9163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0876618700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+60:10540:x1876946927540096:12345-192.168.204.37@tcp:36:lhsmtool_posix.0 Request processed in 1293us (1636us total) trans 4294967400 rc 0/0 00000100:00100000:3.0:1789996320.629729:0:9163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 119 00010000:00010000:1.0:1789996320.637299:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857e00/0x4173739f0fc80f6d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.637320:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857e00/0x4173739f0fc80f6d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.637327:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857e00/0x4173739f0fc80f6d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.637333:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e087f857e00 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:1.0:1789996320.637338:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857e00/0x4173739f0fc80f6d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.637345:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857e00/0x4173739f0fc80f6d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.637362:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8e0861fcf200) 00010000:00010000:1.0:1789996320.637366:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789996320.637371:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857e00/0x4173739f0fc80f6d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.637377:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857e00/0x4173739f0fc80f6d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789996320.651996:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1789996320.652198:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927540224 00000100:00100000:1.0:1789996320.652207:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927540224 00000100:00100000:1.0:1789996320.652271:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 120 00000100:00100000:1.0:1789996320.652280:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0876619c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+59:10540:x1876946927540224:12345-192.168.204.37@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789996320.652302:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789996320.652322:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23a00/0x4173739f0fc80f74 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b97003095e35689 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.652392:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23a00/0x4173739f0fc80f74 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35689 expref: 60 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.652419:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23a00/0x4173739f0fc80f74 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35689 expref: 60 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.652439:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8e0861fcf200) 00010000:00010000:1.0:1789996320.652442:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789996320.652446:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e0876a23a00, rc 0) 00000100:00100000:1.0:1789996320.652523:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0876619c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+60:10540:x1876946927540224:12345-192.168.204.37@tcp:101:lhsmtool_posix.0 Request processed in 243us (538us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996320.652531:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 120 00000100:00100000:3.0:1789996320.660647:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996320.660760:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927540352 00000100:00100000:2.0:1789996320.660779:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927540352 00000100:00100000:2.0:1789996320.660972:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 37 00000100:00100000:2.0:1789996320.660984:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e08810ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+8:2363:x1876946927540352:12345-192.168.204.37@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1789996320.661287:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e08810ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+9:2363:x1876946927540352:12345-192.168.204.37@tcp:2:lhsmtool_posix.0 Request processed in 304us (821us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1789996320.661295:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 37 00000100:00080000:0.0:1789996320.661807:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789996320.677022:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996320.677180:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927540608 00000100:00100000:0.0:1789996320.677191:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927540608 00000100:00100000:0.0:1789996320.677250:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 30 00000100:00100000:0.0:1789996320.677260:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0877abdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+60:10540:x1876946927540608:12345-192.168.204.37@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789996320.677743:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0877abdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+61:10540:x1876946927540608:12345-192.168.204.37@tcp:35:lhsmtool_posix.0 Request processed in 483us (730us total) trans 4294967401 rc 0/0 00000100:00100000:0.0:1789996320.677759:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 30 00000100:00100000:1.0:1789996320.680391:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996320.680680:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927540864 00000100:00100000:0.0:1789996320.680707:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927540864 00000100:00100000:0.0:1789996320.680784:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 121 00000100:00100000:0.0:1789996320.680796:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fada300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+61:10540:x1876946927540864:12345-192.168.204.37@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789996320.681366:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fada300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+61:10540:x1876946927540864:12345-192.168.204.37@tcp:57:lhsmtool_posix.0 Request processed in 569us (983us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996320.681375:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 121 00000100:00100000:3.0:1789996320.691135:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1789996320.691459:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927540992 00000100:00100000:1.0:1789996320.691479:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927540992 00000100:00100000:1.0:1789996320.691589:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 122 00000100:00100000:1.0:1789996320.691601:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fabf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+61:10540:x1876946927540992:12345-192.168.204.37@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789996320.691623:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789996320.691659:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22200/0x4173739f0fc80f7b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b97003095e35690 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.691743:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22800/0x4173739f0fc80f82 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.691780:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22800/0x4173739f0fc80f82 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.691794:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22800/0x4173739f0fc80f82 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789996320.691844:0:5848:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789996320.691863:0:5848:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22800/0x4173739f0fc80f82 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.691888:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22200/0x4173739f0fc80f7b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35690 expref: 63 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.691906:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22800/0x4173739f0fc80f82 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35690 expref: 62 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.692343:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8e0861fcf200) 00010000:00010000:1.0:1789996320.692348:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1789996320.692351:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e0876a22800, rc 0) 00000100:00100000:1.0:1789996320.692678:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fabf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+62:10540:x1876946927540992:12345-192.168.204.37@tcp:101:lhsmtool_posix.0 Request processed in 1077us (1549us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996320.692687:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 122 00000100:00100000:2.0:1789996320.699292:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1789996320.702283:0:8222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927541120 00000100:00100000:1.0:1789996320.702302:0:8222:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927541120 00000100:00100000:1.0:1789996320.702425:0:8222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 38 00000100:00100000:1.0:1789996320.702437:0:8222:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0877abf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+9:2362:x1876946927541120:12345-192.168.204.37@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789996320.702457:0:8222:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789996320.702480:0:8222:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b492f2a9/0x4173739f0fc80f89 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1b97003095e35697 expref: -99 pid: 8222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789996320.702505:0:8222:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6ab12d21, blocks: 0x1 00010000:00010000:1.0:1789996320.702524:0:8222:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=362s v=(0 0) 00010000:00010000:1.0:1789996320.702528:0:8222:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789996320.702537:0:8222:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b492f2a9/0x4173739f0fc80f89 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35697 expref: 10 pid: 8222 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.702571:0:8222:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b492f2a9/0x4173739f0fc80f89 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35697 expref: 10 pid: 8222 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.702585:0:8222:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e0876a22200, rc 0) 00000100:00100000:1.0:1789996320.702658:0:8222:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0877abf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+10:2362:x1876946927541120:12345-192.168.204.37@tcp:101:lhsmtool_posix.0 Request processed in 224us (3375us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996320.702664:0:8222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 38 00000100:00100000:3.0:1789996320.706987:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996320.707236:0:9163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927541376 00000100:00100000:2.0:1789996320.707247:0:9163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927541376 00000100:00100000:2.0:1789996320.707313:0:9163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 123 00000100:00100000:2.0:1789996320.707323:0:9163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fabe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+62:10540:x1876946927541376:12345-192.168.204.37@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789996320.707448:0:9163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fabe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+62:10540:x1876946927541376:12345-192.168.204.37@tcp:57:lhsmtool_posix.0 Request processed in 126us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996320.707470:0:9163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 123 00000100:00100000:3.0:1789996320.711838:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996320.712289:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927541504 00000100:00100000:2.0:1789996320.712301:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927541504 00000100:00100000:2.0:1789996320.712367:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 39 00000100:00100000:2.0:1789996320.712379:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0876a04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+10:10540:x1876946927541504:12345-192.168.204.37@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789996320.712404:0:6689:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789996320.712426:0:6689:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b48596a8/0x4173739f0fc80f90 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1b97003095e3569e expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996320.712462:0:6689:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b492f2a9/0x4173739f0fc80f89 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35697 expref: 11 pid: 8222 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996320.712472:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789996320.712476:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789996320.712481:0:6689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b48596a8/0x4173739f0fc80f90 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e3569e expref: 11 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996320.712517:0:6689:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b492f2a9/0x4173739f0fc80f89 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35697 expref: 11 pid: 8222 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996320.712530:0:6689:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b492f2a9/0x4173739f0fc80f89 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35697 expref: 11 pid: 8222 timeout: 462 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789996320.712695:0:6689:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0877abfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6689:1876946942231552:192.168.204.37@tcp:104: 00000100:00100000:2.0:1789996320.712814:0:6689:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e087fa28300 going to sleep for 11 seconds 00000100:00100000:3.0:1789996320.723027:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996320.723120:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927541632 00000100:00100000:0.0:1789996320.723130:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927541632 00010000:00010000:0.0:1789996320.723170:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b492f2a9/0x4173739f0fc80f89 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35697 expref: 12 pid: 8222 timeout: 462 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789996320.723221:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 56 00000100:00100000:0.0:1789996320.723231:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0876a07b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+12:2362:x1876946927541632:12345-192.168.204.37@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789996320.723247:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789996320.723270:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b492f2a9/0x4173739f0fc80f89 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35697 expref: 12 pid: 8222 timeout: 462 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996320.723284:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b492f2a9/0x4173739f0fc80f89 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35697 expref: 12 pid: 8222 timeout: 462 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996320.723311:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789996320.723316:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789996320.723324:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b48596a8/0x4173739f0fc80f90 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e3569e expref: 12 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996320.723334:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b48596a8/0x4173739f0fc80f90 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e3569e expref: 12 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996320.723386:0:5831:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000b48596a8/0x4173739f0fc80f90 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e3569e expref: 12 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789996320.723402:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0876618a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5831:1876946942231680:192.168.204.37@tcp:105: 00000100:00100000:0.0:1789996320.723486:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e084892ab40 going to sleep for 11 seconds 00010000:00010000:2.0:1789996320.727484:0:6689:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b492f2a9/0x4173739f0fc80f89 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35697 expref: 12 pid: 8222 timeout: 462 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789996320.727517:0:6689:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0877abfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6689:1876946942231552:192.168.204.37@tcp:104: 00010000:00010000:2.0:1789996320.727608:0:6689:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b48596a8/0x4173739f0fc80f90 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.37@tcp remote: 0x1b97003095e3569e expref: 11 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996320.727625:0:6689:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e0842de5c00, rc 0) 00000100:00100000:2.0:1789996320.727701:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0876a04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+11:10540:x1876946927541504:12345-192.168.204.37@tcp:101:lhsmtool_posix.0 Request processed in 15324us (15882us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996320.727711:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 39 00000100:00100000:0.0:1789996320.740131:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0876618a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5831:1876946942231680:192.168.204.37@tcp:105: 00010000:00010000:0.0:1789996320.740159:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789996320.740224:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0876a07b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+10:2362:x1876946927541632:12345-192.168.204.37@tcp:103:ldlm_bl.0 Request processed in 16992us (17205us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996320.740235:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 56 00000100:00100000:3.0:1789996320.748700:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996320.750077:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927541760 00000100:00100000:0.0:1789996320.750089:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927541760 00002000:00100000:0.0:1789996320.750332:0:6694:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff8e084755fb80 x1876946927541760/t0(0) o4->189efa8a-c7eb-4b69-9afa-1dd36d6775f1@192.168.204.37@tcp:51/0 lens 504/0 e 0 to 0 dl 1789996331 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789996320.750346:0:6694:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8e084755fb80 with x1876946927541760 ext(0->12) 00002000:00010000:0.0:1789996320.750355:0:6694:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8e084755fb80 00000100:00100000:0.0:1789996320.750401:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 2 00000100:00100000:0.0:1789996320.750412:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e084755fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+10:2363:x1876946927541760:12345-192.168.204.37@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1789996320.750986:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e084755fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+12:2363:x1876946927541760:12345-192.168.204.37@tcp:4:lhsmtool_posix.0 Request processed in 573us (2296us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1789996320.751293:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 2 00002000:00100000:0.0:1789996320.751302:0:6694:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff8e084755fb80 x1876946927541760/t4294967308(0) o4->189efa8a-c7eb-4b69-9afa-1dd36d6775f1@192.168.204.37@tcp:51/0 lens 504/448 e 0 to 0 dl 1789996331 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789996320.751325:0:6694:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8e084755fb80 with x1876946927541760 ext(0->12) 00002000:00010000:0.0:1789996320.751330:0:6694:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8e084755fb80 00000100:00100000:3.0:1789996320.756158:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996320.756324:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927541888 00000100:00100000:0.0:1789996320.756334:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927541888 00000100:00100000:0.0:1789996320.756401:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 124 00000100:00100000:0.0:1789996320.756412:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e084755f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+62:10540:x1876946927541888:12345-192.168.204.37@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1789996320.831461:0:5868:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967401 is committed 00000020:00080000:1.0:1789996320.831599:0:5868:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8e084892a6c0 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:1.0:1789996320.831605:0:5868:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8e0846fa9f00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8e084892a540 00000020:00080000:1.0:1789996320.831608:0:5868:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8e0846fa9c00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8e0877ab0800 00000020:00080000:3.0:1789996320.831764:0:5879:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 2 committed batchid 0 00000020:00080000:3.0:1789996320.831997:0:5879:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000004:00080000:1.0:1789996320.832247:0:5868:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:1.0:1789996320.832268:0:5868:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8e0848f67600 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:1.0:1789996320.832284:0:5868:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8e084745b200 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8e085aadd300 00000020:00080000:1.0:1789996320.832286:0:5868:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8e084745bc00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8e0852b2d800 00000004:00080000:1.0:1789996320.832327:0:5868:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:1.0:1789996320.832346:0:5868:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000100:00100000:3.0:1789996320.832623:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789996320.832642:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e084755d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876946942231808:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1789996320.832791:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789996320.832871:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942231808 00000100:00100000:3.0:1789996320.832878:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942231808 00000100:00100000:3.0:1789996320.833049:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789996320.833059:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e084755ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3314:x1876946942231808:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1789996320.833085:0:6688:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00010000:00010000:3.0:1789996320.833306:0:6688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cb4124a3/0x4173739f0fc80f97 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996320.833328:0:6688:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000359ca922/0x4173739f0fc80d59 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e355fd expref: 11 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996320.833351:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1789996320.833356:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789996320.833361:0:6688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cb4124a3/0x4173739f0fc80f97 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996320.833387:0:6688:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000359ca922/0x4173739f0fc80d59 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.204.37@tcp remote: 0x1b97003095e355fd expref: 11 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996320.833402:0:6688:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000359ca922/0x4173739f0fc80d59 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.204.37@tcp remote: 0x1b97003095e355fd expref: 11 pid: 6690 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789996320.833416:0:6688:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e084755df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6688:1876946942232064:192.168.204.37@tcp:104: 00000100:00100000:1.0:1789996320.833573:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789996320.833585:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0877abfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876946942231936:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1789996320.833617:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789996320.833842:0:6688:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0845297e40 going to sleep for 11 seconds 00000100:00080000:3.0:1789996320.833856:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789996320.833870:0:8222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942231936 00000100:00100000:3.0:1789996320.833876:0:8222:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942231936 00000100:00100000:3.0:1789996320.833907:0:8222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789996320.833929:0:8222:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fadb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3313:x1876946942231936:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1789996320.833945:0:8222:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00002000:00010000:3.0:1789996320.833974:0:8222:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6ab12d20, atime: 0x6ab12d20, ctime: 0x6ab12d20, blocks: 0x1 00010000:00010000:3.0:1789996320.833980:0:8222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000003076588/0x4173739f0fc80f9e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996320.833991:0:8222:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=362s v=(0 0) 00010000:00010000:3.0:1789996320.833994:0:8222:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789996320.834008:0:8222:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000003076588/0x4173739f0fc80f9e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996320.834023:0:8222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000003076588/0x4173739f0fc80f9e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996320.834033:0:8222:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000003076588/0x4173739f0fc80f9e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996320.834041:0:8222:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000003076588/0x4173739f0fc80f9e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996320.834061:0:8222:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789996320.834862:0:8222:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fadb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:3313:x1876946942231936:12345-0@lo:6:osp-syn-0-0.0 Request processed in 931us (1240us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1789996320.834870:0:8222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00010000:3.0:1789996320.834903:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789996320.835018:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000003076588/0x4173739f0fc80f9e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996320.835039:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e087f856600 already unused, calling callback (ffffffffc1595910) 00010000:00010000:3.0:1789996320.835043:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000003076588/0x4173739f0fc80f9e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996320.835053:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000003076588/0x4173739f0fc80f9e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996320.835085:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000003076588/0x4173739f0fc80f9e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996320.835093:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000003076588/0x4173739f0fc80f9e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789996320.835264:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e084755f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+15:10540:x1876946927541888:12345-192.168.204.37@tcp:44:lhsmtool_posix.0 Request processed in 78852us (79115us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996320.835273:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 124 00010000:00010000:3.0:1789996320.835368:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789996320.835370:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789996320.835372:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1789996320.835405:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e0877abfb80/2, rc 0, transno 4294967304 00000100:00100000:3.0:1789996320.835411:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0877abfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876946942231936:0@lo:6:osp-syn-0-0.0 00000020:00080000:3.0:1789996320.835433:0:5879:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:3.0:1789996320.835570:0:5879:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:3.0:1789996320.840793:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1789996320.840909:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996320.841006:0:6688:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e084755df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6688:1876946942232064:192.168.204.37@tcp:104: 00010000:00010000:0.0:1789996320.841033:0:6688:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000cb4124a3/0x4173739f0fc80f97 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789996320.841627:0:8222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927542016 00000100:00100000:1.0:1789996320.841635:0:8222:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927542016 00000100:00100000:1.0:1789996320.842325:0:8222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 42 00000100:00100000:1.0:1789996320.842337:0:8222:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e084755e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+12:2363:x1876946927542016:12345-192.168.204.37@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1789996320.842433:0:8520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927542144 00000100:00100000:1.0:1789996320.842438:0:8520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927542144 00010000:00010000:1.0:1789996320.842458:0:8520:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000359ca922/0x4173739f0fc80d59 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.37@tcp remote: 0x1b97003095e355fd expref: 13 pid: 6690 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789996320.842502:0:8520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 57 00000100:00100000:1.0:1789996320.842509:0:8520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e084755c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+13:2363:x1876946927542144:12345-192.168.204.37@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789996320.842520:0:8520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789996320.842526:0:8520:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000359ca922/0x4173739f0fc80d59 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.37@tcp remote: 0x1b97003095e355fd expref: 13 pid: 6690 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.842539:0:8520:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000359ca922/0x4173739f0fc80d59 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.204.37@tcp remote: 0x1b97003095e355fd expref: 13 pid: 6690 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.842581:0:8520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000359ca922/0x4173739f0fc80d59 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.204.37@tcp remote: 0x1b97003095e355fd expref: 13 pid: 6690 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.842613:0:8520:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789996320.842618:0:8520:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789996320.842623:0:8520:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000cb4124a3/0x4173739f0fc80f97 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.842634:0:8520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cb4124a3/0x4173739f0fc80f97 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.843113:0:8520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789996320.843453:0:8520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e084755c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+12:2363:x1876946927542144:12345-192.168.204.37@tcp:103:ldlm_bl.0 Request processed in 938us (2539us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996320.843463:0:8520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 57 00010000:00010000:1.0:1789996320.844097:0:6688:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000cb4124a3/0x4173739f0fc80f97 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.844113:0:6688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cb4124a3/0x4173739f0fc80f97 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.844125:0:6688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cb4124a3/0x4173739f0fc80f97 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.844134:0:6688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cb4124a3/0x4173739f0fc80f97 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.844156:0:6688:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789996320.845207:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e084755ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3314:x1876946942231808:12345-0@lo:6:osp-syn-1-0.0 Request processed in 12145us (12411us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1789996320.845218:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:1.0:1789996320.845258:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789996320.845265:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cb4124a3/0x4173739f0fc80f97 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.845275:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e087f857c00 already unused, calling callback (ffffffffc1595910) 00010000:00010000:1.0:1789996320.845280:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cb4124a3/0x4173739f0fc80f97 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.845290:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cb4124a3/0x4173739f0fc80f97 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.845309:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cb4124a3/0x4173739f0fc80f97 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.845316:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cb4124a3/0x4173739f0fc80f97 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.845338:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789996320.845339:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789996320.845341:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1789996320.847155:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e084755d500/2, rc 0, transno 4294967309 00000100:00100000:3.0:1789996320.847192:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e084755d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876946942231808:0@lo:6:osp-syn-1-0.0 00000001:00080000:0.0:1789996320.948146:0:7659:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000001:00080000:0.0:1789996320.948168:0:7659:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000100:00100000:0.0:1789996320.948295:0:8222:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e084755e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+6:2363:x1876946927542016:12345-192.168.204.37@tcp:16:lhsmtool_posix.0 Request processed in 105954us (107525us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996320.948306:0:8222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 42 00000100:00100000:2.0:1789996320.959719:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996320.960002:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927542400 00000100:00100000:0.0:1789996320.960014:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927542400 00000100:00100000:0.0:1789996320.960078:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 125 00000100:00100000:0.0:1789996320.960090:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0877abc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+15:10540:x1876946927542400:12345-192.168.204.37@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789996320.960155:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789996320.960180:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22800/0x4173739f0fc80f82 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35690 expref: 15 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996320.960215:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8e0861fcf200) 00010000:00010000:0.0:1789996320.960221:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789996320.960260:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6e00/0x4173739f0fc80fa5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996320.960273:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6e00/0x4173739f0fc80fa5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996320.960285:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6e00/0x4173739f0fc80fa5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789996320.960795:0:5846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a5eef9c5 reply state 00000000a11ab6d0 transno 4294967402 ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6e00/0x4173739f0fc80fa5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789996320.960806:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789996320.961261:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0877abc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+16:10540:x1876946927542400:12345-192.168.204.37@tcp:36:lhsmtool_posix.0 Request processed in 1172us (1549us total) trans 4294967402 rc 0/0 00000100:00100000:0.0:1789996320.961270:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 125 00000100:00100000:2.0:1789996320.966341:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1789996320.967114:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927542528 00000100:00100000:3.0:1789996320.967125:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927542528 00000100:00100000:3.0:1789996320.967193:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 43 00000100:00100000:3.0:1789996320.967204:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0877abea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+6:2362:x1876946927542528:12345-192.168.204.37@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1789996320.967524:0:6689:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1789996320.967528:0:6689:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1789996320 00002000:00010000:3.0:1789996320.967531:0:6689:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1789996320 00002000:00010000:3.0:1789996320.967534:0:6689:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1789996321 -> 1789996320 00002000:00010000:3.0:1789996320.968058:0:6689:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1789996320.968186:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0877abea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+7:2362:x1876946927542528:12345-192.168.204.37@tcp:2:lhsmtool_posix.0 Request processed in 980us (1850us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1789996320.968195:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 43 00010000:00010000:1.0:1789996320.970611:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6e00/0x4173739f0fc80fa5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.970630:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6e00/0x4173739f0fc80fa5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.970677:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6e00/0x4173739f0fc80fa5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.970684:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e086fcb6e00 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:1.0:1789996320.970689:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6e00/0x4173739f0fc80fa5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.970698:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6e00/0x4173739f0fc80fa5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.970715:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8e0861fcf200) 00010000:00010000:1.0:1789996320.970719:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789996320.970724:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6e00/0x4173739f0fc80fa5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.970730:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6e00/0x4173739f0fc80fa5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789996320.975031:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1789996320.975123:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927542784 00000100:00100000:1.0:1789996320.975134:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927542784 00000100:00100000:1.0:1789996320.975207:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 126 00000100:00100000:1.0:1789996320.975217:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0877abd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+15:10540:x1876946927542784:12345-192.168.204.37@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1789996320.975295:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22600/0x4173739f0fc80fac lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.975315:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22a00/0x4173739f0fc80f66 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35682 expref: 15 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.975324:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22600/0x4173739f0fc80fac lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.975382:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22a00/0x4173739f0fc80f66 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35682 expref: 15 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.975396:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22a00/0x4173739f0fc80f66 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35682 expref: 15 pid: 5848 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789996320.975413:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fad8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5848:1876946942232192:192.168.204.37@tcp:104: 00000100:00100000:1.0:1789996320.975536:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0870487b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789996320.983861:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fad8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5848:1876946942232192:192.168.204.37@tcp:104: 00010000:00010000:1.0:1789996320.983895:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22600/0x4173739f0fc80fac lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789996320.989718:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1789996320.989825:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927542912 00000100:00100000:1.0:1789996320.989836:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927542912 00010000:00010000:1.0:1789996320.989878:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22a00/0x4173739f0fc80f66 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35682 expref: 16 pid: 5848 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789996320.989925:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 58 00000100:00100000:1.0:1789996320.989936:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0877abf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+16:2362:x1876946927542912:12345-192.168.204.37@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789996320.989950:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789996320.989957:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22a00/0x4173739f0fc80f66 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35682 expref: 16 pid: 5848 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.989970:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22a00/0x4173739f0fc80f66 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35682 expref: 16 pid: 5848 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.990012:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22a00/0x4173739f0fc80f66 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35682 expref: 16 pid: 5848 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.990028:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8e0861fcf200) 00010000:00010000:1.0:1789996320.990033:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22600/0x4173739f0fc80fac lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.990042:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22600/0x4173739f0fc80fac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.990050:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22600/0x4173739f0fc80fac lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.990085:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789996320.990142:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0877abf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+15:2362:x1876946927542912:12345-192.168.204.37@tcp:103:ldlm_bl.0 Request processed in 207us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996320.990150:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 58 00010000:00010000:3.0:1789996320.990422:0:5848:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22600/0x4173739f0fc80fac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996320.990430:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22600/0x4173739f0fc80fac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996320.990461:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22600/0x4173739f0fc80fac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996320.990478:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22600/0x4173739f0fc80fac lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996320.990485:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22600/0x4173739f0fc80fac lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996320.990491:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0876a22600 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:3.0:1789996320.990495:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22600/0x4173739f0fc80fac lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996320.990503:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22600/0x4173739f0fc80fac lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996320.990513:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8e0861fcf200) 00010000:00010000:3.0:1789996320.990516:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1789996320.990520:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22600/0x4173739f0fc80fac lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996320.990527:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22600/0x4173739f0fc80fac lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789996320.990625:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0877abd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+14:10540:x1876946927542784:12345-192.168.204.37@tcp:55:lhsmtool_posix.0 Request processed in 15409us (15605us total) trans 0 rc -22/-22 00000100:00100000:3.0:1789996320.990634:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 126 00000100:00100000:2.0:1789996320.994292:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1789996320.994374:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927543040 00000100:00100000:1.0:1789996320.994385:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927543040 00000100:00100000:1.0:1789996320.994444:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 44 00000100:00100000:1.0:1789996320.994455:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0877abd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+7:2364:x1876946927543040:12345-192.168.204.37@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1789996320.994514:0:6688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000750c79a8/0x4173739f0fc80fb3 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.994534:0:6688:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b48596a8/0x4173739f0fc80f90 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.37@tcp remote: 0x1b97003095e3569e expref: 7 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.994595:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789996320.994600:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789996320.994604:0:6688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000750c79a8/0x4173739f0fc80fb3 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.994640:0:6688:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b48596a8/0x4173739f0fc80f90 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.37@tcp remote: 0x1b97003095e3569e expref: 7 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.994653:0:6688:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b48596a8/0x4173739f0fc80f90 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.37@tcp remote: 0x1b97003095e3569e expref: 7 pid: 6689 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789996320.994682:0:6688:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fad8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6688:1876946942232320:192.168.204.37@tcp:104: 00000100:00100000:1.0:1789996320.994757:0:6688:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0870487b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789996320.997397:0:6688:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fad8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6688:1876946942232320:192.168.204.37@tcp:104: 00010000:00010000:1.0:1789996320.997427:0:6688:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000750c79a8/0x4173739f0fc80fb3 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789996320.998618:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1789996320.998940:0:8520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927543168 00000100:00100000:1.0:1789996320.998949:0:8520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927543168 00010000:00010000:1.0:1789996320.998988:0:8520:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b48596a8/0x4173739f0fc80f90 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.37@tcp remote: 0x1b97003095e3569e expref: 8 pid: 6689 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789996320.999033:0:8520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 59 00000100:00100000:1.0:1789996320.999043:0:8520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0877abed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+8:2363:x1876946927543168:12345-192.168.204.37@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789996320.999081:0:8520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789996320.999111:0:8520:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b48596a8/0x4173739f0fc80f90 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.37@tcp remote: 0x1b97003095e3569e expref: 8 pid: 6689 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.999124:0:8520:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b48596a8/0x4173739f0fc80f90 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.37@tcp remote: 0x1b97003095e3569e expref: 8 pid: 6689 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.999148:0:8520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b48596a8/0x4173739f0fc80f90 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.37@tcp remote: 0x1b97003095e3569e expref: 8 pid: 6689 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.999165:0:8520:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789996320.999169:0:8520:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789996320.999174:0:8520:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000750c79a8/0x4173739f0fc80fb3 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.999182:0:8520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000750c79a8/0x4173739f0fc80fb3 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996320.999223:0:8520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789996320.999284:0:8520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0877abed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+7:2363:x1876946927543168:12345-192.168.204.37@tcp:103:ldlm_bl.0 Request processed in 240us (671us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996320.999291:0:8520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 59 00010000:00010000:2.0:1789996321.000000:0:6688:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000750c79a8/0x4173739f0fc80fb3 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996321.000011:0:6688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000750c79a8/0x4173739f0fc80fb3 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996321.000042:0:6688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000750c79a8/0x4173739f0fc80fb3 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996321.000066:0:6688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000750c79a8/0x4173739f0fc80fb3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996321.000076:0:6688:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000750c79a8/0x4173739f0fc80fb3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996321.000083:0:6688:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0876a22c00 already unused, calling callback (ffffffffc1595910) 00010000:00010000:2.0:1789996321.000088:0:6688:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000750c79a8/0x4173739f0fc80fb3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996321.000098:0:6688:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000750c79a8/0x4173739f0fc80fb3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996321.000115:0:6688:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000750c79a8/0x4173739f0fc80fb3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996321.000123:0:6688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000750c79a8/0x4173739f0fc80fb3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789996321.000196:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0877abd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+6:2364:x1876946927543040:12345-192.168.204.37@tcp:1:lhsmtool_posix.0 Request processed in 5741us (5911us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996321.000205:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 44 00000100:00100000:2.0:1789996321.009883:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996321.013278:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927543424 00000100:00100000:0.0:1789996321.013296:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927543424 00000100:00080000:3.0:1789996321.013375:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789996321.013397:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 127 00000100:00100000:0.0:1789996321.013409:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0877abdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+14:10540:x1876946927543424:12345-192.168.204.37@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1789996321.014802:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22a00/0x4173739f0fc80fba lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996321.014894:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22a00/0x4173739f0fc80fba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996321.014927:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22a00/0x4173739f0fc80fba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996321.015228:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22e00/0x4173739f0fc80fc1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996321.015243:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23a00/0x4173739f0fc80f74 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35689 expref: 15 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996321.015251:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22e00/0x4173739f0fc80fc1 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996321.015292:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23a00/0x4173739f0fc80f74 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35689 expref: 15 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996321.015311:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23a00/0x4173739f0fc80f74 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35689 expref: 15 pid: 5848 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789996321.015330:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fad8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5846:1876946942232448:192.168.204.37@tcp:104: 00000100:00100000:1.0:1789996321.015637:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0870487b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789996321.018733:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fad8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5846:1876946942232448:192.168.204.37@tcp:104: 00010000:00010000:1.0:1789996321.018758:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22e00/0x4173739f0fc80fc1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789996321.020461:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1789996321.021030:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927543552 00000100:00100000:1.0:1789996321.021040:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927543552 00010000:00010000:1.0:1789996321.021084:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23a00/0x4173739f0fc80f74 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35689 expref: 16 pid: 5848 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789996321.021209:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 60 00000100:00100000:1.0:1789996321.021221:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0877abc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+16:2362:x1876946927543552:12345-192.168.204.37@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789996321.021237:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789996321.021245:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23a00/0x4173739f0fc80f74 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35689 expref: 16 pid: 5848 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996321.021257:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23a00/0x4173739f0fc80f74 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35689 expref: 16 pid: 5848 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996321.021280:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23a00/0x4173739f0fc80f74 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35689 expref: 16 pid: 5848 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996321.021295:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8e0861fcf200) 00010000:00010000:1.0:1789996321.021300:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22e00/0x4173739f0fc80fc1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996321.021309:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22e00/0x4173739f0fc80fc1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996321.021316:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22e00/0x4173739f0fc80fc1 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996321.021436:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789996321.021497:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0877abc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+15:2362:x1876946927543552:12345-192.168.204.37@tcp:103:ldlm_bl.0 Request processed in 278us (1044us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996321.021505:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 60 00010000:00010000:3.0:1789996321.022930:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22e00/0x4173739f0fc80fc1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996321.022944:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22e00/0x4173739f0fc80fc1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789996321.023202:0:5846:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:3.0:1789996321.023365:0:5846:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967404 00000001:00080000:3.0:1789996321.023411:0:5846:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:3.0:1789996321.023504:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e084755ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5846:1876946942232576:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1789996321.023744:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789996321.023839:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0845297f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789996321.023935:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942232576 00000100:00100000:1.0:1789996321.023949:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942232576 00000100:00100000:1.0:1789996321.024034:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789996321.024044:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e084755d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5846:x1876946942232576:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1789996321.024158:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e084755d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5846:x1876946942232576:12345-0@lo:1000:mdt00_000.0 Request processed in 115us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996321.024166:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789996321.024250:0:5846:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967309 gen 2 00000004:00080000:0.0:1789996321.024257:0:5846:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967309 00000004:00080000:0.0:1789996321.024275:0:5846:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e084755d500, transno 4294967309 00000100:00100000:0.0:1789996321.024298:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e084755ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5846:1876946942232576:0@lo:1000:mdt00_000.0 00000001:00080000:0.0:1789996321.024858:0:5846:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967406 00000100:00100000:0.0:1789996321.024931:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0876618a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5846:1876946942232704:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1789996321.024971:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996321.028115:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e084a7c9780 going to sleep for 11 seconds 00000100:00100000:3.0:1789996321.028999:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942232704 00000100:00100000:3.0:1789996321.029019:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942232704 00000100:00100000:3.0:1789996321.029094:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789996321.029105:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0876618380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5846:x1876946942232704:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1789996321.029429:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0876618380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5846:x1876946942232704:12345-0@lo:1000:mdt00_000.0 Request processed in 324us (4454us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1789996321.029437:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789996321.029804:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0876618a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5846:1876946942232704:0@lo:1000:mdt00_000.0 00010000:00010000:0.0:1789996321.029919:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22e00/0x4173739f0fc80fc1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996321.029931:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22e00/0x4173739f0fc80fc1 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996321.029939:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22e00/0x4173739f0fc80fc1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996321.029945:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0876a22e00 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:0.0:1789996321.029951:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22e00/0x4173739f0fc80fc1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996321.029958:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22e00/0x4173739f0fc80fc1 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996321.029974:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8e0861fcf200) 00010000:00010000:0.0:1789996321.029977:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789996321.029982:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22e00/0x4173739f0fc80fc1 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996321.029988:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22e00/0x4173739f0fc80fc1 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996321.030018:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6200/0x4173739f0fc80f04 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996321.030025:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6200/0x4173739f0fc80f04 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996321.030045:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6200/0x4173739f0fc80f04 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996321.030050:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e086fcb6200 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:0.0:1789996321.030053:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6200/0x4173739f0fc80f04 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996321.030059:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6200/0x4173739f0fc80f04 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996321.030067:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e0861fcfd00) 00010000:00010000:0.0:1789996321.030070:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789996321.030076:0:5846:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7c00/0x4173739f0fc80f0b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e3566d expref: 18 pid: 9163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996321.030088:0:5846:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7c00/0x4173739f0fc80f0b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e3566d expref: 18 pid: 9163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996321.030097:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7c00/0x4173739f0fc80f0b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e3566d expref: 18 pid: 9163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996321.030129:0:5846:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7c00/0x4173739f0fc80f0b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e3566d expref: 18 pid: 9163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789996321.030144:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0876618e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5846:1876946942232832:192.168.204.37@tcp:105: 00000100:00100000:0.0:1789996321.030219:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e084a7c9780 going to sleep for 11 seconds 00000100:00100000:2.0:1789996321.034008:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996321.034285:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0876618e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5846:1876946942232832:192.168.204.37@tcp:105: 00000100:00100000:3.0:1789996321.034305:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927543680 00000100:00100000:3.0:1789996321.034313:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927543680 00010000:00010000:0.0:1789996321.034322:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6200/0x4173739f0fc80f04 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996321.034332:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6200/0x4173739f0fc80f04 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996321.034363:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7000/0x4173739f0fc80fc8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789996321.034378:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 31 00010000:00010000:0.0:1789996321.034378:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7000/0x4173739f0fc80fc8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789996321.034389:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0877abf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+19:10538:x1876946927543680:12345-192.168.204.37@tcp:49:lfs.0 00010000:00010000:0.0:1789996321.034391:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7000/0x4173739f0fc80fc8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996321.034401:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7000/0x4173739f0fc80fc8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996321.034406:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7000/0x4173739f0fc80fc8 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996321.034412:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7000/0x4173739f0fc80fc8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996321.034417:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e086fcb7000 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:0.0:1789996321.034421:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7000/0x4173739f0fc80fc8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996321.034427:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7000/0x4173739f0fc80fc8 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996321.034437:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e0861fcfd00) 00010000:00010000:0.0:1789996321.034440:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789996321.034449:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7000/0x4173739f0fc80fc8 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996321.034454:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7000/0x4173739f0fc80fc8 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996321.034464:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22a00/0x4173739f0fc80fba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996321.034470:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22a00/0x4173739f0fc80fba lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996321.034476:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22a00/0x4173739f0fc80fba lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996321.034481:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0876a22a00 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:0.0:1789996321.034483:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22a00/0x4173739f0fc80fba lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996321.034488:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22a00/0x4173739f0fc80fba lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996321.034495:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e0861fcfd00) 00010000:00010000:0.0:1789996321.034498:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789996321.034500:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22a00/0x4173739f0fc80fba lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996321.034505:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22a00/0x4173739f0fc80fba lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789996321.035284:0:11698:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789996321.035290:0:11698:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:3.0:1789996321.035818:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0877abf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+19:10538:x1876946927543680:12345-192.168.204.37@tcp:49:lfs.0 Request processed in 180us (569us total) trans 0 rc 0/0 00000040:00080000:0.0:1789996321.035823:0:11698:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000100:00100000:3.0:1789996321.035829:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 31 00000040:00080000:0.0:1789996321.035836:0:11698:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789996321.035923:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0877abdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+18:10540:x1876946927543424:12345-192.168.204.37@tcp:57:lhsmtool_posix.0 Request processed in 22516us (26120us total) trans 4294967407 rc 0/0 00000100:00100000:0.0:1789996321.035932:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 127 00000020:00080000:0.0:1789996321.035936:0:5846:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:2.0:1789996321.042891:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996321.046060:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996321.046238:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927544192 00000100:00100000:0.0:1789996321.046249:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927544192 00000100:00100000:0.0:1789996321.046315:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 128 00000100:00100000:0.0:1789996321.046326:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0877abce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+18:10538:x1876946927544192:12345-192.168.204.37@tcp:58:lfs.0 00000040:00080000:0.0:1789996321.047759:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:0.0:1789996321.047964:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0877abce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+18:10538:x1876946927544192:12345-192.168.204.37@tcp:58:lfs.0 Request processed in 1636us (1908us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996321.047975:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 128 00000100:00100000:1.0:1789996321.050320:0:11495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927543936 00000100:00100000:1.0:1789996321.050336:0:11495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927543936 00000100:00100000:1.0:1789996321.050413:0:11495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 32 00000100:00100000:1.0:1789996321.050424:0:11495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0850a20450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+18:10540:x1876946927543936:12345-192.168.204.37@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1789996321.052295:0:11495:0:(mdd_object.c:4178:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1789996321.052402:0:11495:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967408 00010000:00010000:2.0:1789996321.052468:0:11495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5a00/0x4173739f0fc80fcf lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996321.052485:0:11495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5a00/0x4173739f0fc80fcf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 11495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996321.052496:0:11495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5a00/0x4173739f0fc80fcf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 11495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996321.052505:0:11495:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5a00/0x4173739f0fc80fcf lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 11495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996321.052511:0:11495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5a00/0x4173739f0fc80fcf lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 11495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996321.052518:0:11495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5a00/0x4173739f0fc80fcf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 11495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996321.052562:0:11495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789996321.052675:0:11495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0850a20450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+20:10540:x1876946927543936:12345-192.168.204.37@tcp:35:lhsmtool_posix.0 Request processed in 2248us (9789us total) trans 4294967409 rc 0/0 00000100:00100000:2.0:1789996321.052684:0:11495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 32 00000020:00080000:2.0:1789996321.052690:0:11495:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789996321.053384:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789996321.053394:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5a00/0x4173739f0fc80fcf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 11495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996321.053402:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0842de5a00 already unused, calling callback (ffffffffc1595910) 00010000:00010000:3.0:1789996321.053406:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5a00/0x4173739f0fc80fcf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 11495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996321.053414:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5a00/0x4173739f0fc80fcf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 11495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996321.053429:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8e084601bf00) 00010000:00010000:3.0:1789996321.053433:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789996321.053438:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5a00/0x4173739f0fc80fcf lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 11495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996321.053444:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5a00/0x4173739f0fc80fcf lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 11495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996321.053463:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789996321.053464:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789996321.053466:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789996321.081487:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1789996321.081581:0:9163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927544320 00000100:00100000:3.0:1789996321.081593:0:9163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927544320 00000100:00100000:3.0:1789996321.081718:0:9163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 129 00000100:00100000:3.0:1789996321.081731:0:9163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0877abdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+20:10542:x1876946927544320:12345-192.168.204.37@tcp:101:lfs.0 00010000:00010000:3.0:1789996321.081760:0:9163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789996321.081820:0:9163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857c00/0x4173739f0fc80fd6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b97003095e356a5 expref: -99 pid: 9163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996321.081886:0:9163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856600/0x4173739f0fc80fdd lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996321.081901:0:9163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856600/0x4173739f0fc80fdd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996321.081913:0:9163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856600/0x4173739f0fc80fdd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996321.081928:0:9163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857e00/0x4173739f0fc80fe4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996321.081935:0:9163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857e00/0x4173739f0fc80fe4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996321.081940:0:9163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857e00/0x4173739f0fc80fe4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996321.082176:0:9163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856400/0x4173739f0fc80feb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996321.082189:0:9163:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23800/0x4173739f0fc80ef6 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35666 expref: 21 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996321.082198:0:9163:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856400/0x4173739f0fc80feb lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996321.082233:0:9163:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23800/0x4173739f0fc80ef6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35666 expref: 21 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996321.082973:0:9163:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23800/0x4173739f0fc80ef6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35666 expref: 21 pid: 5846 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789996321.082992:0:9163:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e084755c380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9163:1876946942232960:192.168.204.37@tcp:104: 00000100:00100000:1.0:1789996321.085296:0:9163:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0742b28780 going to sleep for 11 seconds 00000100:00100000:0.0:1789996321.092084:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996321.092154:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927544576 00000100:00100000:2.0:1789996321.092166:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927544576 00000100:00100000:2.0:1789996321.092231:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 33 00000100:00100000:2.0:1789996321.092242:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0876618e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+22:5598:x1876946927544576:12345-192.168.204.37@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1789996321.092530:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0876618e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+23:5598:x1876946927544576:12345-192.168.204.37@tcp:35:ldlm_bl.0 Request processed in 289us (469us total) trans 4294967410 rc 0/0 00000100:00100000:2.0:1789996321.092538:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 33 00000100:00100000:1.0:1789996321.092679:0:9163:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e084755c380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9163:1876946942232960:192.168.204.37@tcp:104: 00010000:00010000:1.0:1789996321.092713:0:9163:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856400/0x4173739f0fc80feb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789996321.095193:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1789996321.095292:0:8520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927544704 00000100:00100000:1.0:1789996321.095303:0:8520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927544704 00010000:00010000:1.0:1789996321.095344:0:8520:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23800/0x4173739f0fc80ef6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35666 expref: 23 pid: 5846 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789996321.095389:0:8520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 61 00000100:00100000:1.0:1789996321.095399:0:8520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e087059a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+23:2363:x1876946927544704:12345-192.168.204.37@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789996321.095415:0:8520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789996321.095423:0:8520:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23800/0x4173739f0fc80ef6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35666 expref: 23 pid: 5846 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996321.095435:0:8520:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23800/0x4173739f0fc80ef6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35666 expref: 23 pid: 5846 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996321.095474:0:8520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23800/0x4173739f0fc80ef6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35666 expref: 23 pid: 5846 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996321.095490:0:8520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e0861fcfd00) 00010000:00010000:1.0:1789996321.095495:0:8520:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856400/0x4173739f0fc80feb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996321.095505:0:8520:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856400/0x4173739f0fc80feb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996321.095513:0:8520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856400/0x4173739f0fc80feb lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996321.095589:0:8520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789996321.095652:0:8520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e087059a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+22:2363:x1876946927544704:12345-192.168.204.37@tcp:103:ldlm_bl.0 Request processed in 254us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996321.095672:0:8520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 61 00010000:00010000:2.0:1789996321.095780:0:9163:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856400/0x4173739f0fc80feb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996321.095790:0:9163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856400/0x4173739f0fc80feb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789996321.095843:0:9163:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1789996321.095848:0:9163:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789996321.095868:0:9163:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856400/0x4173739f0fc80feb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996321.095880:0:9163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856400/0x4173739f0fc80feb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996321.095889:0:9163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856600/0x4173739f0fc80fdd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996321.095895:0:9163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856600/0x4173739f0fc80fdd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996321.095902:0:9163:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856600/0x4173739f0fc80fdd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996321.095907:0:9163:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e087f856600 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:2.0:1789996321.095911:0:9163:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856600/0x4173739f0fc80fdd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996321.095918:0:9163:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856600/0x4173739f0fc80fdd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996321.095935:0:9163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e084601b700) 00010000:00010000:2.0:1789996321.095938:0:9163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789996321.095943:0:9163:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856600/0x4173739f0fc80fdd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996321.095948:0:9163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856600/0x4173739f0fc80fdd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996321.095959:0:9163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857e00/0x4173739f0fc80fe4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996321.095965:0:9163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857e00/0x4173739f0fc80fe4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996321.095970:0:9163:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857e00/0x4173739f0fc80fe4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996321.095974:0:9163:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e087f857e00 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:2.0:1789996321.095976:0:9163:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857e00/0x4173739f0fc80fe4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996321.095982:0:9163:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857e00/0x4173739f0fc80fe4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996321.095988:0:9163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8e0846583c00) 00010000:00010000:2.0:1789996321.095990:0:9163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789996321.095992:0:9163:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857e00/0x4173739f0fc80fe4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996321.095997:0:9163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857e00/0x4173739f0fc80fe4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996321.096057:0:9163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857c00/0x4173739f0fc80fd6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e356a5 expref: 22 pid: 9163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996321.096071:0:9163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856400/0x4173739f0fc80feb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e356a5 expref: 21 pid: 9163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996321.096078:0:9163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e0861fcfd00) 00010000:00010000:2.0:1789996321.096081:0:9163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789996321.096084:0:9163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e087f856400, rc 0) 00000100:00100000:2.0:1789996321.096158:0:9163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0877abdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+21:10542:x1876946927544320:12345-192.168.204.37@tcp:101:lfs.0 Request processed in 14429us (14683us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996321.096165:0:9163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 129 00010000:00010000:1.0:1789996321.129609:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789996321.828395:0:12069:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789996321.828406:0:12069:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789996321.828450:0:12069:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1789996321.828455:0:12069:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:0.0:1789996321.837035:0:6715:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000001:00080000:0.0:1789996321.837050:0:6715:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000001:00080000:0.0:1789996321.837056:0:6715:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000001:00080000:0.0:1789996321.837067:0:6715:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000040:00080000:0.0:1789996322.088819:0:11698:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789996322.088829:0:11698:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789996322.088884:0:11698:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1789996322.088891:0:11698:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789996322.089018:0:11698:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e087f9baa00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11698:1876946942233088:192.168.204.37@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789996322.089144:0:11698:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0845297300 going to sleep for 11 seconds 00000100:00100000:2.0:1789996322.095673:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1789996322.095756:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927544832 00000100:00100000:3.0:1789996322.095765:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927544832 00000100:00100000:3.0:1789996322.095894:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 130 00000100:00100000:3.0:1789996322.095906:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0877abf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+22:10554:x1876946927544832:12345-192.168.204.37@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789996322.095942:0:5848:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789996322.096058:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0877abf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+22:10554:x1876946927544832:12345-192.168.204.37@tcp:53:lhsmtool_posix.0 Request processed in 154us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996322.096066:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 130 00000100:00100000:0.0:1789996322.098174:0:11698:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e087f9baa00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11698:1876946942233088:192.168.204.37@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789996322.098689:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996322.098775:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927545088 00000100:00100000:0.0:1789996322.098790:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927545088 00000100:00100000:0.0:1789996322.098842:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 131 00000100:00100000:0.0:1789996322.098851:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0877abca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+21:10554:x1876946927545088:12345-192.168.204.37@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789996322.098870:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789996322.098893:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7800/0x4173739f0fc80ff2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b97003095e356ac expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996322.098987:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6600/0x4173739f0fc80ff9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996322.099001:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6600/0x4173739f0fc80ff9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996322.099015:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6600/0x4173739f0fc80ff9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789996322.099027:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1789996322.099123:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7800/0x4173739f0fc80ff2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e356ac expref: 24 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996322.099141:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6600/0x4173739f0fc80ff9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e356ac expref: 23 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996322.099149:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e0861fcfd00) 00010000:00010000:0.0:1789996322.099152:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789996322.099156:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e086fcb6600, rc 0) 00000100:00100000:0.0:1789996322.099220:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0877abca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+23:10554:x1876946927545088:12345-192.168.204.37@tcp:101:lhsmtool_posix.0 Request processed in 369us (533us total) trans 4294967411 rc 0/0 00000100:00100000:0.0:1789996322.099242:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 131 00000100:00100000:1.0:1789996322.105232:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996322.105355:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927545216 00000100:00100000:0.0:1789996322.105363:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927545216 00000100:00100000:0.0:1789996322.105432:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 8 00000100:00100000:0.0:1789996322.105443:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fad8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+23:2365:x1876946927545216:12345-192.168.204.37@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789996322.105458:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789996322.105485:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6600/0x4173739f0fc80ff9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e356ac expref: 23 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996322.105503:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e0861fcfd00) 00010000:00010000:0.0:1789996322.105508:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789996322.105697:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fad8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+22:2365:x1876946927545216:12345-192.168.204.37@tcp:103:ldlm_bl.0 Request processed in 255us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996322.105705:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 8 00000100:00100000:3.0:1789996322.109957:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1789996322.110240:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927545472 00000100:00100000:1.0:1789996322.110250:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927545472 00000100:00100000:1.0:1789996322.110309:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 132 00000100:00100000:1.0:1789996322.110320:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e084755c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+22:10554:x1876946927545472:12345-192.168.204.37@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1789996322.110397:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23400/0x4173739f0fc81007 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996322.110415:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23400/0x4173739f0fc81007 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996322.110446:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23400/0x4173739f0fc81007 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996322.110949:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23400/0x4173739f0fc81007 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996322.110957:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23400/0x4173739f0fc81007 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996322.110964:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23400/0x4173739f0fc81007 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996322.110971:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0876a23400 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:1.0:1789996322.110975:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23400/0x4173739f0fc81007 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996322.110983:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23400/0x4173739f0fc81007 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996322.110996:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e0861fcfd00) 00010000:00010000:1.0:1789996322.110998:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789996322.111004:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23400/0x4173739f0fc81007 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996322.111010:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23400/0x4173739f0fc81007 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789996322.113906:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e084755c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+23:10554:x1876946927545472:12345-192.168.204.37@tcp:57:lhsmtool_posix.0 Request processed in 3576us (3948us total) trans 4294967412 rc 0/0 00000100:00100000:1.0:1789996322.113920:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 132 00000040:00080000:0.0:1789996322.117357:0:11698:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789996322.117366:0:11698:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789996322.119021:0:11698:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1789996322.119038:0:11698:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789996322.123732:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996322.123949:0:11495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927545728 00000100:00100000:0.0:1789996322.123959:0:11495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927545728 00000100:00100000:0.0:1789996322.124016:0:11495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 34 00000100:00100000:0.0:1789996322.124027:0:11495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0877abe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+23:10554:x1876946927545728:12345-192.168.204.37@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789996322.124248:0:11495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0877abe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+24:10554:x1876946927545728:12345-192.168.204.37@tcp:35:lhsmtool_posix.0 Request processed in 222us (525us total) trans 4294967413 rc 0/0 00000100:00100000:0.0:1789996322.124257:0:11495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 34 00010000:00010000:3.0:1789996322.152937:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789996322.793070:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789996322.793103:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fadad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876946942233216:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789996322.793195:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996322.793308:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942233216 00000100:00100000:2.0:1789996322.793317:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942233216 00000100:00080000:1.0:1789996322.793385:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789996322.796942:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789996322.796980:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e084755c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1876946942233216:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789996322.797022:0:6692:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789996322.797470:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e084755c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1876946942233216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 514us (4274us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996322.797478:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789996322.797596:0:3316:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:3.0:1789996322.797603:0:3316:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967304 00000004:00080000:3.0:1789996322.797625:0:3316:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e0877b7e680, transno 4294967301 00000004:00080000:3.0:1789996322.797641:0:3316:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:3.0:1789996322.797652:0:3316:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e0877abfb80, transno 4294967304 00000100:00100000:3.0:1789996322.797665:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fadad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876946942233216:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789996323.176942:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789996323.625392:0:12121:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789996323.625401:0:12121:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789996323.625458:0:12121:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1789996323.625470:0:12121:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789996323.632269:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996323.632309:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996323.632333:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996323.632348:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996323.632379:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996323.632408:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927546112 00000100:00100000:2.0:1789996323.632418:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927546112 00000100:00100000:2.0:1789996323.632472:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927546240 00000100:00100000:2.0:1789996323.632633:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927546240 00000100:00100000:2.0:1789996323.632661:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 70 00000100:00100000:2.0:1789996323.632670:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0877abfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+5:2362:x1876946927546112:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:2.0:1789996323.632752:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0877abfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+5:2362:x1876946927546112:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 82us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996323.632759:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 70 00000100:00100000:2.0:1789996323.632777:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 71 00000100:00100000:2.0:1789996323.632784:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0877abc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+6:2362:x1876946927546240:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:2.0:1789996323.632809:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0877abc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+6:2362:x1876946927546240:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 26us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996323.632815:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 71 00000100:00100000:2.0:1789996323.632833:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927546368 00000100:00100000:2.0:1789996323.632836:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927546368 00000100:00100000:2.0:1789996323.632858:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927545984 00000100:00100000:2.0:1789996323.632860:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927545984 00000100:00100000:2.0:1789996323.632877:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 128 00000100:00100000:2.0:1789996323.632883:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0877abf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cfc759a1-09a6-40ba-80a8-7399de51b555+5:2362:x1876946927546368:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:2.0:1789996323.632908:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0877abf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cfc759a1-09a6-40ba-80a8-7399de51b555+5:2362:x1876946927546368:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 25us (575us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996323.632920:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 128 00000100:00100000:2.0:1789996323.632932:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 129 00000100:00100000:2.0:1789996323.632937:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0877abed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+24:2362:x1876946927545984:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:2.0:1789996323.632961:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0877abed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+24:2362:x1876946927545984:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 24us (612us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996323.632967:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 129 00000100:00080000:2.0:1789996323.632985:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789996323.632990:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789996323.632991:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789996323.633472:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927545856 00000100:00100000:3.0:1789996323.633623:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927545856 00000100:00100000:3.0:1789996323.633659:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 284 00000100:00100000:3.0:1789996323.633666:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852ba1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f78f7903-47ba-48a7-bb82-1f616cb85fc0+13:2362:x1876946927545856:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:3.0:1789996323.633703:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852ba1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f78f7903-47ba-48a7-bb82-1f616cb85fc0+13:2362:x1876946927545856:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 38us (1442us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996323.633709:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 284 00000100:00100000:2.0:1789996323.779202:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996323.779290:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927546624 00000100:00100000:0.0:1789996323.780148:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927546624 00000100:00100000:0.0:1789996323.780218:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 133 00000100:00100000:0.0:1789996323.780229:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0877abd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+24:10574:x1876946927546624:12345-192.168.204.37@tcp:101:lfs.0 00010000:00010000:0.0:1789996323.780249:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789996323.780267:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7000/0x4173739f0fc8100e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b97003095e356b3 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996323.780359:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7a00/0x4173739f0fc81015 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996323.780373:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7a00/0x4173739f0fc81015 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996323.780386:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7a00/0x4173739f0fc81015 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789996323.780397:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1789996323.780523:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7000/0x4173739f0fc8100e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e356b3 expref: 27 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996323.780557:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7a00/0x4173739f0fc81015 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e356b3 expref: 26 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996323.780566:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e0861fcfd00) 00010000:00010000:0.0:1789996323.780570:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1789996323.780573:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e086fcb7a00, rc 0) 00000100:00100000:0.0:1789996323.780638:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0877abd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+26:10574:x1876946927546624:12345-192.168.204.37@tcp:101:lfs.0 Request processed in 410us (1447us total) trans 4294967414 rc 0/0 00000100:00100000:0.0:1789996323.781488:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 133 00000100:00100000:2.0:1789996323.784265:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996323.784340:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927546752 00000100:00100000:0.0:1789996323.784349:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927546752 00000100:00100000:0.0:1789996323.784403:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 134 00000100:00100000:0.0:1789996323.784414:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fabf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+26:10574:x1876946927546752:12345-192.168.204.37@tcp:54:lfs.0 00010000:00010000:0.0:1789996323.784587:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6e00/0x4173739f0fc81023 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996323.784604:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6e00/0x4173739f0fc81023 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996323.784616:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6e00/0x4173739f0fc81023 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996323.784719:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6e00/0x4173739f0fc81023 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996323.784728:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6e00/0x4173739f0fc81023 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996323.784735:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6e00/0x4173739f0fc81023 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996323.784742:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e086fcb6e00 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:0.0:1789996323.784747:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6e00/0x4173739f0fc81023 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996323.784754:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6e00/0x4173739f0fc81023 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996323.784766:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e0861fcfd00) 00010000:00010000:0.0:1789996323.784781:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789996323.784787:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6e00/0x4173739f0fc81023 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996323.784793:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6e00/0x4173739f0fc81023 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789996323.784898:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fabf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+26:10574:x1876946927546752:12345-192.168.204.37@tcp:54:lfs.0 Request processed in 485us (641us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996323.784906:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 134 00000100:00100000:1.0:1789996323.817297:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fabd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876946942233472:0@lo:400:kworker.0 00000100:00100000:0.0:1789996323.817330:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e08810a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876946942233728:0@lo:400:kworker.0 00000100:00100000:3.0:1789996323.817400:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fabed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e0c28cd8-555e-481f-bd03-c3b02aee51c5:3316:1876946942233344:0@lo:400:kworker.0 00000100:00100000:2.0:1789996323.818153:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e08810ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3314:1876946942233600:0@lo:400:kworker.0 00000100:00100000:0.0:1789996323.818217:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996323.818303:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942233728 00000100:00100000:0.0:1789996323.818311:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942233728 00000100:00100000:0.0:1789996323.818357:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789996323.818367:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e087f9baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1876946942233728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789996323.818417:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e087f9baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1876946942233728:12345-0@lo:400:kworker.0 Request processed in 52us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996323.818424:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789996323.818442:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996323.818465:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fa71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876946942233984:0@lo:400:kworker.0 00000100:00100000:0.0:1789996323.818466:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e08810a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876946942233728:0@lo:400:kworker.0 00000100:00100000:1.0:1789996323.818499:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996323.818603:0:8222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942233984 00000100:00100000:0.0:1789996323.818607:0:8222:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942233984 00000100:00100000:0.0:1789996323.818648:0:8222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789996323.818655:0:8222:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fadad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3313:x1876946942233984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789996323.818695:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996323.818706:0:8222:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fadad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3313:x1876946942233984:12345-0@lo:400:kworker.0 Request processed in 51us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996323.818727:0:8222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789996323.818744:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e08810a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3316:1876946942233856:0@lo:400:kworker.0 00000100:00100000:0.0:1789996323.818762:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fa71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876946942233984:0@lo:400:kworker.0 00000100:00100000:3.0:1789996323.818776:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996323.818818:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942233472 00000100:00100000:0.0:1789996323.818823:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942233472 00000100:00100000:0.0:1789996323.818846:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942233856 00000100:00100000:0.0:1789996323.818849:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942233856 00000100:00100000:0.0:1789996323.818866:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1789996323.818871:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fad9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876946942233472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789996323.818904:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fad9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876946942233472:12345-0@lo:400:kworker.0 Request processed in 32us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996323.818909:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1789996323.818919:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1789996323.818925:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e084755d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1876946942233856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789996323.819096:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942233344 00000100:00100000:3.0:1789996323.819101:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942233344 00000100:00080000:1.0:1789996323.819113:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789996323.819120:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789996323.819134:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:3.0:1789996323.819142:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852ba1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+19:3316:x1876946942233344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789996323.820635:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996323.821292:0:9163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942233600 00000100:00100000:2.0:1789996323.821301:0:9163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942233600 00000100:00100000:2.0:1789996323.821363:0:9163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1789996323.821372:0:9163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fa71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876946942233600:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1789996323.821397:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789996323.821434:0:9163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fa71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876946942233600:12345-0@lo:400:kworker.0 Request processed in 62us (804us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996323.821442:0:9163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1789996323.821464:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e08810ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3314:1876946942233600:0@lo:400:kworker.0 00000100:00100000:3.0:1789996323.822177:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852ba1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+19:3316:x1876946942233344:12345-0@lo:400:kworker.0 Request processed in 3033us (3481us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996323.822187:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:2.0:1789996323.822596:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fabed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e0c28cd8-555e-481f-bd03-c3b02aee51c5:3316:1876946942233344:0@lo:400:kworker.0 00000100:00100000:1.0:1789996323.823789:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fabd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876946942233472:0@lo:400:kworker.0 00000100:00100000:2.0:1789996323.824091:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e08810a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3316:1876946942233856:0@lo:400:kworker.0 00000100:00100000:0.0:1789996323.824094:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e084755d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1876946942233856:12345-0@lo:400:kworker.0 Request processed in 5165us (5315us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996323.824106:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1789996323.856033:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996323.856259:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927546880 00000100:00100000:0.0:1789996323.856271:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927546880 00000100:00100000:0.0:1789996323.856332:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 45 00000100:00100000:0.0:1789996323.856344:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fad9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+6:2364:x1876946927546880:12345-192.168.204.37@tcp:101:cat.0 00010000:00010000:0.0:1789996323.856361:0:6690:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789996323.856380:0:6690:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000754eb88/0x4173739f0fc8102a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1b97003095e356ba expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789996323.856408:0:6690:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6ab12d20, atime: 0x6ab12d20, ctime: 0x6ab12d20, blocks: 0xb 00010000:00010000:0.0:1789996323.856428:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=365s v=(0 0) 00010000:00010000:0.0:1789996323.856432:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789996323.856442:0:6690:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000754eb88/0x4173739f0fc8102a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e356ba expref: 7 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996323.856477:0:6690:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000754eb88/0x4173739f0fc8102a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e356ba expref: 7 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996323.857250:0:6690:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e086fcb6e00, rc 0) 00000100:00100000:1.0:1789996323.857456:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fad9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+7:2364:x1876946927546880:12345-192.168.204.37@tcp:101:cat.0 Request processed in 1110us (1429us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996323.857465:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 45 00000100:00100000:2.0:1789996323.864850:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996323.864986:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927547008 00000100:00100000:0.0:1789996323.864997:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927547008 00002000:00100000:0.0:1789996323.865045:0:6693:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff8e086fa92300 x1876946927547008/t0(0) o3->189efa8a-c7eb-4b69-9afa-1dd36d6775f1@192.168.204.37@tcp:54/0 lens 488/0 e 0 to 0 dl 1789996334 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789996323.865055:0:6693:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8e086fa92300 with x1876946927547008 ext(0->4095) 00002000:00010000:0.0:1789996323.865061:0:6693:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8e086fa92300 00000100:00100000:0.0:1789996323.865090:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 3 00000100:00100000:0.0:1789996323.865098:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fa92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+7:2364:x1876946927547008:12345-192.168.204.37@tcp:3:cat.0 00000100:00100000:0.0:1789996323.865323:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fa92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+7:2364:x1876946927547008:12345-192.168.204.37@tcp:3:cat.0 Request processed in 224us (483us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1789996323.865331:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 3 00002000:00100000:0.0:1789996323.865338:0:6693:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff8e086fa92300 x1876946927547008/t0(0) o3->189efa8a-c7eb-4b69-9afa-1dd36d6775f1@192.168.204.37@tcp:54/0 lens 488/4536 e 0 to 0 dl 1789996334 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789996323.865347:0:6693:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8e086fa92300 with x1876946927547008 ext(0->4095) 00002000:00010000:0.0:1789996323.865350:0:6693:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8e086fa92300 00010000:00010000:0.0:1789996324.203530:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1789996324.330219:0:8107:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 366049672842ns, next at 367049670843ns, rc = 0 00000100:00100000:2.0:1789996324.330624:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789996324.330665:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e087f9b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876946942234112:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789996324.330755:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996324.330913:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942234112 00000100:00100000:0.0:1789996324.330933:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942234112 00000100:00100000:0.0:1789996324.330996:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789996324.331005:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fde9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1876946942234112:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789996324.331146:0:6692:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789996324.336290:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fde9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1876946942234112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 5277us (5526us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996324.336383:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789996324.336644:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e087f9b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876946942234112:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789996325.225998:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789996325.907333:0:7659:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000001:00080000:1.0:1789996325.907350:0:7659:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000004:00080000:3.0:1789996325.921383:0:5868:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000001:00080000:3.0:1789996325.921415:0:5868:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:3.0:1789996325.921432:0:5868:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8e084a7c93c0 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:3.0:1789996325.921438:0:5868:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8e0846fa9100 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8e084a7c9840 00000020:00080000:3.0:1789996325.921441:0:5868:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8e0846fa9700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8e08811e0000 00000020:00080000:3.0:1789996325.921503:0:5868:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:3.0:1789996325.921508:0:5868:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 2 batchid updated 00000020:00080000:3.0:1789996325.921520:0:5879:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:3.0:1789996325.921810:0:5879:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000100:00100000:2.0:1789996325.922197:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789996325.922220:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fdeb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876946942234240:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1789996325.922298:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996325.922367:0:8222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942234240 00000100:00100000:2.0:1789996325.922375:0:8222:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942234240 00000100:00100000:2.0:1789996325.922429:0:8222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789996325.922439:0:8222:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0741837b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3316:x1876946942234240:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1789996325.922977:0:8222:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1789996325.922982:0:8222:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 1789996320 -> 1789996320 00002000:00010000:2.0:1789996325.922985:0:8222:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 1789996320 -> 1789996320 00002000:00010000:2.0:1789996325.922987:0:8222:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1789996320 -> 1789996320 00002000:00010000:2.0:1789996325.922989:0:8222:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1789996325.923035:0:8222:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0741837b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3316:x1876946942234240:12345-0@lo:2:osp-syn-1-0.0 Request processed in 597us (736us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1789996325.923043:0:8222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789996325.923086:0:3316:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:2.0:1789996325.923091:0:3316:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967311 committed transno 4294967311 00000100:00100000:2.0:1789996325.923110:0:3316:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff8e086fdeb100 x1876946942234240/t4294967312(4294967312) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1789996341 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1789996325.923122:0:3316:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e086fdeb100/2, rc 0, transno 4294967312 00000100:00100000:2.0:1789996325.923127:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fdeb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876946942234240:0@lo:2:osp-syn-1-0.0 00000100:00080000:0.0:1789996325.923298:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1789996326.248845:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789996326.249009:0:11698:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789996326.249016:0:11698:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789996326.249076:0:11698:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1789996326.249083:0:11698:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1789996327.275434:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789996327.912968:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789996327.912993:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fabed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876946942234368:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789996327.913068:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996327.913197:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942234368 00000100:00100000:1.0:1789996327.913206:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942234368 00000100:00100000:1.0:1789996327.913272:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789996327.913283:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e084755ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876946942234368:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789996327.913318:0:6691:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789996327.913366:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e084755ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876946942234368:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996327.913373:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:0.0:1789996327.913406:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789996327.913438:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fabed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876946942234368:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789996327.986370:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1789996327.986490:0:9163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927547136 00000100:00100000:3.0:1789996327.986501:0:9163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927547136 00000100:00100000:3.0:1789996327.986622:0:9163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 135 00000100:00100000:3.0:1789996327.986651:0:9163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0741835880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+13:10227:x1876946927547136:12345-192.168.204.37@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1789996327.986761:0:9163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0741835880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+13:10227:x1876946927547136:12345-192.168.204.37@tcp:60:lhsmtool_posix.0 Request processed in 113us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996327.986769:0:9163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 135 00000100:00080000:1.0:1789996327.987431:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789996327.992173:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1789996327.992777:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927547392 00000100:00100000:3.0:1789996327.992788:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927547392 00000100:00100000:3.0:1789996327.992850:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 35 00000100:00100000:3.0:1789996327.992861:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fabed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+13:10227:x1876946927547392:12345-192.168.204.37@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789996327.993191:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fabed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+14:10227:x1876946927547392:12345-192.168.204.37@tcp:35:lhsmtool_posix.0 Request processed in 330us (1026us total) trans 4294967415 rc 0/0 00000100:00100000:3.0:1789996327.993200:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 35 00010000:00010000:0.0:1789996328.298600:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789996328.748346:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996328.748412:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996328.748450:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996328.748481:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996328.748505:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1789996328.748534:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927548032 00000100:00100000:1.0:1789996328.748574:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927548032 00000100:00100000:1.0:1789996328.748651:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927547648 00000100:00100000:1.0:1789996328.748655:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927547648 00000100:00100000:1.0:1789996328.748688:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 133 00000100:00100000:1.0:1789996328.748699:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e087f828e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cfc759a1-09a6-40ba-80a8-7399de51b555+5:2365:x1876946927548032:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:0.0:1789996328.748725:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927547520 00000100:00100000:0.0:1789996328.748732:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927547520 00000100:00100000:0.0:1789996328.748768:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 286 00000100:00100000:0.0:1789996328.748778:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852ba1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f78f7903-47ba-48a7-bb82-1f616cb85fc0+13:2365:x1876946927547520:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:1.0:1789996328.748784:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e087f828e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cfc759a1-09a6-40ba-80a8-7399de51b555+5:2365:x1876946927548032:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 84us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996328.748793:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 133 00000100:00100000:1.0:1789996328.748814:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 134 00000100:00100000:0.0:1789996328.748820:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852ba1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f78f7903-47ba-48a7-bb82-1f616cb85fc0+13:2365:x1876946927547520:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 41us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996328.748827:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e087f828000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+14:2365:x1876946927547648:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:0.0:1789996328.748833:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 286 00000100:00100000:1.0:1789996328.748876:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e087f828000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+14:2365:x1876946927547648:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 53us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996328.748883:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 134 00000100:00080000:0.0:1789996328.748885:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789996328.751022:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927547776 00000100:00100000:1.0:1789996328.751036:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927547776 00000100:00100000:3.0:1789996328.751056:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927547904 00000100:00100000:3.0:1789996328.751063:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927547904 00000100:00100000:1.0:1789996328.751125:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 74 00000100:00080000:0.0:1789996328.751132:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789996328.751138:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0876618a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+5:2365:x1876946927547776:12345-192.168.204.37@tcp:400:kworker.0 00000100:00080000:0.0:1789996328.751139:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789996328.751240:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0876618a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+5:2365:x1876946927547776:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 106us (2837us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996328.751247:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 74 00000100:00100000:3.0:1789996328.752761:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 75 00000100:00100000:3.0:1789996328.752778:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e087993a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+6:2365:x1876946927547904:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:3.0:1789996328.752838:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e087993a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+6:2365:x1876946927547904:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 68us (4333us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996328.752845:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 75 00000100:00100000:2.0:1789996328.937396:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fabd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e0c28cd8-555e-481f-bd03-c3b02aee51c5:3313:1876946942234496:0@lo:400:kworker.0 00000100:00100000:2.0:1789996328.937471:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996328.937570:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086f88ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3313:1876946942235008:0@lo:400:kworker.0 00000100:00100000:2.0:1789996328.937601:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996328.937637:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789996328.937643:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0876a07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876946942234624:0@lo:400:kworker.0 00000100:00100000:2.0:1789996328.937678:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996328.937698:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086f88a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876946942235136:0@lo:400:kworker.0 00000100:00100000:2.0:1789996328.937720:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996328.937747:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086f888e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876946942234880:0@lo:400:kworker.0 00000100:00100000:2.0:1789996328.937769:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996328.937789:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789996328.937794:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086f88b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3316:1876946942234752:0@lo:400:kworker.0 00000100:00100000:2.0:1789996328.937814:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996328.937845:0:8222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942235136 00000100:00100000:2.0:1789996328.937854:0:8222:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942235136 00000100:00100000:2.0:1789996328.937906:0:8222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942234880 00000100:00100000:2.0:1789996328.937910:0:8222:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942234880 00000100:00100000:2.0:1789996328.937933:0:8222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789996328.937959:0:8222:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e087f83b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3313:x1876946942235136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789996328.938025:0:8222:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e087f83b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3313:x1876946942235136:12345-0@lo:400:kworker.0 Request processed in 68us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996328.938032:0:8222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789996328.938050:0:8222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1789996328.938055:0:8222:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e087f83b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3316:x1876946942234880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789996328.938087:0:8222:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e087f83b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3316:x1876946942234880:12345-0@lo:400:kworker.0 Request processed in 31us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996328.938093:0:8222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:2.0:1789996328.938112:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789996328.938143:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086f888e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876946942234880:0@lo:400:kworker.0 00000100:00100000:2.0:1789996328.938170:0:9163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942235008 00000100:00100000:2.0:1789996328.938174:0:9163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942235008 00000100:00100000:2.0:1789996328.938209:0:9163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942234624 00000100:00100000:2.0:1789996328.938212:0:9163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942234624 00000100:00100000:2.0:1789996328.938223:0:9163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942234752 00000100:00100000:2.0:1789996328.938225:0:9163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942234752 00000100:00100000:2.0:1789996328.938240:0:9163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1789996328.938246:0:9163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0879938000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876946942235008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789996328.938276:0:9163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0879938000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1876946942235008:12345-0@lo:400:kworker.0 Request processed in 30us (675us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996328.938283:0:9163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1789996328.938294:0:9163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1789996328.938300:0:9163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e087f83a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876946942234624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789996328.938324:0:9163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e087f83a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876946942234624:12345-0@lo:400:kworker.0 Request processed in 25us (646us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996328.938339:0:9163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1789996328.938352:0:9163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1789996328.938358:0:9163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e087f83aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1876946942234752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789996328.938390:0:9163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e087f83aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1876946942234752:12345-0@lo:400:kworker.0 Request processed in 33us (575us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996328.938395:0:9163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00080000:2.0:1789996328.938413:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789996328.938430:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086f88b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3316:1876946942234752:0@lo:400:kworker.0 00000100:00100000:2.0:1789996328.938453:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0876a07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876946942234624:0@lo:400:kworker.0 00000100:00100000:2.0:1789996328.938463:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086f88a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876946942235136:0@lo:400:kworker.0 00000100:00100000:2.0:1789996328.938470:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086f88ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3313:1876946942235008:0@lo:400:kworker.0 00000100:00100000:1.0:1789996328.938805:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942234496 00000100:00100000:1.0:1789996328.938810:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942234496 00000100:00100000:1.0:1789996328.938855:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:1.0:1789996328.938862:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852ba0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+19:3313:x1876946942234496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789996328.938906:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852ba0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+19:3313:x1876946942234496:12345-0@lo:400:kworker.0 Request processed in 45us (1436us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996328.938912:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:2.0:1789996328.939460:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fabd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e0c28cd8-555e-481f-bd03-c3b02aee51c5:3313:1876946942234496:0@lo:400:kworker.0 00010000:00010000:1.0:1789996329.323576:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789996329.449876:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789996329.449899:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e087f9bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876946942235264:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789996329.449967:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996329.450037:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942235264 00000100:00100000:0.0:1789996329.450044:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942235264 00000100:00100000:0.0:1789996329.450084:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789996329.450092:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e087f9b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3316:x1876946942235264:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789996329.450125:0:6691:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789996329.450174:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e087f9b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3316:x1876946942235264:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996329.450181:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789996329.450221:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e087f9bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876946942235264:0@lo:13:osp-pre-1-0.0 00000001:02000400:3.0:1789996329.856445:0:12320:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 09:12:09 (1789996329) 00010000:00010000:0.0:1789996330.344751:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789996331.056456:0:7659:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00000001:00080000:0.0:1789996331.063975:0:5868:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000020:00080000:0.0:1789996331.063989:0:5868:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:3.0:1789996331.064050:0:5879:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:3.0:1789996331.064061:0:5879:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:2.0:1789996331.145052:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996331.145140:0:9163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927548288 00000100:00100000:0.0:1789996331.145149:0:9163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927548288 00000100:00100000:0.0:1789996331.145224:0:9163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 136 00000100:00100000:0.0:1789996331.145235:0:9163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fabd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+13:11286:x1876946927548288:12345-192.168.204.37@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789996331.145255:0:9163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789996331.145275:0:9163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6c00/0x4173739f0fc81031 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b97003095e356c1 expref: -99 pid: 9163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996331.145345:0:9163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7200/0x4173739f0fc81038 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996331.145358:0:9163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7200/0x4173739f0fc81038 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996331.145369:0:9163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7200/0x4173739f0fc81038 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996331.145384:0:9163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7600/0x4173739f0fc8103f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996331.145391:0:9163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7600/0x4173739f0fc8103f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996331.145415:0:9163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7600/0x4173739f0fc8103f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789996331.145599:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789996331.146037:0:9163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7000/0x4173739f0fc81046 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996331.146049:0:9163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7000/0x4173739f0fc81046 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996331.146057:0:9163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7000/0x4173739f0fc81046 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789996331.146080:0:9163:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:0.0:1789996331.146215:0:9163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7200/0x4173739f0fc81038 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996331.146222:0:9163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7200/0x4173739f0fc81038 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996331.146229:0:9163:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7200/0x4173739f0fc81038 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996331.146235:0:9163:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e086fcb7200 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:0.0:1789996331.146239:0:9163:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7200/0x4173739f0fc81038 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996331.146247:0:9163:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7200/0x4173739f0fc81038 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996331.146258:0:9163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8e084601b800) 00010000:00010000:0.0:1789996331.146260:0:9163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789996331.146271:0:9163:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7200/0x4173739f0fc81038 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996331.146277:0:9163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7200/0x4173739f0fc81038 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996331.146287:0:9163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7600/0x4173739f0fc8103f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996331.146293:0:9163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7600/0x4173739f0fc8103f lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996331.146298:0:9163:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7600/0x4173739f0fc8103f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996331.146303:0:9163:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e086fcb7600 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:0.0:1789996331.146306:0:9163:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7600/0x4173739f0fc8103f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996331.146311:0:9163:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7600/0x4173739f0fc8103f lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996331.146317:0:9163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8e0850c28e00) 00010000:00010000:0.0:1789996331.146319:0:9163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789996331.146322:0:9163:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7600/0x4173739f0fc8103f lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996331.146327:0:9163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7600/0x4173739f0fc8103f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996331.148065:0:9163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6c00/0x4173739f0fc81031 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e356c1 expref: 16 pid: 9163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996331.148104:0:9163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7000/0x4173739f0fc81046 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e356c1 expref: 15 pid: 9163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996331.148113:0:9163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e084601b600) 00010000:00010000:0.0:1789996331.148116:0:9163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789996331.148119:0:9163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e086fcb7000, rc 0) 00000100:00100000:0.0:1789996331.148197:0:9163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fabd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+15:11286:x1876946927548288:12345-192.168.204.37@tcp:101:lhsmtool_posix.0 Request processed in 2964us (3155us total) trans 4294967416 rc 0/0 00000100:00100000:0.0:1789996331.148206:0:9163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 136 00000100:00100000:0.0:1789996331.155636:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1789996331.155725:0:8520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927548416 00000100:00100000:1.0:1789996331.155737:0:8520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927548416 00000100:00100000:1.0:1789996331.155818:0:8520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 9 00000100:00100000:1.0:1789996331.155829:0:8520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e087f9bad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+15:2364:x1876946927548416:12345-192.168.204.37@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789996331.155844:0:8520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789996331.155870:0:8520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7000/0x4173739f0fc81046 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e356c1 expref: 15 pid: 9163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996331.155891:0:8520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e084601b600) 00010000:00010000:1.0:1789996331.155896:0:8520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789996331.155955:0:8520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e087f9bad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+14:2364:x1876946927548416:12345-192.168.204.37@tcp:103:ldlm_bl.0 Request processed in 128us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996331.155963:0:8520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 9 00000100:00100000:2.0:1789996331.156664:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1789996331.156745:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927548544 00000100:00100000:1.0:1789996331.156751:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927548544 00000100:00100000:1.0:1789996331.156870:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 137 00000100:00100000:1.0:1789996331.156881:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0876a07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+14:11286:x1876946927548544:12345-192.168.204.37@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1789996331.156958:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0876a07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+14:11286:x1876946927548544:12345-192.168.204.37@tcp:59:lhsmtool_posix.0 Request processed in 79us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996331.162761:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 137 00000040:00080000:2.0:1789996331.368781:0:11698:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789996331.368789:0:11698:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789996331.369443:0:11698:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1789996331.369453:0:11698:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1789996331.369858:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789996332.394745:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789996332.731467:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996332.731592:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927548672 00000100:00100000:0.0:1789996332.731756:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927548672 00000100:00100000:0.0:1789996332.731868:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 138 00000100:00100000:0.0:1789996332.731879:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0847556d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+14:11328:x1876946927548672:12345-192.168.204.37@tcp:101:lfs.0 00010000:00010000:0.0:1789996332.731901:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789996332.731922:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6600/0x4173739f0fc81054 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b97003095e356c8 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996332.731986:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7800/0x4173739f0fc8105b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996332.732001:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7800/0x4173739f0fc8105b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996332.732013:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7800/0x4173739f0fc8105b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996332.732041:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7400/0x4173739f0fc81062 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996332.732049:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7400/0x4173739f0fc81062 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996332.732056:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7400/0x4173739f0fc81062 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996332.732258:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7800/0x4173739f0fc8105b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996332.732267:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7800/0x4173739f0fc8105b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996332.732274:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7800/0x4173739f0fc8105b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996332.732280:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e086fcb7800 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:0.0:1789996332.732285:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7800/0x4173739f0fc8105b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996332.732292:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7800/0x4173739f0fc8105b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996332.732304:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e0850c28200) 00010000:00010000:0.0:1789996332.732307:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789996332.732312:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7800/0x4173739f0fc8105b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996332.732331:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7800/0x4173739f0fc8105b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996332.732360:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7400/0x4173739f0fc81062 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996332.732367:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7400/0x4173739f0fc81062 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996332.732372:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7400/0x4173739f0fc81062 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996332.732378:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e086fcb7400 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:0.0:1789996332.732381:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7400/0x4173739f0fc81062 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996332.732387:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7400/0x4173739f0fc81062 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996332.732395:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8e0850c28e00) 00010000:00010000:0.0:1789996332.732398:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789996332.732401:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7400/0x4173739f0fc81062 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996332.732406:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7400/0x4173739f0fc81062 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996332.732439:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6600/0x4173739f0fc81054 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e356c8 expref: 15 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996332.732449:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e0850c28200) 00010000:00010000:0.0:1789996332.732452:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789996332.732462:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6600/0x4173739f0fc81054 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e356c8 expref: 15 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996332.732474:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e086fcb6600, rc 0) 00000100:00100000:0.0:1789996332.732576:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0847556d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+14:11328:x1876946927548672:12345-192.168.204.37@tcp:101:lfs.0 Request processed in 699us (1118us total) trans 0 rc 301/301 00000100:00100000:0.0:1789996332.732585:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 138 00000100:00100000:2.0:1789996332.739044:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996332.741705:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927548928 00000100:00100000:0.0:1789996332.741718:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927548928 00000100:00100000:0.0:1789996332.741780:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 139 00000100:00100000:0.0:1789996332.741791:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086f887100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+14:11328:x1876946927548928:12345-192.168.204.37@tcp:36:lfs.0 00010000:00010000:0.0:1789996332.741845:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789996332.741870:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0840031200/0x4173739f0fc809e0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35508 expref: 14 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996332.741887:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e0850c28200) 00010000:00010000:0.0:1789996332.741897:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789996332.742314:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6800/0x4173739f0fc81069 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996332.742329:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6800/0x4173739f0fc81069 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996332.742413:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6800/0x4173739f0fc81069 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996332.742426:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6400/0x4173739f0fc81070 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996332.742434:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6400/0x4173739f0fc81070 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996332.742447:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6400/0x4173739f0fc81070 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789996332.743739:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:0.0:1789996332.743753:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6800/0x4173739f0fc81069 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996332.743761:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6800/0x4173739f0fc81069 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996332.743768:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6800/0x4173739f0fc81069 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996332.743775:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e086fcb6800 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:0.0:1789996332.743779:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6800/0x4173739f0fc81069 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996332.743786:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6800/0x4173739f0fc81069 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996332.743799:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e0850c28a00) 00010000:00010000:0.0:1789996332.743802:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789996332.743807:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6800/0x4173739f0fc81069 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996332.743813:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6800/0x4173739f0fc81069 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789996332.743832:0:5846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000000c852a4 reply state 00000000a360a5a0 transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6400/0x4173739f0fc81070 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789996332.743874:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789996332.743966:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086f887100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+15:11328:x1876946927548928:12345-192.168.204.37@tcp:36:lfs.0 Request processed in 2173us (4929us total) trans 4294967417 rc 0/0 00000100:00100000:0.0:1789996332.743974:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 139 00010000:00010000:0.0:1789996332.746872:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6400/0x4173739f0fc81070 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996332.746890:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6400/0x4173739f0fc81070 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996332.746898:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6400/0x4173739f0fc81070 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996332.746904:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e086fcb6400 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:0.0:1789996332.746909:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6400/0x4173739f0fc81070 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996332.746917:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6400/0x4173739f0fc81070 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996332.746933:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8e0850c28d00) 00010000:00010000:0.0:1789996332.746936:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789996332.746942:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6400/0x4173739f0fc81070 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996332.746948:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6400/0x4173739f0fc81070 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789996332.805058:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996332.805223:0:9163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927549056 00000100:00100000:0.0:1789996332.805235:0:9163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927549056 00000100:00100000:0.0:1789996332.805315:0:9163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 140 00000100:00100000:0.0:1789996332.805337:0:9163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086f886d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+14:11336:x1876946927549056:12345-192.168.204.37@tcp:101:lctl.0 00010000:00010000:0.0:1789996332.805360:0:9163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789996332.805384:0:9163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6800/0x4173739f0fc81077 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b97003095e356cf expref: -99 pid: 9163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996332.805443:0:9163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6600/0x4173739f0fc8107e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996332.805457:0:9163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6600/0x4173739f0fc8107e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996332.805469:0:9163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6600/0x4173739f0fc8107e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789996332.805518:0:9163:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789996332.805523:0:9163:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789996332.805585:0:9163:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6600/0x4173739f0fc8107e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996332.805608:0:9163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6800/0x4173739f0fc81077 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e356cf expref: 16 pid: 9163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996332.805629:0:9163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6600/0x4173739f0fc8107e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e356cf expref: 15 pid: 9163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996332.805638:0:9163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e0850c28d00) 00010000:00010000:0.0:1789996332.805641:0:9163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789996332.805644:0:9163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e086fcb6600, rc 0) 00000100:00100000:0.0:1789996332.805701:0:9163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086f886d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+15:11336:x1876946927549056:12345-192.168.204.37@tcp:101:lctl.0 Request processed in 367us (655us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996332.805715:0:9163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 140 00000100:00100000:3.0:1789996332.854839:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996332.855011:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927549184 00000100:00100000:2.0:1789996332.855035:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927549184 00000100:00100000:2.0:1789996332.855110:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 141 00000100:00100000:2.0:1789996332.855122:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e084755df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+15:11342:x1876946927549184:12345-192.168.204.37@tcp:101:bash.0 00010000:00010000:2.0:1789996332.855144:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789996332.855166:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4200/0x4173739f0fc81085 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b97003095e356d6 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996332.855232:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4800/0x4173739f0fc8108c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996332.855247:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4800/0x4173739f0fc8108c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996332.855259:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4800/0x4173739f0fc8108c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996332.855274:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4e00/0x4173739f0fc81093 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996332.855282:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4e00/0x4173739f0fc81093 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996332.855289:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4e00/0x4173739f0fc81093 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996332.855385:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5c00/0x4173739f0fc8109a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996332.855394:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5c00/0x4173739f0fc8109a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996332.855401:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5c00/0x4173739f0fc8109a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789996332.855434:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:2.0:1789996332.855438:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789996332.855458:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5c00/0x4173739f0fc8109a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996332.855470:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4800/0x4173739f0fc8108c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996332.855476:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4800/0x4173739f0fc8108c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996332.855483:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4800/0x4173739f0fc8108c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996332.855489:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0842de4800 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:2.0:1789996332.855779:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4800/0x4173739f0fc8108c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996332.855789:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4800/0x4173739f0fc8108c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996332.855803:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e0850c28d00) 00010000:00010000:2.0:1789996332.855806:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789996332.855811:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4800/0x4173739f0fc8108c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996332.855818:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4800/0x4173739f0fc8108c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996332.855833:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4e00/0x4173739f0fc81093 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996332.855850:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4e00/0x4173739f0fc81093 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996332.855856:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4e00/0x4173739f0fc81093 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996332.855861:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0842de4e00 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:2.0:1789996332.855864:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4e00/0x4173739f0fc81093 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996332.855870:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4e00/0x4173739f0fc81093 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996332.855879:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8e084601be00) 00010000:00010000:2.0:1789996332.855882:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789996332.855884:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4e00/0x4173739f0fc81093 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996332.855890:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4e00/0x4173739f0fc81093 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996332.855925:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4200/0x4173739f0fc81085 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e356d6 expref: 17 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996332.855939:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5c00/0x4173739f0fc8109a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e356d6 expref: 16 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996332.855946:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e084601b500) 00010000:00010000:2.0:1789996332.855948:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789996332.855956:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e0842de5c00, rc 0) 00000100:00100000:2.0:1789996332.856072:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e084755df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+16:11342:x1876946927549184:12345-192.168.204.37@tcp:101:bash.0 Request processed in 952us (1242us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996332.856080:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 141 00000100:00100000:2.0:1789996332.862743:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1789996332.862874:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927549440 00000100:00100000:3.0:1789996332.862884:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927549440 00000100:00100000:3.0:1789996332.862934:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 142 00000100:00100000:3.0:1789996332.862944:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086f886300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+16:11342:x1876946927549440:12345-192.168.204.37@tcp:101:bash.0 00010000:00010000:3.0:1789996332.862966:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789996332.862989:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857800/0x4173739f0fc810a1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b97003095e356dd expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996332.863114:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856200/0x4173739f0fc810a8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996332.863129:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856200/0x4173739f0fc810a8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996332.863140:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856200/0x4173739f0fc810a8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996332.863155:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857000/0x4173739f0fc810af lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996332.863162:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857000/0x4173739f0fc810af lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996332.863170:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857000/0x4173739f0fc810af lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789996332.863777:0:5848:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:3.0:1789996332.863939:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856c00/0x4173739f0fc810b6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996332.863950:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856c00/0x4173739f0fc810b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996332.863959:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856c00/0x4173739f0fc810b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996332.863991:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856200/0x4173739f0fc810a8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996332.864005:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856200/0x4173739f0fc810a8 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996332.864011:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856200/0x4173739f0fc810a8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996332.864018:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e087f856200 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:3.0:1789996332.864022:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856200/0x4173739f0fc810a8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996332.864030:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856200/0x4173739f0fc810a8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996332.864041:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e084601b500) 00010000:00010000:3.0:1789996332.864044:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789996332.864050:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856200/0x4173739f0fc810a8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996332.864056:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856200/0x4173739f0fc810a8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789996332.864080:0:5848:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000affde054 reply state 00000000c1d0869a transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857000/0x4173739f0fc810af lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789996332.864089:0:5848:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789996332.864119:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857800/0x4173739f0fc810a1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e356dd expref: 19 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996332.864133:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856c00/0x4173739f0fc810b6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e356dd expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996332.864140:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e0846583c00) 00010000:00010000:3.0:1789996332.864143:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789996332.864145:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e087f856c00, rc 0) 00000100:00100000:3.0:1789996332.864440:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086f886300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+19:11342:x1876946927549440:12345-192.168.204.37@tcp:101:bash.0 Request processed in 1496us (1705us total) trans 4294967418 rc 0/0 00000100:00100000:3.0:1789996332.864449:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 142 00010000:00010000:1.0:1789996332.866834:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857000/0x4173739f0fc810af lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996332.866851:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857000/0x4173739f0fc810af lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996332.866858:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857000/0x4173739f0fc810af lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996332.866864:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e087f857000 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:1.0:1789996332.866869:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857000/0x4173739f0fc810af lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996332.866875:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857000/0x4173739f0fc810af lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996332.866889:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8e0846583d00) 00010000:00010000:1.0:1789996332.866893:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789996332.866897:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857000/0x4173739f0fc810af lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996332.866904:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857000/0x4173739f0fc810af lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789996332.868908:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996332.869628:0:8222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927549568 00000100:00100000:0.0:1789996332.869640:0:8222:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927549568 00000100:00100000:0.0:1789996332.869726:0:8222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 47 00000100:00100000:0.0:1789996332.869736:0:8222:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086f887480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+5:2362:x1876946927549568:12345-192.168.204.37@tcp:101:bash.0 00010000:00010000:0.0:1789996332.869755:0:8222:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789996332.869775:0:8222:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000075361c22/0x4173739f0fc810c4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1b97003095e356e4 expref: -99 pid: 8222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789996332.869802:0:8222:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789996332.869822:0:8222:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=374s v=(0 0) 00010000:00010000:0.0:1789996332.869828:0:8222:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789996332.869837:0:8222:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000075361c22/0x4173739f0fc810c4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e356e4 expref: 6 pid: 8222 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996332.869855:0:8222:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000075361c22/0x4173739f0fc810c4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e356e4 expref: 6 pid: 8222 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996332.869869:0:8222:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e086fcb6800, rc 0) 00000100:00100000:0.0:1789996332.869937:0:8222:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086f887480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+6:2362:x1876946927549568:12345-192.168.204.37@tcp:101:bash.0 Request processed in 203us (1039us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996332.869944:0:8222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 47 00000100:00080000:2.0:1789996332.870051:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789996332.872472:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996332.872582:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927549696 00000100:00100000:0.0:1789996332.872591:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927549696 00000100:00100000:0.0:1789996332.872642:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 48 00000100:00100000:0.0:1789996332.872653:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0876a6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+6:11342:x1876946927549696:12345-192.168.204.37@tcp:101:bash.0 00010000:00010000:0.0:1789996332.872676:0:6689:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789996332.872694:0:6689:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003b2db54a/0x4173739f0fc810cb lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1b97003095e356eb expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996332.872722:0:6689:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000075361c22/0x4173739f0fc810c4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e356e4 expref: 7 pid: 8222 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996332.872731:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789996332.872735:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789996332.872740:0:6689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003b2db54a/0x4173739f0fc810cb lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e356eb expref: 7 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996332.872772:0:6689:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000075361c22/0x4173739f0fc810c4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e356e4 expref: 7 pid: 8222 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996332.872787:0:6689:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000075361c22/0x4173739f0fc810c4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e356e4 expref: 7 pid: 8222 timeout: 474 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789996332.872802:0:6689:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e087f9bb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6689:1876946942235392:192.168.204.37@tcp:104: 00000100:00100000:0.0:1789996332.872889:0:6689:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0858c43e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789996332.875011:0:6689:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e087f9bb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6689:1876946942235392:192.168.204.37@tcp:104: 00010000:00010000:0.0:1789996332.875046:0:6689:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003b2db54a/0x4173739f0fc810cb lrc: 3/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.37@tcp remote: 0x1b97003095e356eb expref: 7 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996332.875065:0:6689:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e086fcb7400, rc 0) 00000100:00100000:0.0:1789996332.875173:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0876a6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+7:11342:x1876946927549696:12345-192.168.204.37@tcp:101:bash.0 Request processed in 2521us (2709us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996332.875181:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 48 00000100:00100000:2.0:1789996332.879057:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996332.879158:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927549824 00000100:00100000:0.0:1789996332.879169:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927549824 00010000:00010000:0.0:1789996332.879213:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000075361c22/0x4173739f0fc810c4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e356e4 expref: 7 pid: 8222 timeout: 474 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789996332.879259:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 62 00000100:00100000:0.0:1789996332.879270:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086f885180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+7:2363:x1876946927549824:12345-192.168.204.37@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789996332.879285:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789996332.879307:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000075361c22/0x4173739f0fc810c4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e356e4 expref: 7 pid: 8222 timeout: 474 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996332.879322:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000075361c22/0x4173739f0fc810c4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e356e4 expref: 7 pid: 8222 timeout: 474 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996332.879345:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000075361c22/0x4173739f0fc810c4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e356e4 expref: 7 pid: 8222 timeout: 474 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996332.879362:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789996332.879367:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789996332.879375:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003b2db54a/0x4173739f0fc810cb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.37@tcp remote: 0x1b97003095e356eb expref: 6 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996332.879385:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003b2db54a/0x4173739f0fc810cb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.37@tcp remote: 0x1b97003095e356eb expref: 6 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996332.879440:0:5831:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000003b2db54a/0x4173739f0fc810cb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.37@tcp remote: 0x1b97003095e356eb expref: 6 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789996332.879454:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e087f9bb100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5831:1876946942235520:192.168.204.37@tcp:105: 00000100:00100000:0.0:1789996332.879519:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0858c43e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789996332.884209:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e087f9bb100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5831:1876946942235520:192.168.204.37@tcp:105: 00010000:00010000:0.0:1789996332.884236:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789996332.884295:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086f885180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+6:2363:x1876946927549824:12345-192.168.204.37@tcp:103:ldlm_bl.0 Request processed in 5026us (5248us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996332.884307:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 62 00000100:00100000:2.0:1789996332.887204:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996332.887422:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927550080 00000100:00100000:0.0:1789996332.887433:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927550080 00000100:00100000:0.0:1789996332.887598:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 36 00000100:00100000:0.0:1789996332.887610:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0880f7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+18:11342:x1876946927550080:12345-192.168.204.37@tcp:35:bash.0 00000100:00100000:0.0:1789996332.888140:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0880f7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+19:11342:x1876946927550080:12345-192.168.204.37@tcp:35:bash.0 Request processed in 531us (944us total) trans 4294967419 rc 0/0 00000100:00100000:0.0:1789996332.888148:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 36 00000100:00100000:3.0:1789996332.956854:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996332.957113:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927550336 00000100:00100000:0.0:1789996332.957122:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927550336 00000100:00100000:0.0:1789996332.957243:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 143 00000100:00100000:0.0:1789996332.957255:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0876a68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+19:11352:x1876946927550336:12345-192.168.204.37@tcp:101:lfs.0 00010000:00010000:0.0:1789996332.957280:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789996332.957346:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6800/0x4173739f0fc810d2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b97003095e356f2 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789996332.957474:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:0.0:1789996332.958043:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6800/0x4173739f0fc810d2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e356f2 expref: 21 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996332.958059:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e0850c28d00) 00010000:00010000:0.0:1789996332.958062:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789996332.958067:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6800/0x4173739f0fc810d2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e356f2 expref: 21 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996332.958080:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e086fcb6800, rc 0) 00000100:00100000:0.0:1789996332.958147:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0876a68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+20:11352:x1876946927550336:12345-192.168.204.37@tcp:101:lfs.0 Request processed in 893us (1303us total) trans 4294967420 rc 301/301 00000100:00100000:0.0:1789996332.958154:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 143 00000100:00100000:2.0:1789996332.962012:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996332.963082:0:11495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927550592 00000100:00100000:0.0:1789996332.963095:0:11495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927550592 00000100:00100000:0.0:1789996332.963163:0:11495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 37 00000100:00100000:0.0:1789996332.963175:0:11495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0880f7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+20:11352:x1876946927550592:12345-192.168.204.37@tcp:35:lfs.0 00000100:00100000:0.0:1789996332.963411:0:11495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0880f7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+21:11352:x1876946927550592:12345-192.168.204.37@tcp:35:lfs.0 Request processed in 238us (1407us total) trans 4294967421 rc 0/0 00000100:00100000:0.0:1789996332.963419:0:11495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 37 00000100:00100000:2.0:1789996333.021293:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996333.022278:0:9163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927550720 00000100:00100000:0.0:1789996333.022290:0:9163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927550720 00000100:00100000:0.0:1789996333.022364:0:9163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 144 00000100:00100000:0.0:1789996333.022375:0:9163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0880f79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+21:11358:x1876946927550720:12345-192.168.204.37@tcp:101:lfs.0 00010000:00010000:0.0:1789996333.022398:0:9163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789996333.022437:0:9163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6800/0x4173739f0fc810e0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b97003095e356f9 expref: -99 pid: 9163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996333.022504:0:9163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7800/0x4173739f0fc810e7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996333.022577:0:9163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7800/0x4173739f0fc810e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996333.022598:0:9163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7800/0x4173739f0fc810e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789996333.022635:0:9163:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:0.0:1789996333.022639:0:9163:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789996333.022658:0:9163:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7800/0x4173739f0fc810e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996333.022686:0:9163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6800/0x4173739f0fc810e0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e356f9 expref: 23 pid: 9163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996333.022703:0:9163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7800/0x4173739f0fc810e7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e356f9 expref: 22 pid: 9163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996333.022712:0:9163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e084601b500) 00010000:00010000:0.0:1789996333.022715:0:9163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789996333.022718:0:9163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e086fcb7800, rc 0) 00000100:00100000:0.0:1789996333.022777:0:9163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0880f79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+22:11358:x1876946927550720:12345-192.168.204.37@tcp:101:lfs.0 Request processed in 404us (1494us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996333.022785:0:9163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 144 00000100:00080000:2.0:1789996333.023010:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789996333.029019:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1789996333.029120:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927550976 00000100:00100000:1.0:1789996333.029131:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927550976 00000100:00100000:1.0:1789996333.029195:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 145 00000100:00100000:1.0:1789996333.029206:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0880f79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+22:11358:x1876946927550976:12345-192.168.204.37@tcp:101:lfs.0 00010000:00010000:1.0:1789996333.029341:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789996333.029363:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22e00/0x4173739f0fc810ee lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b97003095e35700 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996333.029801:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23a00/0x4173739f0fc810f5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996333.029816:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23a00/0x4173739f0fc810f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996333.029828:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23a00/0x4173739f0fc810f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789996333.029840:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1789996333.029956:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22e00/0x4173739f0fc810ee lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35700 expref: 25 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996333.029973:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23a00/0x4173739f0fc810f5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35700 expref: 24 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996333.029982:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e0846583c00) 00010000:00010000:1.0:1789996333.029985:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789996333.029989:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e0876a23a00, rc 0) 00000100:00100000:1.0:1789996333.030049:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0880f79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+24:11358:x1876946927550976:12345-192.168.204.37@tcp:101:lfs.0 Request processed in 845us (1041us total) trans 4294967422 rc 0/0 00000100:00100000:1.0:1789996333.030056:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 145 00000100:00100000:0.0:1789996333.032911:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086f889880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876946942235648:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789996333.032989:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789996333.033043:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996333.033368:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942235648 00000100:00100000:2.0:1789996333.033376:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942235648 00000100:00100000:2.0:1789996333.033451:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789996333.033461:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e087f9bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1876946942235648:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789996333.033492:0:6691:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1789996333.033567:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789996333.033799:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927551232 00000100:00100000:3.0:1789996333.033805:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927551232 00000100:00100000:3.0:1789996333.033895:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 146 00000100:00100000:3.0:1789996333.033905:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0876a6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+24:11358:x1876946927551232:12345-192.168.204.37@tcp:101:lfs.0 00010000:00010000:3.0:1789996333.033924:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789996333.033944:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857800/0x4173739f0fc81103 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b97003095e35707 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996333.034051:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856200/0x4173739f0fc8110a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996333.034067:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856200/0x4173739f0fc8110a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996333.034080:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856200/0x4173739f0fc8110a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789996333.034105:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00000100:00100000:2.0:1789996333.034193:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e087f9bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1876946942235648:12345-0@lo:13:osp-pre-0-0.0 Request processed in 731us (1200us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996333.034201:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00010000:00010000:3.0:1789996333.034231:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857800/0x4173739f0fc81103 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35707 expref: 27 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996333.034249:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856200/0x4173739f0fc8110a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35707 expref: 26 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996333.034257:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e0846583c00) 00010000:00010000:3.0:1789996333.034261:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1789996333.034264:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e087f856200, rc 0) 00000100:00100000:3.0:1789996333.034309:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0876a6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+26:11358:x1876946927551232:12345-192.168.204.37@tcp:101:lfs.0 Request processed in 406us (1271us total) trans 4294967423 rc 0/0 00000100:00100000:3.0:1789996333.034316:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 146 00000100:00100000:0.0:1789996333.034917:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086f889880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876946942235648:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789996333.037249:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1789996333.037368:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927551360 00000100:00100000:1.0:1789996333.037377:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927551360 00000100:00100000:1.0:1789996333.037485:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 10 00000100:00100000:1.0:1789996333.037496:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0880f7b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+26:2364:x1876946927551360:12345-192.168.204.37@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789996333.037510:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789996333.038679:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23a00/0x4173739f0fc810f5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35700 expref: 26 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996333.038702:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e0846583c00) 00010000:00010000:1.0:1789996333.038707:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789996333.038771:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0880f7b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+25:2364:x1876946927551360:12345-192.168.204.37@tcp:103:ldlm_bl.0 Request processed in 1276us (1530us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996333.038780:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 10 00000100:00100000:2.0:1789996333.041570:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996333.041645:0:8222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927551488 00000100:00100000:0.0:1789996333.041654:0:8222:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927551488 00000100:00100000:0.0:1789996333.041742:0:8222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 49 00000100:00100000:0.0:1789996333.041754:0:8222:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0877b7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+6:2363:x1876946927551488:12345-192.168.204.37@tcp:1:lfs.0 00010000:00010000:0.0:1789996333.041798:0:8222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000075361c22/0x4173739f0fc81118 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996333.041817:0:8222:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003b2db54a/0x4173739f0fc810cb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.37@tcp remote: 0x1b97003095e356eb expref: 6 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996333.041825:0:8222:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789996333.041830:0:8222:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789996333.041834:0:8222:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000075361c22/0x4173739f0fc81118 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996333.041869:0:8222:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003b2db54a/0x4173739f0fc810cb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.37@tcp remote: 0x1b97003095e356eb expref: 6 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996333.041883:0:8222:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003b2db54a/0x4173739f0fc810cb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.37@tcp remote: 0x1b97003095e356eb expref: 6 pid: 6689 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789996333.041898:0:8222:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e087f9b9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8222:1876946942235776:192.168.204.37@tcp:104: 00000100:00100000:0.0:1789996333.041974:0:8222:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0858c43840 going to sleep for 11 seconds 00000100:00100000:3.0:1789996333.045931:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996333.046024:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927551616 00000100:00100000:2.0:1789996333.046034:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927551616 00002000:00100000:2.0:1789996333.046084:0:6693:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff8e0876a69180 x1876946927551616/t0(0) o4->189efa8a-c7eb-4b69-9afa-1dd36d6775f1@192.168.204.37@tcp:64/0 lens 504/0 e 0 to 0 dl 1789996344 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789996333.046097:0:6693:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8e0876a69180 with x1876946927551616 ext(0->12) 00010000:00010000:2.0:1789996333.046120:0:6693:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000003b2db54a/0x4173739f0fc810cb lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.37@tcp remote: 0x1b97003095e356eb expref: 7 pid: 6689 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996333.046137:0:6693:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000003b2db54a/0x4173739f0fc810cb lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.37@tcp remote: 0x1b97003095e356eb expref: 7 pid: 6689 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789996333.046146:0:6693:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8e0876a69180 00000100:00100000:2.0:1789996333.046178:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 2 00000100:00100000:2.0:1789996333.046188:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0876a69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+7:2363:x1876946927551616:12345-192.168.204.37@tcp:4:lfs.0 00000100:00100000:2.0:1789996333.046700:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0876a69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+9:2363:x1876946927551616:12345-192.168.204.37@tcp:4:lfs.0 Request processed in 512us (777us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1789996333.046708:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 2 00002000:00100000:2.0:1789996333.046715:0:6693:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff8e0876a69180 x1876946927551616/t4294967305(0) o4->189efa8a-c7eb-4b69-9afa-1dd36d6775f1@192.168.204.37@tcp:64/0 lens 504/448 e 0 to 0 dl 1789996344 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789996333.046722:0:6693:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8e0876a69180 with x1876946927551616 ext(0->12) 00010000:00010000:2.0:1789996333.046728:0:6693:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000003b2db54a/0x4173739f0fc810cb lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.37@tcp remote: 0x1b97003095e356eb expref: 9 pid: 6689 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996333.046740:0:6693:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000003b2db54a/0x4173739f0fc810cb lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.37@tcp remote: 0x1b97003095e356eb expref: 9 pid: 6689 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789996333.046746:0:6693:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8e0876a69180 00000100:00100000:0.0:1789996333.046850:0:8222:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e087f9b9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8222:1876946942235776:192.168.204.37@tcp:104: 00010000:00010000:0.0:1789996333.046889:0:8222:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000075361c22/0x4173739f0fc81118 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789996333.054133:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1789996333.054863:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927551744 00000100:00100000:1.0:1789996333.054874:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927551744 00010000:00010000:1.0:1789996333.054915:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003b2db54a/0x4173739f0fc810cb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.37@tcp remote: 0x1b97003095e356eb expref: 9 pid: 6689 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789996333.055004:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 63 00000100:00100000:1.0:1789996333.055014:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0877b7d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+9:2364:x1876946927551744:12345-192.168.204.37@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789996333.055032:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1789996333.055051:0:5832:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1789996333.055054:0:5832:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1789996333 00002000:00010000:1.0:1789996333.055057:0:5832:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1789996333 00002000:00010000:1.0:1789996333.055059:0:5832:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1789996333 00010000:00010000:1.0:1789996333.055065:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003b2db54a/0x4173739f0fc810cb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.37@tcp remote: 0x1b97003095e356eb expref: 9 pid: 6689 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996333.055101:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003b2db54a/0x4173739f0fc810cb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.37@tcp remote: 0x1b97003095e356eb expref: 9 pid: 6689 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996333.055124:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003b2db54a/0x4173739f0fc810cb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.37@tcp remote: 0x1b97003095e356eb expref: 9 pid: 6689 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996333.055142:0:5832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789996333.055147:0:5832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789996333.055153:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000075361c22/0x4173739f0fc81118 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996333.055163:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000075361c22/0x4173739f0fc81118 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996333.055203:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789996333.055265:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0877b7d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+8:2364:x1876946927551744:12345-192.168.204.37@tcp:103:ldlm_bl.0 Request processed in 252us (1141us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996333.055274:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 63 00010000:00010000:2.0:1789996333.055483:0:8222:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000075361c22/0x4173739f0fc81118 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996333.055507:0:8222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000075361c22/0x4173739f0fc81118 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996333.055559:0:8222:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000075361c22/0x4173739f0fc81118 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996333.055569:0:8222:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000075361c22/0x4173739f0fc81118 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996333.055582:0:8222:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000075361c22/0x4173739f0fc81118 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996333.055589:0:8222:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e086fcb6800 already unused, calling callback (ffffffffc1595910) 00010000:00010000:2.0:1789996333.055594:0:8222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000075361c22/0x4173739f0fc81118 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996333.055603:0:8222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000075361c22/0x4173739f0fc81118 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996333.055616:0:8222:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000075361c22/0x4173739f0fc81118 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996333.055624:0:8222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000075361c22/0x4173739f0fc81118 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789996333.055694:0:8222:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0877b7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+7:2363:x1876946927551488:12345-192.168.204.37@tcp:1:lfs.0 Request processed in 13942us (14167us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996333.055703:0:8222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 49 00000100:00100000:2.0:1789996333.067494:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996333.067949:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927552000 00000100:00100000:0.0:1789996333.067960:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927552000 00000100:00100000:0.0:1789996333.068025:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 38 00000100:00100000:0.0:1789996333.068034:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0850a22c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+25:11358:x1876946927552000:12345-192.168.204.37@tcp:35:lfs.0 00000004:00010000:0.0:1789996333.068099:0:5849:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856200/0x4173739f0fc8110a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35707 expref: 25 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789996333.068510:0:5849:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:0.0:1789996333.069391:0:5849:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967425 00000001:00080000:0.0:1789996333.070488:0:5849:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967426 00010000:00010000:0.0:1789996333.070901:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7200/0x4173739f0fc8111f lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996333.070921:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856c00/0x4173739f0fc810b6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e356dd expref: 29 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996333.070930:0:5849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7200/0x4173739f0fc8111f lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996333.070969:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856c00/0x4173739f0fc810b6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e356dd expref: 29 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996333.070987:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856c00/0x4173739f0fc810b6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e356dd expref: 29 pid: 5848 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789996333.071002:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e087f9b9500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5849:1876946942235904:192.168.204.37@tcp:104: 00000100:00100000:0.0:1789996333.071158:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0858c43840 going to sleep for 11 seconds 00000100:00100000:1.0:1789996333.077232:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996333.077349:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e087f9b9500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5849:1876946942235904:192.168.204.37@tcp:104: 00010000:00010000:0.0:1789996333.077376:0:5849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7200/0x4173739f0fc8111f lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789996333.077451:0:8520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927552128 00000100:00100000:3.0:1789996333.077459:0:8520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927552128 00010000:00010000:3.0:1789996333.077494:0:8520:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856c00/0x4173739f0fc810b6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e356dd expref: 30 pid: 5848 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789996333.077610:0:8520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 64 00000100:00100000:3.0:1789996333.077632:0:8520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086f88b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+30:2362:x1876946927552128:12345-192.168.204.37@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789996333.077647:0:8520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789996333.077654:0:8520:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856c00/0x4173739f0fc810b6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e356dd expref: 30 pid: 5848 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996333.077667:0:8520:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856c00/0x4173739f0fc810b6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e356dd expref: 30 pid: 5848 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996333.077690:0:8520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856c00/0x4173739f0fc810b6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e356dd expref: 30 pid: 5848 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996333.077706:0:8520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e0846583c00) 00010000:00010000:3.0:1789996333.077711:0:8520:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7200/0x4173739f0fc8111f lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996333.077720:0:8520:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7200/0x4173739f0fc8111f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996333.077728:0:8520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7200/0x4173739f0fc8111f lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996333.077747:0:8520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789996333.077947:0:5849:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7200/0x4173739f0fc8111f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996333.077955:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7200/0x4173739f0fc8111f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789996333.078082:0:5849:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967427 00000001:00080000:0.0:1789996333.078285:0:5849:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:0.0:1789996333.078392:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e087f9b9500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5849:1876946942236032:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1789996333.078450:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996333.078499:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e086d5920c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789996333.079018:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942236032 00000100:00100000:2.0:1789996333.079026:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942236032 00000100:00100000:2.0:1789996333.079070:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789996333.079079:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e087f9b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5849:x1876946942236032:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1789996333.079152:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e087f9b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5849:x1876946942236032:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 74us (701us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996333.079160:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789996333.079244:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e087f9b9500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5849:1876946942236032:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1789996333.079996:0:8520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086f88b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+31:2362:x1876946927552128:12345-192.168.204.37@tcp:103:ldlm_bl.0 Request processed in 2363us (2770us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996333.080006:0:8520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 64 00000001:00080000:0.0:1789996333.081281:0:5849:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967429 00000100:00100000:0.0:1789996333.081375:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e087f9b9500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5849:1876946942236160:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1789996333.081516:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996333.081872:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0858c43840 going to sleep for 11 seconds 00000100:00100000:2.0:1789996333.081941:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942236160 00000100:00100000:2.0:1789996333.081949:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942236160 00000100:00100000:2.0:1789996333.081999:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789996333.082009:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e08810a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5849:x1876946942236160:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1789996333.082203:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e08810a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5849:x1876946942236160:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 195us (687us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1789996333.082211:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789996333.082469:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e087f9b9500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5849:1876946942236160:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1789996333.082981:0:5849:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:1.0:1789996333.083044:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7200/0x4173739f0fc8111f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996333.083055:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7200/0x4173739f0fc8111f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996333.083080:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7200/0x4173739f0fc8111f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996333.083087:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e086fcb7200 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:1.0:1789996333.083091:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7200/0x4173739f0fc8111f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996333.083100:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7200/0x4173739f0fc8111f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996333.083117:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e0846583c00) 00010000:00010000:1.0:1789996333.083121:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1789996333.083126:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7200/0x4173739f0fc8111f lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996333.083132:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7200/0x4173739f0fc8111f lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789996333.083321:0:5849:0:(mdd_object.c:4178:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1789996333.083416:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:1.0:1789996333.083443:0:5849:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 374802899886ns, next at 375802897350ns, rc = 0 00000001:00080000:1.0:1789996333.083450:0:5849:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967431 00010000:00010000:1.0:1789996333.083484:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e0846583c00) 00010000:00010000:1.0:1789996333.083488:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1789996333.083495:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856200/0x4173739f0fc8110a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35707 expref: 33 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789996333.083651:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0850a22c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+32:11358:x1876946927552000:12345-192.168.204.37@tcp:35:lfs.0 Request processed in 15616us (16165us total) trans 4294967432 rc 0/0 00000100:00100000:1.0:1789996333.083667:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 38 00000020:00080000:1.0:1789996333.083673:0:5849:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1789996333.086457:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996333.087182:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927552256 00000100:00100000:0.0:1789996333.087192:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927552256 00000100:00100000:0.0:1789996333.087286:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 147 00000100:00100000:0.0:1789996333.087298:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086f889880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+32:11358:x1876946927552256:12345-192.168.204.37@tcp:101:lfs.0 00010000:00010000:0.0:1789996333.087321:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789996333.087343:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7600/0x4173739f0fc81126 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b97003095e3570e expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996333.087415:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7600/0x4173739f0fc81126 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e3570e expref: 33 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996333.087444:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7600/0x4173739f0fc81126 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e3570e expref: 33 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996333.087462:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e0850c28e00) 00010000:00010000:0.0:1789996333.087465:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789996333.087469:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e086fcb7600, rc 0) 00000100:00100000:0.0:1789996333.087565:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086f889880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+33:11358:x1876946927552256:12345-192.168.204.37@tcp:101:lfs.0 Request processed in 269us (1118us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996333.087586:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 147 00000100:00100000:3.0:1789996333.092237:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996333.092351:0:11495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927552512 00000100:00100000:0.0:1789996333.092360:0:11495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927552512 00000100:00100000:0.0:1789996333.092419:0:11495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 39 00000100:00100000:0.0:1789996333.092429:0:11495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0876a6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+33:11358:x1876946927552512:12345-192.168.204.37@tcp:35:lfs.0 00000100:00100000:0.0:1789996333.093020:0:11495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0876a6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+34:11358:x1876946927552512:12345-192.168.204.37@tcp:35:lfs.0 Request processed in 591us (791us total) trans 4294967433 rc 0/0 00000100:00100000:0.0:1789996333.093028:0:11495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 39 00000100:00100000:2.0:1789996333.158034:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1789996333.165700:0:9163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927552768 00000100:00100000:1.0:1789996333.165718:0:9163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927552768 00000100:00100000:1.0:1789996333.165991:0:9163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 148 00000100:00100000:1.0:1789996333.166003:0:9163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0877b7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+34:11368:x1876946927552768:12345-192.168.204.37@tcp:101:lfs.0 00010000:00010000:1.0:1789996333.166027:0:9163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789996333.166059:0:9163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22c00/0x4173739f0fc8112d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b97003095e35715 expref: -99 pid: 9163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789996333.166151:0:9163:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:1.0:1789996333.166266:0:9163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22c00/0x4173739f0fc8112d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35715 expref: 36 pid: 9163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996333.166280:0:9163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e0850c28d00) 00010000:00010000:1.0:1789996333.166295:0:9163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789996333.166301:0:9163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22c00/0x4173739f0fc8112d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35715 expref: 36 pid: 9163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996333.166324:0:9163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e0876a22c00, rc 0) 00000100:00100000:1.0:1789996333.166396:0:9163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0877b7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+35:11368:x1876946927552768:12345-192.168.204.37@tcp:101:lfs.0 Request processed in 395us (8371us total) trans 4294967434 rc 301/301 00000100:00100000:1.0:1789996333.166403:0:9163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 148 00000100:00100000:2.0:1789996333.170090:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1789996333.170173:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927552896 00000100:00100000:1.0:1789996333.170184:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927552896 00000100:00100000:1.0:1789996333.170247:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 149 00000100:00100000:1.0:1789996333.170273:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0877b7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+35:11368:x1876946927552896:12345-192.168.204.37@tcp:34:lfs.0 00010000:00010000:1.0:1789996333.170363:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22600/0x4173739f0fc8113b lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996333.170380:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22600/0x4173739f0fc8113b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996333.170398:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22600/0x4173739f0fc8113b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996333.170414:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22800/0x4173739f0fc81142 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996333.170422:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22800/0x4173739f0fc81142 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996333.170428:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22800/0x4173739f0fc81142 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996333.170513:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22200/0x4173739f0fc81149 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996333.170522:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22200/0x4173739f0fc81149 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996333.170539:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22200/0x4173739f0fc81149 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789996333.170624:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22200/0x4173739f0fc81149 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996333.170637:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22600/0x4173739f0fc8113b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996333.170650:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22600/0x4173739f0fc8113b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996333.170656:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22600/0x4173739f0fc8113b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996333.170662:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0876a22600 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:1.0:1789996333.170666:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22600/0x4173739f0fc8113b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996333.170673:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22600/0x4173739f0fc8113b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996333.170685:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e084601b500) 00010000:00010000:1.0:1789996333.170688:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789996333.170693:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22600/0x4173739f0fc8113b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996333.170698:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22600/0x4173739f0fc8113b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996333.170712:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22800/0x4173739f0fc81142 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996333.170718:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22800/0x4173739f0fc81142 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996333.170723:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22800/0x4173739f0fc81142 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996333.170729:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0876a22800 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:1.0:1789996333.170738:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22800/0x4173739f0fc81142 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996333.170744:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22800/0x4173739f0fc81142 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996333.170880:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8e0861fcf300) 00010000:00010000:1.0:1789996333.170884:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789996333.170888:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22800/0x4173739f0fc81142 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996333.170894:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22800/0x4173739f0fc81142 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996333.170911:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22200/0x4173739f0fc81149 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996333.170916:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22200/0x4173739f0fc81149 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996333.170922:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22200/0x4173739f0fc81149 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996333.170927:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0876a22200 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:1.0:1789996333.170931:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22200/0x4173739f0fc81149 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996333.170937:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22200/0x4173739f0fc81149 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996333.170944:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e0850c28e00) 00010000:00010000:1.0:1789996333.170946:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789996333.170956:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22200/0x4173739f0fc81149 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996333.170962:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22200/0x4173739f0fc81149 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789996333.171033:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0877b7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+35:11368:x1876946927552896:12345-192.168.204.37@tcp:34:lfs.0 Request processed in 762us (952us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996333.171040:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 149 00000100:00100000:2.0:1789996333.179117:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1789996333.179208:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927553152 00000100:00100000:1.0:1789996333.179220:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927553152 00000100:00100000:1.0:1789996333.179279:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 40 00000100:00100000:1.0:1789996333.179290:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0877b7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+35:11368:x1876946927553152:12345-192.168.204.37@tcp:35:lfs.0 00000100:00100000:1.0:1789996333.179630:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0877b7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+36:11368:x1876946927553152:12345-192.168.204.37@tcp:35:lfs.0 Request processed in 341us (520us total) trans 4294967435 rc 0/0 00000100:00100000:1.0:1789996333.179637:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 40 00000100:00100000:2.0:1789996333.207953:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1789996333.208042:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927553408 00000100:00100000:3.0:1789996333.208051:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927553408 00000100:00100000:3.0:1789996333.208156:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 150 00000100:00100000:3.0:1789996333.208166:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086d7f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+36:11371:x1876946927553408:12345-192.168.204.37@tcp:101:lfs.0 00010000:00010000:3.0:1789996333.208190:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789996333.208208:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856c00/0x4173739f0fc81150 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b97003095e3571c expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996333.208272:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857800/0x4173739f0fc81157 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996333.208286:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857800/0x4173739f0fc81157 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996333.208298:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857800/0x4173739f0fc81157 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996333.208311:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856a00/0x4173739f0fc8115e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996333.208318:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856a00/0x4173739f0fc8115e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996333.208324:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856a00/0x4173739f0fc8115e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996333.208423:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857200/0x4173739f0fc81165 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996333.208430:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857200/0x4173739f0fc81165 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996333.208455:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857200/0x4173739f0fc81165 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789996333.208466:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1789996333.208604:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857800/0x4173739f0fc81157 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996333.208612:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857800/0x4173739f0fc81157 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996333.208618:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857800/0x4173739f0fc81157 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996333.208624:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e087f857800 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:3.0:1789996333.208628:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857800/0x4173739f0fc81157 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996333.208635:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857800/0x4173739f0fc81157 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996333.208647:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e084601b500) 00010000:00010000:3.0:1789996333.208650:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789996333.208654:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857800/0x4173739f0fc81157 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996333.208661:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857800/0x4173739f0fc81157 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996333.208673:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856a00/0x4173739f0fc8115e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996333.208678:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856a00/0x4173739f0fc8115e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996333.208693:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856a00/0x4173739f0fc8115e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996333.208698:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e087f856a00 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:3.0:1789996333.208701:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856a00/0x4173739f0fc8115e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996333.208707:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856a00/0x4173739f0fc8115e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996333.208715:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8e0846583700) 00010000:00010000:3.0:1789996333.208718:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789996333.208721:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856a00/0x4173739f0fc8115e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996333.208727:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856a00/0x4173739f0fc8115e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996333.208782:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856c00/0x4173739f0fc81150 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e3571c expref: 39 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996333.208796:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857200/0x4173739f0fc81165 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e3571c expref: 38 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996333.208803:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e0850c28e00) 00010000:00010000:3.0:1789996333.208805:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789996333.208808:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e087f857200, rc 0) 00000100:00100000:3.0:1789996333.208871:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086d7f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+38:11371:x1876946927553408:12345-192.168.204.37@tcp:101:lfs.0 Request processed in 706us (928us total) trans 4294967436 rc 0/0 00000100:00100000:3.0:1789996333.208887:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 150 00000100:00100000:2.0:1789996333.217424:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1789996333.217640:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927553536 00000100:00100000:1.0:1789996333.217650:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927553536 00000100:00100000:1.0:1789996333.217744:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 151 00000100:00100000:1.0:1789996333.217763:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086d7f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+38:11371:x1876946927553536:12345-192.168.204.37@tcp:54:lfs.0 00010000:00010000:1.0:1789996333.217827:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22200/0x4173739f0fc81173 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996333.217845:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22200/0x4173739f0fc81173 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996333.217857:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22200/0x4173739f0fc81173 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996333.217881:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22200/0x4173739f0fc81173 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996333.217899:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22200/0x4173739f0fc81173 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996333.217907:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22200/0x4173739f0fc81173 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996333.217913:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0876a22200 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:1.0:1789996333.217917:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22200/0x4173739f0fc81173 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996333.217926:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22200/0x4173739f0fc81173 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996333.217938:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e0850c28e00) 00010000:00010000:1.0:1789996333.217941:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789996333.217946:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22200/0x4173739f0fc81173 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996333.217952:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22200/0x4173739f0fc81173 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789996333.218034:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086d7f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+38:11371:x1876946927553536:12345-192.168.204.37@tcp:54:lfs.0 Request processed in 280us (619us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996333.218042:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 151 00000100:00100000:2.0:1789996333.222187:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1789996333.222292:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927553792 00000100:00100000:1.0:1789996333.222302:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927553792 00000100:00100000:1.0:1789996333.222357:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 41 00000100:00100000:1.0:1789996333.222368:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086d7f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+38:11371:x1876946927553792:12345-192.168.204.37@tcp:35:lfs.0 00000100:00100000:1.0:1789996333.226518:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086d7f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+39:11371:x1876946927553792:12345-192.168.204.37@tcp:35:lfs.0 Request processed in 4140us (4329us total) trans 4294967437 rc 0/0 00000100:00100000:1.0:1789996333.226580:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 41 00010000:00010000:1.0:1789996333.417718:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789996333.466985:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1789996333.467234:0:9163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927554048 00000100:00100000:1.0:1789996333.467245:0:9163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927554048 00000100:00100000:1.0:1789996333.467305:0:9163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 152 00000100:00100000:1.0:1789996333.467315:0:9163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086d7f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+39:11402:x1876946927554048:12345-192.168.204.37@tcp:101:cat.0 00010000:00010000:1.0:1789996333.467339:0:9163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789996333.467360:0:9163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22200/0x4173739f0fc8117a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b97003095e35723 expref: -99 pid: 9163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996333.467457:0:9163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22800/0x4173739f0fc81181 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996333.467472:0:9163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22800/0x4173739f0fc81181 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996333.467497:0:9163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22800/0x4173739f0fc81181 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789996333.467509:0:9163:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1789996333.467679:0:9163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22200/0x4173739f0fc8117a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35723 expref: 42 pid: 9163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996333.467709:0:9163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22800/0x4173739f0fc81181 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35723 expref: 41 pid: 9163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996333.467718:0:9163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e0850c28e00) 00010000:00010000:1.0:1789996333.467721:0:9163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789996333.467734:0:9163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e0876a22800, rc 0) 00000100:00100000:1.0:1789996333.467799:0:9163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086d7f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+41:11402:x1876946927554048:12345-192.168.204.37@tcp:101:cat.0 Request processed in 484us (832us total) trans 4294967438 rc 0/0 00000100:00100000:1.0:1789996333.467806:0:9163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 152 00000100:00100000:3.0:1789996333.475045:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996333.475462:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996333.475614:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927554176 00000100:00100000:0.0:1789996333.475626:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927554176 00000100:00100000:0.0:1789996333.475759:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 11 00000100:00100000:0.0:1789996333.475772:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0870598850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+41:2365:x1876946927554176:12345-192.168.204.37@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789996333.475788:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789996333.475813:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22800/0x4173739f0fc81181 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35723 expref: 41 pid: 9163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996333.475844:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e0850c28e00) 00010000:00010000:0.0:1789996333.475849:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789996333.475918:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0870598850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+40:2365:x1876946927554176:12345-192.168.204.37@tcp:103:ldlm_bl.0 Request processed in 149us (881us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996333.475927:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 11 00000100:00100000:1.0:1789996333.477183:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927554432 00000100:00100000:1.0:1789996333.477193:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927554432 00000100:00100000:1.0:1789996333.477413:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 42 00000100:00100000:1.0:1789996333.477645:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086d7f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+40:11402:x1876946927554432:12345-192.168.204.37@tcp:35:cat.0 00000100:00100000:1.0:1789996333.478947:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086d7f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+41:11402:x1876946927554432:12345-192.168.204.37@tcp:35:cat.0 Request processed in 1461us (3480us total) trans 4294967439 rc 0/0 00000100:00100000:1.0:1789996333.478957:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 42 00000100:00100000:3.0:1789996333.548367:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996333.550242:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927554688 00000100:00100000:0.0:1789996333.550258:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927554688 00000100:00100000:0.0:1789996333.550335:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 153 00000100:00100000:0.0:1789996333.550346:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0876a69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+41:11408:x1876946927554688:12345-192.168.204.37@tcp:101:dd.0 00010000:00010000:0.0:1789996333.550374:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789996333.550377:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789996333.550409:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7800/0x4173739f0fc810e7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e356f9 expref: 41 pid: 9163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996333.550506:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e084601b500) 00010000:00010000:0.0:1789996333.550511:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789996333.550535:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6c00/0x4173739f0fc8118f lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b97003095e3572a expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996333.550956:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7000/0x4173739f0fc81196 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996333.551051:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857200/0x4173739f0fc81165 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e3571c expref: 41 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996333.551060:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7000/0x4173739f0fc81196 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996333.551100:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857200/0x4173739f0fc81165 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e3571c expref: 41 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996333.551114:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857200/0x4173739f0fc81165 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e3571c expref: 41 pid: 5848 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789996333.551129:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e08810ab480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5846:1876946942236288:192.168.204.37@tcp:104: 00000100:00100000:0.0:1789996333.551292:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0858c43e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789996333.554877:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996333.554910:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e08810ab480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5846:1876946942236288:192.168.204.37@tcp:104: 00010000:00010000:0.0:1789996333.554939:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7000/0x4173739f0fc81196 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789996333.555951:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927554816 00000100:00100000:1.0:1789996333.556034:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927554816 00010000:00010000:1.0:1789996333.556078:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857200/0x4173739f0fc81165 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e3571c expref: 42 pid: 5848 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789996333.556176:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 65 00000100:00100000:1.0:1789996333.556186:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0876a6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+42:2363:x1876946927554816:12345-192.168.204.37@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789996333.556203:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789996333.556210:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857200/0x4173739f0fc81165 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e3571c expref: 42 pid: 5848 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996333.556222:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857200/0x4173739f0fc81165 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e3571c expref: 42 pid: 5848 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996333.556244:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857200/0x4173739f0fc81165 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e3571c expref: 42 pid: 5848 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996333.556279:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e0850c28e00) 00010000:00010000:1.0:1789996333.556284:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7000/0x4173739f0fc81196 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996333.556293:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7000/0x4173739f0fc81196 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996333.556301:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7000/0x4173739f0fc81196 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996333.556333:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789996333.556395:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0876a6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+41:2363:x1876946927554816:12345-192.168.204.37@tcp:103:ldlm_bl.0 Request processed in 210us (1527us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996333.556404:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 65 00010000:00010000:0.0:1789996333.556462:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7000/0x4173739f0fc81196 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996333.556470:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7000/0x4173739f0fc81196 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789996333.556489:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1789996333.556664:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6c00/0x4173739f0fc8118f lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e3572a expref: 42 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996333.556681:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7000/0x4173739f0fc81196 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e3572a expref: 41 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996333.556689:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e0850c28e00) 00010000:00010000:0.0:1789996333.556691:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789996333.556700:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e086fcb7000, rc 0) 00000100:00100000:0.0:1789996333.556726:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0876a69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+41:11408:x1876946927554688:12345-192.168.204.37@tcp:101:dd.0 Request processed in 6382us (8373us total) trans 4294967440 rc 0/0 00000100:00100000:0.0:1789996333.556733:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 153 00000100:00100000:2.0:1789996333.561473:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1789996333.561707:0:9163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927555072 00000100:00100000:1.0:1789996333.561718:0:9163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927555072 00000100:00100000:1.0:1789996333.561876:0:9163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 154 00000100:00100000:1.0:1789996333.561887:0:9163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0881081c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+41:11408:x1876946927555072:12345-192.168.204.37@tcp:36:dd.0 00010000:00010000:1.0:1789996333.562166:0:9163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22200/0x4173739f0fc811a4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996333.562183:0:9163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22200/0x4173739f0fc811a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996333.562195:0:9163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22200/0x4173739f0fc811a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789996333.562246:0:9163:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967441 00000004:00010000:1.0:1789996333.562271:0:9163:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000098f21eb5 reply state 00000000455c1390 transno 4294967442 ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22200/0x4173739f0fc811a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789996333.562286:0:9163:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789996333.562385:0:9163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0881081c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+44:11408:x1876946927555072:12345-192.168.204.37@tcp:36:dd.0 Request processed in 499us (920us total) trans 4294967442 rc 0/0 00000100:00100000:1.0:1789996333.562393:0:9163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 154 00000020:00080000:1.0:1789996333.562398:0:9163:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789996333.566131:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22200/0x4173739f0fc811a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996333.566149:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22200/0x4173739f0fc811a4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996333.566158:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22200/0x4173739f0fc811a4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996333.566164:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0876a22200 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:0.0:1789996333.566170:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22200/0x4173739f0fc811a4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996333.566177:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22200/0x4173739f0fc811a4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996333.566194:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e0850c28e00) 00010000:00010000:0.0:1789996333.566197:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789996333.566201:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22200/0x4173739f0fc811a4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996333.566207:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22200/0x4173739f0fc811a4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789996333.838758:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1789996333.838856:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927555200 00000100:00100000:1.0:1789996333.838866:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927555200 00000100:00100000:1.0:1789996333.838930:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 155 00000100:00100000:1.0:1789996333.838940:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0881083100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+43:11422:x1876946927555200:12345-192.168.204.37@tcp:101:stat.0 00010000:00010000:1.0:1789996333.838965:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789996333.838986:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22600/0x4173739f0fc811ab lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b97003095e35731 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996333.840189:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22c00/0x4173739f0fc811b2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996333.840208:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22c00/0x4173739f0fc811b2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996333.840220:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22c00/0x4173739f0fc811b2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996333.840235:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22000/0x4173739f0fc811b9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996333.840246:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22000/0x4173739f0fc811b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996333.840254:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22000/0x4173739f0fc811b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996333.841405:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22200/0x4173739f0fc811c0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996333.841432:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7000/0x4173739f0fc81196 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e3572a expref: 44 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996333.841441:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22200/0x4173739f0fc811c0 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996333.841485:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7000/0x4173739f0fc81196 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e3572a expref: 44 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996333.841500:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7000/0x4173739f0fc81196 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e3572a expref: 44 pid: 5846 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789996333.841522:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086f88ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5847:1876946942236416:192.168.204.37@tcp:104: 00000100:00100000:1.0:1789996333.841649:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e08494c9780 going to sleep for 11 seconds 00000100:00100000:2.0:1789996333.845631:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1789996333.845739:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086f88ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5847:1876946942236416:192.168.204.37@tcp:104: 00010000:00010000:1.0:1789996333.845906:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22200/0x4173739f0fc811c0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789996333.845975:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927555456 00000100:00100000:3.0:1789996333.845982:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927555456 00000100:00100000:3.0:1789996333.846084:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 43 00000100:00100000:3.0:1789996333.846095:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0881083b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+45:5599:x1876946927555456:12345-192.168.204.37@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1789996333.846393:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0881083b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+46:5599:x1876946927555456:12345-192.168.204.37@tcp:35:ldlm_bl.0 Request processed in 300us (769us total) trans 4294967443 rc 0/0 00000100:00100000:3.0:1789996333.846401:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 43 00000100:00100000:2.0:1789996333.850885:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1789996333.851009:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927555584 00000100:00100000:1.0:1789996333.851019:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927555584 00010000:00010000:1.0:1789996333.851059:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7000/0x4173739f0fc81196 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e3572a expref: 46 pid: 5846 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789996333.851103:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 66 00000100:00100000:1.0:1789996333.851126:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0881080380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+46:2362:x1876946927555584:12345-192.168.204.37@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789996333.851471:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789996333.851480:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7000/0x4173739f0fc81196 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e3572a expref: 46 pid: 5846 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996333.851494:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7000/0x4173739f0fc81196 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e3572a expref: 46 pid: 5846 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996333.851525:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7000/0x4173739f0fc81196 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e3572a expref: 46 pid: 5846 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996333.851746:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e0850c28e00) 00010000:00010000:1.0:1789996333.851754:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22200/0x4173739f0fc811c0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996333.851764:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22200/0x4173739f0fc811c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996333.851772:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22200/0x4173739f0fc811c0 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996333.851912:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789996333.851977:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0881080380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+45:2362:x1876946927555584:12345-192.168.204.37@tcp:103:ldlm_bl.0 Request processed in 852us (1101us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996333.851987:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 66 00010000:00010000:2.0:1789996333.853057:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22200/0x4173739f0fc811c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996333.853069:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22200/0x4173739f0fc811c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789996333.853118:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1789996333.853122:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789996333.853243:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22200/0x4173739f0fc811c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996333.853257:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22200/0x4173739f0fc811c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996333.853266:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22c00/0x4173739f0fc811b2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996333.853272:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22c00/0x4173739f0fc811b2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996333.853279:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22c00/0x4173739f0fc811b2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996333.853286:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0876a22c00 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:2.0:1789996333.853290:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22c00/0x4173739f0fc811b2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996333.853297:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22c00/0x4173739f0fc811b2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996333.853322:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e084601b500) 00010000:00010000:2.0:1789996333.853324:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789996333.853459:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22c00/0x4173739f0fc811b2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996333.853467:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22c00/0x4173739f0fc811b2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996333.853481:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22000/0x4173739f0fc811b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996333.853486:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22000/0x4173739f0fc811b9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996333.853491:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22000/0x4173739f0fc811b9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996333.853496:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0876a22000 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:2.0:1789996333.853498:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22000/0x4173739f0fc811b9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996333.853504:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22000/0x4173739f0fc811b9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996333.853523:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8e0861fcf300) 00010000:00010000:2.0:1789996333.853526:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789996333.853529:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22000/0x4173739f0fc811b9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996333.853535:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22000/0x4173739f0fc811b9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996333.853769:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22600/0x4173739f0fc811ab lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35731 expref: 45 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996333.853782:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22200/0x4173739f0fc811c0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35731 expref: 44 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996333.853789:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e0850c28e00) 00010000:00010000:2.0:1789996333.853791:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789996333.853793:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e0876a22200, rc 0) 00000100:00100000:2.0:1789996333.853918:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0881083100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+44:11422:x1876946927555200:12345-192.168.204.37@tcp:101:stat.0 Request processed in 14980us (15169us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996333.853927:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 155 00000100:00100000:2.0:1789996333.868384:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996333.868490:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996333.868833:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996333.868860:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996333.868903:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927555840 00000100:00100000:2.0:1789996333.868913:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927555840 00000100:00100000:2.0:1789996333.868960:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927555968 00000100:00100000:2.0:1789996333.868963:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927555968 00000100:00100000:2.0:1789996333.869000:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 78 00000100:00100000:2.0:1789996333.869010:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0881082a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+7:2363:x1876946927555840:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:2.0:1789996333.869081:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0881082a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+7:2363:x1876946927555840:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 72us (767us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996333.869088:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 78 00000100:00100000:2.0:1789996333.869107:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 79 00000100:00100000:2.0:1789996333.869129:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0881083480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+6:2363:x1876946927555968:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:2.0:1789996333.869157:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0881083480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+6:2363:x1876946927555968:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 30us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996333.869165:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 79 00000100:00100000:3.0:1789996333.869652:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927555712 00000100:00100000:3.0:1789996333.869658:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927555712 00000100:00100000:3.0:1789996333.869696:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 288 00000100:00100000:3.0:1789996333.869704:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852ba3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f78f7903-47ba-48a7-bb82-1f616cb85fc0+13:2363:x1876946927555712:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:3.0:1789996333.869744:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852ba3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f78f7903-47ba-48a7-bb82-1f616cb85fc0+13:2363:x1876946927555712:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 41us (911us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996333.869750:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 288 00000100:00080000:1.0:1789996333.870013:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789996333.870937:0:9163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927556096 00000100:00100000:0.0:1789996333.870944:0:9163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927556096 00000100:00100000:0.0:1789996333.871034:0:9163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 138 00000100:00100000:0.0:1789996333.871043:0:9163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0881081180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cfc759a1-09a6-40ba-80a8-7399de51b555+5:2363:x1876946927556096:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:0.0:1789996333.871111:0:9163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0881081180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cfc759a1-09a6-40ba-80a8-7399de51b555+5:2363:x1876946927556096:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 70us (2620us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996333.871119:0:9163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 138 00000100:00080000:1.0:1789996333.871844:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789996333.927217:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996333.927317:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927556352 00000100:00100000:0.0:1789996333.927329:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927556352 00000100:00100000:0.0:1789996333.927389:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 156 00000100:00100000:0.0:1789996333.927401:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0881081500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+44:11428:x1876946927556352:12345-192.168.204.37@tcp:36:truncate.0 00010000:00010000:0.0:1789996333.927459:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789996333.927487:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22200/0x4173739f0fc811c0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35731 expref: 44 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996333.927505:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e0850c28e00) 00010000:00010000:0.0:1789996333.927510:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789996333.929203:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7800/0x4173739f0fc811c7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996333.929226:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7800/0x4173739f0fc811c7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996333.929237:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7800/0x4173739f0fc811c7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789996333.929295:0:5846:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967444 00000004:00010000:0.0:1789996333.929322:0:5846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001511d226 reply state 00000000a3d7247e transno 4294967445 ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7800/0x4173739f0fc811c7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789996333.929332:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789996333.929439:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0881081500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+46:11428:x1876946927556352:12345-192.168.204.37@tcp:36:truncate.0 Request processed in 2038us (2229us total) trans 4294967445 rc 0/0 00000100:00100000:0.0:1789996333.929464:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 156 00000020:00080000:0.0:1789996333.929470:0:5846:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789996333.940800:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7800/0x4173739f0fc811c7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996333.940819:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7800/0x4173739f0fc811c7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996333.940827:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7800/0x4173739f0fc811c7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996333.940851:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e086fcb7800 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:3.0:1789996333.940856:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7800/0x4173739f0fc811c7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996333.940967:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7800/0x4173739f0fc811c7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996333.940987:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e0850c28e00) 00010000:00010000:3.0:1789996333.940991:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789996333.940997:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7800/0x4173739f0fc811c7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996333.941003:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7800/0x4173739f0fc811c7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789996334.056814:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086f88ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e0c28cd8-555e-481f-bd03-c3b02aee51c5:3313:1876946942236544:0@lo:400:kworker.0 00000100:00100000:2.0:1789996334.056892:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996334.057003:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942236544 00000100:00100000:0.0:1789996334.057012:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942236544 00000100:00100000:0.0:1789996334.057057:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:0.0:1789996334.057066:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852ba3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0c28cd8-555e-481f-bd03-c3b02aee51c5+19:3313:x1876946942236544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789996334.057177:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086f88a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876946942236672:0@lo:400:kworker.0 00000100:00100000:3.0:1789996334.057209:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789996334.057291:0:9163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942236672 00000100:00100000:3.0:1789996334.057295:0:9163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942236672 00000100:00100000:3.0:1789996334.057323:0:9163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1789996334.057338:0:9163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0876a69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876946942236672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789996334.057394:0:9163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0876a69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876946942236672:12345-0@lo:400:kworker.0 Request processed in 51us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996334.057400:0:9163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1789996334.057451:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086f88a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876946942236672:0@lo:400:kworker.0 00000100:00100000:0.0:1789996334.057712:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852ba3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0c28cd8-555e-481f-bd03-c3b02aee51c5+19:3313:x1876946942236544:12345-0@lo:400:kworker.0 Request processed in 646us (819us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996334.057718:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:2.0:1789996334.057949:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086f88ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e0c28cd8-555e-481f-bd03-c3b02aee51c5:3313:1876946942236544:0@lo:400:kworker.0 00000100:00100000:3.0:1789996334.057965:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086f88b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1876946942236800:0@lo:400:kworker.0 00000100:00100000:3.0:1789996334.058001:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996334.058133:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086f888e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876946942236928:0@lo:400:kworker.0 00000100:00100000:0.0:1789996334.058163:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996334.058195:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942236928 00000100:00100000:0.0:1789996334.058200:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942236928 00000100:00100000:0.0:1789996334.058227:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1789996334.058234:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e08810ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3316:x1876946942236928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789996334.058269:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e08810ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3316:x1876946942236928:12345-0@lo:400:kworker.0 Request processed in 36us (106us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996334.058276:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1789996334.058303:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086f888e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876946942236928:0@lo:400:kworker.0 00000100:00100000:2.0:1789996334.058818:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942236800 00000100:00100000:2.0:1789996334.058823:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942236800 00000100:00100000:2.0:1789996334.058878:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1789996334.058885:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0876a68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876946942236800:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1789996334.058905:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789996334.059176:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086f88ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876946942237184:0@lo:400:kworker.0 00000100:00100000:1.0:1789996334.059207:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996334.059237:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0876a68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876946942236800:12345-0@lo:400:kworker.0 Request processed in 353us (1235us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996334.059238:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789996334.059244:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086f888e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3314:1876946942237056:0@lo:400:kworker.0 00000100:00100000:2.0:1789996334.059245:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1789996334.059266:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996334.059286:0:9163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942237056 00000100:00100000:1.0:1789996334.059288:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942237184 00000100:00100000:2.0:1789996334.059290:0:9163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942237056 00000100:00100000:1.0:1789996334.059291:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942237184 00000100:00100000:2.0:1789996334.059325:0:9163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1789996334.059332:0:9163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086f88b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876946942237056:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1789996334.059332:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789996334.059336:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789996334.059364:0:9163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086f88b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876946942237056:12345-0@lo:400:kworker.0 Request processed in 33us (97us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996334.059371:0:9163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1789996334.059385:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086f888e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3314:1876946942237056:0@lo:400:kworker.0 00000100:00100000:3.0:1789996334.059646:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086f88b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1876946942236800:0@lo:400:kworker.0 00000100:00100000:1.0:1789996334.059953:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1789996334.059961:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086f88a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1876946942237184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789996334.060008:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086f88a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1876946942237184:12345-0@lo:400:kworker.0 Request processed in 48us (800us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996334.060015:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1789996334.060075:0:3314:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:0.0:1789996334.060081:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e086fdeb100, transno 4294967312 00000100:00100000:0.0:1789996334.060153:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086f88ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876946942237184:0@lo:400:kworker.0 00000100:00100000:2.0:1789996334.064278:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996334.065807:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927556480 00000100:00100000:0.0:1789996334.065821:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927556480 00000100:00100000:0.0:1789996334.065937:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 157 00000100:00100000:0.0:1789996334.065948:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0881082d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+45:11442:x1876946927556480:12345-192.168.204.37@tcp:101:stat.0 00010000:00010000:0.0:1789996334.065970:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789996334.065990:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6000/0x4173739f0fc811ce lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b97003095e35738 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996334.066054:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7e00/0x4173739f0fc811d5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996334.066069:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7e00/0x4173739f0fc811d5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996334.066080:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7e00/0x4173739f0fc811d5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996334.066095:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6a00/0x4173739f0fc811dc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996334.066102:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6a00/0x4173739f0fc811dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996334.066109:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6a00/0x4173739f0fc811dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996334.066200:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7800/0x4173739f0fc811e3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996334.066208:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7800/0x4173739f0fc811e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996334.066227:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7800/0x4173739f0fc811e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789996334.066261:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:0.0:1789996334.066266:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789996334.066284:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7800/0x4173739f0fc811e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996334.066295:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7800/0x4173739f0fc811e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996334.066303:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7e00/0x4173739f0fc811d5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996334.066310:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7e00/0x4173739f0fc811d5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996334.066316:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7e00/0x4173739f0fc811d5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996334.066322:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e086fcb7e00 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:0.0:1789996334.066326:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7e00/0x4173739f0fc811d5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996334.066333:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7e00/0x4173739f0fc811d5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996334.066343:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e084601b500) 00010000:00010000:0.0:1789996334.066346:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789996334.066350:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7e00/0x4173739f0fc811d5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996334.066366:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7e00/0x4173739f0fc811d5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996334.066380:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6a00/0x4173739f0fc811dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996334.066386:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6a00/0x4173739f0fc811dc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996334.066392:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6a00/0x4173739f0fc811dc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996334.066397:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e086fcb6a00 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:0.0:1789996334.066400:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6a00/0x4173739f0fc811dc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996334.066405:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6a00/0x4173739f0fc811dc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996334.066413:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8e0850c28700) 00010000:00010000:0.0:1789996334.066415:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789996334.066418:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6a00/0x4173739f0fc811dc lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996334.066424:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6a00/0x4173739f0fc811dc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996334.066454:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6000/0x4173739f0fc811ce lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35738 expref: 47 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996334.066467:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7800/0x4173739f0fc811e3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35738 expref: 46 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996334.066481:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e0850c28e00) 00010000:00010000:0.0:1789996334.066483:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789996334.066486:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e086fcb7800, rc 0) 00000100:00100000:0.0:1789996334.066606:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0881082d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+46:11442:x1876946927556480:12345-192.168.204.37@tcp:101:stat.0 Request processed in 659us (2338us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996334.066613:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 157 00000100:00100000:0.0:1789996334.128072:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1789996334.128518:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927556736 00000100:00100000:3.0:1789996334.128532:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927556736 00000100:00100000:3.0:1789996334.128963:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 158 00000100:00100000:3.0:1789996334.128976:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e08810a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+46:11452:x1876946927556736:12345-192.168.204.37@tcp:101:lfs.0 00010000:00010000:3.0:1789996334.129013:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789996334.129036:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856a00/0x4173739f0fc811ea lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b97003095e3573f expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789996334.129124:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:3.0:1789996334.129241:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856a00/0x4173739f0fc811ea lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e3573f expref: 48 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996334.129255:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e0850c28d00) 00010000:00010000:3.0:1789996334.129258:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789996334.129264:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856a00/0x4173739f0fc811ea lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e3573f expref: 48 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996334.129278:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e087f856a00, rc 0) 00000100:00100000:3.0:1789996334.129357:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e08810a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+47:11452:x1876946927556736:12345-192.168.204.37@tcp:101:lfs.0 Request processed in 384us (1294us total) trans 4294967446 rc 301/301 00000100:00100000:3.0:1789996334.129364:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 158 00000100:00100000:1.0:1789996334.132296:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996334.132532:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927556992 00000100:00100000:0.0:1789996334.132934:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927556992 00000100:00100000:0.0:1789996334.132997:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 44 00000100:00100000:0.0:1789996334.133007:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0850a22850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+47:11452:x1876946927556992:12345-192.168.204.37@tcp:35:lfs.0 00000100:00100000:0.0:1789996334.134058:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0850a22850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+48:11452:x1876946927556992:12345-192.168.204.37@tcp:35:lfs.0 Request processed in 1047us (1766us total) trans 4294967447 rc 0/0 00000100:00100000:0.0:1789996334.134068:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 44 00000100:00100000:2.0:1789996334.201125:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1789996334.201233:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927557248 00000100:00100000:1.0:1789996334.201243:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927557248 00000100:00100000:1.0:1789996334.201312:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 159 00000100:00100000:1.0:1789996334.201323:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0881081f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+48:11458:x1876946927557248:12345-192.168.204.37@tcp:101:bash.0 00010000:00010000:1.0:1789996334.201348:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789996334.201368:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22e00/0x4173739f0fc811f8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b97003095e35746 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996334.201485:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23a00/0x4173739f0fc811ff lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996334.201501:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7800/0x4173739f0fc811e3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35738 expref: 49 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996334.201522:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23a00/0x4173739f0fc811ff lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996334.201729:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7800/0x4173739f0fc811e3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35738 expref: 49 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996334.201758:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7800/0x4173739f0fc811e3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35738 expref: 49 pid: 5846 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789996334.201774:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086f88ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5847:1876946942237312:192.168.204.37@tcp:104: 00000100:00100000:1.0:1789996334.201868:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e08494c9780 going to sleep for 11 seconds 00000100:00100000:1.0:1789996334.204273:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086f88ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5847:1876946942237312:192.168.204.37@tcp:104: 00010000:00010000:1.0:1789996334.204305:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23a00/0x4173739f0fc811ff lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789996334.204309:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1789996334.204387:0:8520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927557376 00000100:00100000:3.0:1789996334.204395:0:8520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927557376 00010000:00010000:3.0:1789996334.204428:0:8520:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7800/0x4173739f0fc811e3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35738 expref: 50 pid: 5846 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789996334.204466:0:8520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 67 00000100:00100000:3.0:1789996334.204483:0:8520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0881080700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+50:2362:x1876946927557376:12345-192.168.204.37@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789996334.204496:0:8520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789996334.204503:0:8520:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7800/0x4173739f0fc811e3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35738 expref: 50 pid: 5846 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996334.204741:0:8520:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7800/0x4173739f0fc811e3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35738 expref: 50 pid: 5846 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996334.204766:0:8520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7800/0x4173739f0fc811e3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35738 expref: 50 pid: 5846 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996334.204848:0:8520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e0850c28e00) 00010000:00010000:3.0:1789996334.204853:0:8520:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23a00/0x4173739f0fc811ff lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996334.204864:0:8520:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23a00/0x4173739f0fc811ff lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996334.204873:0:8520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23a00/0x4173739f0fc811ff lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996334.204938:0:8520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789996334.204994:0:8520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0881080700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+49:2362:x1876946927557376:12345-192.168.204.37@tcp:103:ldlm_bl.0 Request processed in 512us (685us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996334.205001:0:8520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 67 00010000:00010000:1.0:1789996334.205409:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23a00/0x4173739f0fc811ff lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996334.205418:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23a00/0x4173739f0fc811ff lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789996334.205437:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:1.0:1789996334.207709:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22e00/0x4173739f0fc811f8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35746 expref: 50 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996334.207736:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23a00/0x4173739f0fc811ff lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35746 expref: 49 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996334.207746:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e0850c28e00) 00010000:00010000:1.0:1789996334.207749:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789996334.207752:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e0876a23a00, rc 0) 00000100:00100000:1.0:1789996334.207889:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0881081f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+49:11458:x1876946927557248:12345-192.168.204.37@tcp:101:bash.0 Request processed in 6566us (6773us total) trans 4294967448 rc 0/0 00000100:00100000:1.0:1789996334.207917:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 159 00000100:00100000:2.0:1789996334.212347:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1789996334.212504:0:9163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927557632 00000100:00100000:3.0:1789996334.212524:0:9163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927557632 00000100:00100000:3.0:1789996334.212604:0:9163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 160 00000100:00100000:3.0:1789996334.212614:0:9163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0881083800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+49:11458:x1876946927557632:12345-192.168.204.37@tcp:36:bash.0 00010000:00010000:3.0:1789996334.213054:0:9163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856a00/0x4173739f0fc8120d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996334.213072:0:9163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856a00/0x4173739f0fc8120d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996334.213084:0:9163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856a00/0x4173739f0fc8120d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789996334.213138:0:9163:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967449 00000004:00010000:3.0:1789996334.213162:0:9163:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a7eebce9 reply state 00000000cdea7412 transno 4294967450 ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856a00/0x4173739f0fc8120d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789996334.213170:0:9163:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789996334.213309:0:9163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0881083800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+52:11458:x1876946927557632:12345-192.168.204.37@tcp:36:bash.0 Request processed in 695us (970us total) trans 4294967450 rc 0/0 00000100:00100000:3.0:1789996334.213317:0:9163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 160 00000020:00080000:3.0:1789996334.213321:0:9163:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789996334.224743:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856a00/0x4173739f0fc8120d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996334.224762:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856a00/0x4173739f0fc8120d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996334.224770:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856a00/0x4173739f0fc8120d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996334.224777:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e087f856a00 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:3.0:1789996334.224781:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856a00/0x4173739f0fc8120d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996334.224790:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856a00/0x4173739f0fc8120d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996334.224820:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e0850c28e00) 00010000:00010000:3.0:1789996334.224823:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789996334.224829:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856a00/0x4173739f0fc8120d lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996334.224837:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856a00/0x4173739f0fc8120d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789996334.233434:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996334.236818:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927557760 00000100:00100000:0.0:1789996334.236835:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927557760 00000100:00100000:0.0:1789996334.236912:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 161 00000100:00100000:0.0:1789996334.236923:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0881080e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+51:11458:x1876946927557760:12345-192.168.204.37@tcp:101:bash.0 00010000:00010000:0.0:1789996334.236948:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789996334.236967:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6000/0x4173739f0fc81214 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b97003095e3574d expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996334.237045:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6a00/0x4173739f0fc8121b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996334.237077:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23a00/0x4173739f0fc811ff lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35746 expref: 52 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996334.237087:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6a00/0x4173739f0fc8121b lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996334.237137:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23a00/0x4173739f0fc811ff lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35746 expref: 52 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996334.237150:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23a00/0x4173739f0fc811ff lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35746 expref: 52 pid: 5847 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789996334.237164:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086d7f2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5846:1876946942237440:192.168.204.37@tcp:104: 00000100:00100000:0.0:1789996334.237262:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e07432d6b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789996334.246976:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996334.247138:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086d7f2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5846:1876946942237440:192.168.204.37@tcp:104: 00010000:00010000:0.0:1789996334.247251:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6a00/0x4173739f0fc8121b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789996334.249715:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927557888 00000100:00100000:3.0:1789996334.249749:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927557888 00010000:00010000:3.0:1789996334.249795:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23a00/0x4173739f0fc811ff lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35746 expref: 53 pid: 5847 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789996334.249959:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 68 00000100:00100000:3.0:1789996334.249970:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0881080a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+53:2362:x1876946927557888:12345-192.168.204.37@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789996334.249987:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789996334.249994:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23a00/0x4173739f0fc811ff lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35746 expref: 53 pid: 5847 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996334.250008:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23a00/0x4173739f0fc811ff lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35746 expref: 53 pid: 5847 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996334.250030:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23a00/0x4173739f0fc811ff lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35746 expref: 53 pid: 5847 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996334.250046:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e0850c28e00) 00010000:00010000:3.0:1789996334.250052:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6a00/0x4173739f0fc8121b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996334.250076:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6a00/0x4173739f0fc8121b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996334.250085:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6a00/0x4173739f0fc8121b lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996334.250137:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789996334.250189:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6a00/0x4173739f0fc8121b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789996334.250201:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0881080a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+52:2362:x1876946927557888:12345-192.168.204.37@tcp:103:ldlm_bl.0 Request processed in 230us (3232us total) trans 0 rc 0/0 00010000:00010000:0.0:1789996334.250202:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6a00/0x4173739f0fc8121b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789996334.250216:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 68 00000004:00200000:0.0:1789996334.250259:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1789996334.250265:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789996334.250284:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6a00/0x4173739f0fc8121b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996334.250329:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6000/0x4173739f0fc81214 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e3574d expref: 52 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996334.250346:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6a00/0x4173739f0fc8121b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e3574d expref: 51 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996334.250353:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e0850c28e00) 00010000:00010000:0.0:1789996334.250356:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789996334.250358:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e086fcb6a00, rc 0) 00000100:00100000:0.0:1789996334.250388:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0881080e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+51:11458:x1876946927557760:12345-192.168.204.37@tcp:101:bash.0 Request processed in 13467us (16964us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996334.250395:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 161 00000100:00100000:2.0:1789996334.255198:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1789996334.255642:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927558144 00000100:00100000:3.0:1789996334.255655:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927558144 00000100:00100000:3.0:1789996334.255997:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 45 00000100:00100000:3.0:1789996334.256007:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0881082680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+51:11458:x1876946927558144:12345-192.168.204.37@tcp:35:bash.0 00000100:00100000:3.0:1789996334.256249:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0881082680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+52:11458:x1876946927558144:12345-192.168.204.37@tcp:35:bash.0 Request processed in 243us (1060us total) trans 4294967451 rc 0/0 00000100:00100000:3.0:1789996334.256257:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 45 00000100:00100000:2.0:1789996334.374089:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996334.374256:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927558400 00000100:00100000:0.0:1789996334.374267:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927558400 00000100:00100000:0.0:1789996334.374324:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 162 00000100:00100000:0.0:1789996334.374334:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0881081880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+52:11468:x1876946927558400:12345-192.168.204.37@tcp:101:lfs.0 00010000:00010000:0.0:1789996334.374359:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789996334.374379:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6000/0x4173739f0fc81222 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b97003095e35754 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789996334.374464:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:1.0:1789996334.377203:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6000/0x4173739f0fc81222 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35754 expref: 54 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996334.377223:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e0850c28d00) 00010000:00010000:1.0:1789996334.377226:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789996334.377231:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6000/0x4173739f0fc81222 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35754 expref: 54 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996334.377247:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e086fcb6000, rc 0) 00000100:00100000:1.0:1789996334.377325:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0881081880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+53:11468:x1876946927558400:12345-192.168.204.37@tcp:101:lfs.0 Request processed in 2991us (3245us total) trans 4294967452 rc 301/301 00000100:00100000:1.0:1789996334.377334:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 162 00000100:00100000:1.0:1789996334.382332:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996334.382583:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927558528 00000100:00100000:2.0:1789996334.382593:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927558528 00000100:00100000:2.0:1789996334.382644:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 163 00000100:00100000:2.0:1789996334.382653:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086f88ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+53:11468:x1876946927558528:12345-192.168.204.37@tcp:34:lfs.0 00010000:00010000:2.0:1789996334.382745:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5a00/0x4173739f0fc81230 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996334.382761:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5a00/0x4173739f0fc81230 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996334.382775:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5a00/0x4173739f0fc81230 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996334.382790:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4800/0x4173739f0fc81237 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996334.382797:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4800/0x4173739f0fc81237 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996334.382809:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4800/0x4173739f0fc81237 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996334.383066:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4e00/0x4173739f0fc8123e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996334.383076:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4e00/0x4173739f0fc8123e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996334.383153:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4e00/0x4173739f0fc8123e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789996334.383196:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4e00/0x4173739f0fc8123e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996334.383208:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5a00/0x4173739f0fc81230 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996334.383216:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5a00/0x4173739f0fc81230 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996334.383222:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5a00/0x4173739f0fc81230 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996334.383229:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0842de5a00 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:2.0:1789996334.383233:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5a00/0x4173739f0fc81230 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996334.383241:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5a00/0x4173739f0fc81230 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996334.383252:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e084601b500) 00010000:00010000:2.0:1789996334.383254:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789996334.383259:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5a00/0x4173739f0fc81230 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996334.383266:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5a00/0x4173739f0fc81230 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996334.383278:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4800/0x4173739f0fc81237 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996334.383291:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4800/0x4173739f0fc81237 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996334.383298:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4800/0x4173739f0fc81237 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996334.383303:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0842de4800 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:2.0:1789996334.383306:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4800/0x4173739f0fc81237 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996334.383313:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4800/0x4173739f0fc81237 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996334.383321:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8e084601be00) 00010000:00010000:2.0:1789996334.383323:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789996334.383326:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4800/0x4173739f0fc81237 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996334.383332:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4800/0x4173739f0fc81237 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996334.383346:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4e00/0x4173739f0fc8123e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996334.383351:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4e00/0x4173739f0fc8123e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996334.383358:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4e00/0x4173739f0fc8123e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996334.383363:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0842de4e00 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:2.0:1789996334.383371:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4e00/0x4173739f0fc8123e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996334.383378:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4e00/0x4173739f0fc8123e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996334.383386:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e0850c28e00) 00010000:00010000:2.0:1789996334.383388:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789996334.383391:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4e00/0x4173739f0fc8123e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996334.383398:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4e00/0x4173739f0fc8123e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789996334.383564:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086f88ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+53:11468:x1876946927558528:12345-192.168.204.37@tcp:34:lfs.0 Request processed in 888us (1217us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996334.383573:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 163 00000100:00100000:2.0:1789996334.393316:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996334.393392:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927558784 00000100:00100000:0.0:1789996334.393412:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927558784 00000100:00100000:0.0:1789996334.393469:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 46 00000100:00100000:0.0:1789996334.393478:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0881080000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+53:11468:x1876946927558784:12345-192.168.204.37@tcp:35:lfs.0 00000100:00100000:0.0:1789996334.393772:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0881080000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+54:11468:x1876946927558784:12345-192.168.204.37@tcp:35:lfs.0 Request processed in 293us (463us total) trans 4294967453 rc 0/0 00000100:00100000:0.0:1789996334.393801:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 46 00000100:00100000:3.0:1789996334.422819:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996334.422951:0:9163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927559040 00000100:00100000:2.0:1789996334.422961:0:9163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927559040 00000100:00100000:2.0:1789996334.423135:0:9163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 164 00000100:00100000:2.0:1789996334.423147:0:9163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0876a6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+54:11471:x1876946927559040:12345-192.168.204.37@tcp:101:lfs.0 00010000:00010000:2.0:1789996334.423171:0:9163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789996334.423191:0:9163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4e00/0x4173739f0fc81245 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b97003095e3575b expref: -99 pid: 9163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996334.423259:0:9163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4800/0x4173739f0fc8124c lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996334.423272:0:9163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4800/0x4173739f0fc8124c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996334.423297:0:9163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4800/0x4173739f0fc8124c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996334.423312:0:9163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5a00/0x4173739f0fc81253 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996334.423320:0:9163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5a00/0x4173739f0fc81253 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996334.423326:0:9163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5a00/0x4173739f0fc81253 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996334.423451:0:9163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4200/0x4173739f0fc8125a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996334.423460:0:9163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4200/0x4173739f0fc8125a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996334.423466:0:9163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4200/0x4173739f0fc8125a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789996334.423474:0:9163:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1789996334.423617:0:9163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4800/0x4173739f0fc8124c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996334.423625:0:9163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4800/0x4173739f0fc8124c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996334.423631:0:9163:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4800/0x4173739f0fc8124c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996334.423637:0:9163:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0842de4800 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:2.0:1789996334.423650:0:9163:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4800/0x4173739f0fc8124c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996334.423658:0:9163:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4800/0x4173739f0fc8124c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996334.423669:0:9163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e084601b500) 00010000:00010000:2.0:1789996334.423672:0:9163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789996334.423677:0:9163:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4800/0x4173739f0fc8124c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996334.423683:0:9163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4800/0x4173739f0fc8124c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996334.423696:0:9163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5a00/0x4173739f0fc81253 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996334.423703:0:9163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5a00/0x4173739f0fc81253 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996334.423709:0:9163:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5a00/0x4173739f0fc81253 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996334.423714:0:9163:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0842de5a00 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:2.0:1789996334.423716:0:9163:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5a00/0x4173739f0fc81253 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996334.423722:0:9163:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5a00/0x4173739f0fc81253 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996334.423729:0:9163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8e084601be00) 00010000:00010000:2.0:1789996334.423731:0:9163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789996334.423741:0:9163:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5a00/0x4173739f0fc81253 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996334.423747:0:9163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5a00/0x4173739f0fc81253 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996334.423788:0:9163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4e00/0x4173739f0fc81245 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e3575b expref: 57 pid: 9163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996334.423801:0:9163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4200/0x4173739f0fc8125a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e3575b expref: 56 pid: 9163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996334.423809:0:9163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e0850c28e00) 00010000:00010000:2.0:1789996334.423811:0:9163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789996334.423813:0:9163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e0842de4200, rc 0) 00000100:00100000:2.0:1789996334.423874:0:9163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0876a6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+56:11471:x1876946927559040:12345-192.168.204.37@tcp:101:lfs.0 Request processed in 729us (1064us total) trans 4294967454 rc 0/0 00000100:00100000:2.0:1789996334.423881:0:9163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 164 00000100:00100000:1.0:1789996334.426447:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996334.426669:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927559168 00000100:00100000:2.0:1789996334.426678:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927559168 00000100:00100000:2.0:1789996334.426874:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 165 00000100:00100000:2.0:1789996334.426885:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086f88b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+56:11471:x1876946927559168:12345-192.168.204.37@tcp:54:lfs.0 00000100:00100000:3.0:1789996334.427012:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00010000:00010000:2.0:1789996334.427930:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0841524e00/0x4173739f0fc81268 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996334.427947:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0841524e00/0x4173739f0fc81268 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996334.427959:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0841524e00/0x4173739f0fc81268 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996334.428006:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0841524e00/0x4173739f0fc81268 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996334.428014:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0841524e00/0x4173739f0fc81268 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996334.428021:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e0841524e00/0x4173739f0fc81268 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996334.428026:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0841524e00 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:2.0:1789996334.428031:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0841524e00/0x4173739f0fc81268 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996334.428038:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0841524e00/0x4173739f0fc81268 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996334.428050:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e0850c28e00) 00010000:00010000:2.0:1789996334.428053:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789996334.428058:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e0841524e00/0x4173739f0fc81268 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996334.428064:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0841524e00/0x4173739f0fc81268 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789996334.428143:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086f88b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+56:11471:x1876946927559168:12345-192.168.204.37@tcp:54:lfs.0 Request processed in 1258us (1704us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996334.428151:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 165 00000100:00100000:1.0:1789996334.428237:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927559296 00000100:00100000:1.0:1789996334.428245:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927559296 00000100:00100000:1.0:1789996334.428343:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 12 00000100:00100000:1.0:1789996334.428353:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0876a68e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+56:2362:x1876946927559296:12345-192.168.204.37@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789996334.428366:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789996334.428381:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4200/0x4173739f0fc8125a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e3575b expref: 56 pid: 9163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996334.428394:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e0850c28e00) 00010000:00010000:1.0:1789996334.428398:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789996334.428418:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0876a68e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+55:2362:x1876946927559296:12345-192.168.204.37@tcp:103:ldlm_bl.0 Request processed in 68us (1408us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996334.428431:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 12 00000100:00100000:1.0:1789996334.430818:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996334.431086:0:11495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927559552 00000100:00100000:2.0:1789996334.431105:0:11495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927559552 00000100:00100000:2.0:1789996334.431150:0:11495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 47 00000100:00100000:2.0:1789996334.431174:0:11495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086f888e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+55:11471:x1876946927559552:12345-192.168.204.37@tcp:35:lfs.0 00000100:00100000:2.0:1789996334.431391:0:11495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086f888e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+56:11471:x1876946927559552:12345-192.168.204.37@tcp:35:lfs.0 Request processed in 219us (582us total) trans 4294967455 rc 0/0 00000100:00100000:2.0:1789996334.431399:0:11495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 47 00010000:00010000:2.0:1789996334.443107:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789996334.568909:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086d7f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876946942237568:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789996334.568997:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789996334.569317:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1789996334.569583:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927559808 00000100:00100000:1.0:1789996334.569591:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927559808 00000100:00100000:1.0:1789996334.569637:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 166 00000100:00100000:1.0:1789996334.569646:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0876a68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+56:11489:x1876946927559808:12345-192.168.204.37@tcp:101:cat.0 00010000:00010000:1.0:1789996334.569668:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789996334.569689:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23800/0x4173739f0fc8126f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b97003095e35762 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996334.569796:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23400/0x4173739f0fc81276 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996334.569811:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23400/0x4173739f0fc81276 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996334.569823:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23400/0x4173739f0fc81276 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789996334.569835:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1789996334.569966:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23800/0x4173739f0fc8126f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35762 expref: 59 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996334.569999:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23400/0x4173739f0fc81276 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35762 expref: 58 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996334.570009:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e0850c28e00) 00010000:00010000:1.0:1789996334.570012:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00000100:00100000:0.0:1789996334.570028:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942237568 00010000:00010000:1.0:1789996334.570030:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e0876a23400, rc 0) 00000100:00100000:0.0:1789996334.570035:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942237568 00000100:00100000:1.0:1789996334.570088:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0876a68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+58:11489:x1876946927559808:12345-192.168.204.37@tcp:101:cat.0 Request processed in 441us (772us total) trans 4294967456 rc 0/0 00000100:00100000:1.0:1789996334.570096:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 166 00000100:00100000:0.0:1789996334.570131:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789996334.570141:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0881082300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876946942237568:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789996334.570169:0:6691:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789996334.570222:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0881082300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876946942237568:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (1237us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996334.570229:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789996334.570332:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086d7f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876946942237568:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789996334.607479:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996334.607743:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927559936 00000100:00100000:0.0:1789996334.607753:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927559936 00000100:00100000:0.0:1789996334.608033:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 167 00000100:00100000:0.0:1789996334.608045:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0876a6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+58:11490:x1876946927559936:12345-192.168.204.37@tcp:101:lfs.0 00010000:00010000:0.0:1789996334.608083:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789996334.608105:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6c00/0x4173739f0fc81284 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b97003095e35769 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996334.608253:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7200/0x4173739f0fc8128b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996334.608267:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7200/0x4173739f0fc8128b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996334.608279:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7200/0x4173739f0fc8128b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789996334.608313:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:0.0:1789996334.608317:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789996334.608353:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7200/0x4173739f0fc8128b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996334.608379:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6c00/0x4173739f0fc81284 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35769 expref: 60 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996334.608397:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7200/0x4173739f0fc8128b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35769 expref: 59 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996334.608405:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e084601b500) 00010000:00010000:0.0:1789996334.608407:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789996334.608411:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e086fcb7200, rc 0) 00000100:00100000:0.0:1789996334.608476:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0876a6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+59:11490:x1876946927559936:12345-192.168.204.37@tcp:101:lfs.0 Request processed in 434us (1009us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996334.608483:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 167 00000100:00100000:2.0:1789996334.616525:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1789996334.618609:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927560320 00000100:00100000:3.0:1789996334.618623:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927560320 00000100:00100000:3.0:1789996334.618878:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 48 00000100:00100000:3.0:1789996334.618890:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0881083b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+59:11490:x1876946927560320:12345-192.168.204.37@tcp:35:lfs.0 00000100:00100000:3.0:1789996334.619221:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0881083b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+60:11490:x1876946927560320:12345-192.168.204.37@tcp:35:lfs.0 Request processed in 333us (2704us total) trans 4294967457 rc 0/0 00000100:00100000:3.0:1789996334.619229:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 48 00000100:00100000:3.0:1789996334.621448:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1789996334.621960:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927560448 00000100:00100000:1.0:1789996334.621970:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927560448 00000100:00100000:1.0:1789996334.622113:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 13 00000100:00100000:1.0:1789996334.622124:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0876a69880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+60:11490:x1876946927560448:12345-192.168.204.37@tcp:103:lfs.0 00010000:00010000:1.0:1789996334.622141:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1789996334.622166:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6a00/0x4173739f0fc8121b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e3574d expref: 60 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996334.622190:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23400/0x4173739f0fc81276 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35762 expref: 59 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996334.622204:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7600/0x4173739f0fc81126 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e3570e expref: 58 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996334.622215:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e0850c28e00) 00010000:00010000:1.0:1789996334.622226:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789996334.622349:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0876a69880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+57:11490:x1876946927560448:12345-192.168.204.37@tcp:103:lfs.0 Request processed in 227us (909us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996334.622357:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 13 00000100:00100000:2.0:1789996334.625741:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1789996334.626779:0:9163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927560576 00000100:00100000:3.0:1789996334.626791:0:9163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927560576 00000100:00100000:3.0:1789996334.626856:0:9163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 168 00000100:00100000:3.0:1789996334.626867:0:9163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fdeb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+57:11490:x1876946927560576:12345-192.168.204.37@tcp:58:lfs.0 00010000:00010000:3.0:1789996334.626983:0:9163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856a00/0x4173739f0fc81292 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996334.627002:0:9163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856a00/0x4173739f0fc81292 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996334.627014:0:9163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856a00/0x4173739f0fc81292 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789996334.627340:0:9163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:3.0:1789996334.627442:0:9163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fdeb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+57:11490:x1876946927560576:12345-192.168.204.37@tcp:58:lfs.0 Request processed in 576us (1710us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996334.627450:0:9163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 168 00000100:00100000:2.0:1789996334.650799:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1789996334.650904:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927560704 00000100:00100000:1.0:1789996334.650915:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927560704 00000100:00100000:1.0:1789996334.650974:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 169 00000100:00100000:1.0:1789996334.650985:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fc84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+57:11492:x1876946927560704:12345-192.168.204.37@tcp:101:lfs.0 00010000:00010000:1.0:1789996334.651016:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789996334.651038:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23400/0x4173739f0fc81299 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b97003095e35770 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996334.651116:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23800/0x4173739f0fc812a0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996334.651132:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23800/0x4173739f0fc812a0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996334.651144:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23800/0x4173739f0fc812a0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996334.651158:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23e00/0x4173739f0fc812a7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996334.651165:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23e00/0x4173739f0fc812a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996334.651171:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23e00/0x4173739f0fc812a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996334.651259:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22a00/0x4173739f0fc812ae lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996334.651268:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22a00/0x4173739f0fc812ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996334.651276:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22a00/0x4173739f0fc812ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789996334.651308:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1789996334.651319:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789996334.651343:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22a00/0x4173739f0fc812ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996334.651354:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22a00/0x4173739f0fc812ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996334.651362:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23800/0x4173739f0fc812a0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996334.651369:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23800/0x4173739f0fc812a0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996334.651376:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23800/0x4173739f0fc812a0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996334.651381:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0876a23800 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:1.0:1789996334.651385:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23800/0x4173739f0fc812a0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996334.651392:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23800/0x4173739f0fc812a0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996334.651404:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e084601b500) 00010000:00010000:1.0:1789996334.651407:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789996334.651412:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23800/0x4173739f0fc812a0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996334.651418:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23800/0x4173739f0fc812a0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996334.651430:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23e00/0x4173739f0fc812a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996334.651445:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23e00/0x4173739f0fc812a7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996334.651451:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23e00/0x4173739f0fc812a7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996334.651456:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0876a23e00 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:1.0:1789996334.651459:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23e00/0x4173739f0fc812a7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996334.651465:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23e00/0x4173739f0fc812a7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996334.651473:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8e0861fcf000) 00010000:00010000:1.0:1789996334.651476:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789996334.651478:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23e00/0x4173739f0fc812a7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996334.651485:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23e00/0x4173739f0fc812a7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996334.651527:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23400/0x4173739f0fc81299 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35770 expref: 59 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996334.651590:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22a00/0x4173739f0fc812ae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35770 expref: 58 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996334.651599:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e0846583700) 00010000:00010000:1.0:1789996334.651601:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789996334.651609:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e0876a22a00, rc 0) 00000100:00100000:1.0:1789996334.651675:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fc84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+58:11492:x1876946927560704:12345-192.168.204.37@tcp:101:lfs.0 Request processed in 691us (884us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996334.651682:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 169 00000040:00080000:1.0:1789996335.392219:0:12468:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789996335.392229:0:12468:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789996335.392277:0:12468:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 5 00000040:00080000:1.0:1789996335.392285:0:12468:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:2.0:1789996335.465735:0:11698:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789996335.465744:0:11698:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789996335.465797:0:11698:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 5 00000040:00080000:2.0:1789996335.465804:0:11698:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789996335.465932:0:11698:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fc86680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11698:1876946942237696:192.168.204.37@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789996335.466022:0:11698:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e085455f3c0 going to sleep for 11 seconds 00010000:00010000:1.0:1789996335.466731:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789996335.474953:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1789996335.475070:0:9163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927560832 00000100:00100000:1.0:1789996335.475080:0:9163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927560832 00000100:00100000:1.0:1789996335.475253:0:9163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 170 00000100:00100000:1.0:1789996335.475265:0:9163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fc85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+59:11504:x1876946927560832:12345-192.168.204.37@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789996335.475297:0:9163:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789996335.475399:0:9163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fc85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+59:11504:x1876946927560832:12345-192.168.204.37@tcp:53:lhsmtool_posix.0 Request processed in 136us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996335.475407:0:9163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 170 00000100:00100000:0.0:1789996335.475696:0:11698:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fc86680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11698:1876946942237696:192.168.204.37@tcp:107:hsm_cdtr.0 00000100:00080000:2.0:1789996335.476024:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789996335.484466:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1789996335.485009:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927560960 00000100:00100000:1.0:1789996335.485019:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927560960 00000100:00100000:1.0:1789996335.485072:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 171 00000100:00100000:1.0:1789996335.485083:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fc84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+58:11504:x1876946927560960:12345-192.168.204.37@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1789996335.485151:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22600/0x4173739f0fc812b5 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996335.485169:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22600/0x4173739f0fc812b5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996335.485182:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22600/0x4173739f0fc812b5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996335.485205:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22000/0x4173739f0fc812bc lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996335.485213:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22000/0x4173739f0fc812bc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996335.485220:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22000/0x4173739f0fc812bc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996335.485247:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22c00/0x4173739f0fc812c3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996335.485256:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22c00/0x4173739f0fc812c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996335.485262:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22c00/0x4173739f0fc812c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789996335.485297:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1789996335.485302:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789996335.485314:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22c00/0x4173739f0fc812c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996335.485325:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22600/0x4173739f0fc812b5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996335.485331:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22600/0x4173739f0fc812b5 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996335.485338:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22600/0x4173739f0fc812b5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996335.485355:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0876a22600 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:1.0:1789996335.485360:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22600/0x4173739f0fc812b5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996335.485368:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22600/0x4173739f0fc812b5 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996335.485381:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e084601b600) 00010000:00010000:1.0:1789996335.485385:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789996335.485391:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22600/0x4173739f0fc812b5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996335.485397:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22600/0x4173739f0fc812b5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996335.485409:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22000/0x4173739f0fc812bc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996335.485415:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22000/0x4173739f0fc812bc lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996335.485421:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22000/0x4173739f0fc812bc lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996335.485427:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0876a22000 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:1.0:1789996335.485429:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22000/0x4173739f0fc812bc lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996335.485435:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22000/0x4173739f0fc812bc lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996335.485453:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff8e0861fcf000) 00010000:00010000:1.0:1789996335.485455:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789996335.485458:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22000/0x4173739f0fc812bc lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996335.485464:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22000/0x4173739f0fc812bc lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996335.485478:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22c00/0x4173739f0fc812c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996335.485499:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22c00/0x4173739f0fc812c3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996335.485505:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22c00/0x4173739f0fc812c3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996335.485510:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0876a22c00 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:1.0:1789996335.485512:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22c00/0x4173739f0fc812c3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996335.485518:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22c00/0x4173739f0fc812c3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996335.485526:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e0846583700) 00010000:00010000:1.0:1789996335.485528:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789996335.485531:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22c00/0x4173739f0fc812c3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996335.485536:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22c00/0x4173739f0fc812c3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789996335.485650:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fc84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+58:11504:x1876946927560960:12345-192.168.204.37@tcp:34:lhsmtool_posix.0 Request processed in 569us (1194us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996335.485658:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 171 00000100:00100000:0.0:1789996335.490064:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1789996335.493956:0:9163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927561216 00000100:00100000:1.0:1789996335.493972:0:9163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927561216 00000100:00100000:1.0:1789996335.494077:0:9163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 172 00000100:00100000:1.0:1789996335.494089:0:9163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086d7f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+58:11504:x1876946927561216:12345-192.168.204.37@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789996335.494109:0:9163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789996335.494128:0:9163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22200/0x4173739f0fc812ca lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b97003095e35777 expref: -99 pid: 9163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996335.494225:0:9163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22800/0x4173739f0fc812d1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996335.494239:0:9163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22800/0x4173739f0fc812d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996335.494250:0:9163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22800/0x4173739f0fc812d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789996335.494261:0:9163:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1789996335.494351:0:9163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22800/0x4173739f0fc812d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996335.494358:0:9163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22800/0x4173739f0fc812d1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996335.494365:0:9163:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22800/0x4173739f0fc812d1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996335.494397:0:9163:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0876a22800 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:1.0:1789996335.494401:0:9163:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22800/0x4173739f0fc812d1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996335.494410:0:9163:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22800/0x4173739f0fc812d1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996335.494422:0:9163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e0846583700) 00010000:00010000:1.0:1789996335.494426:0:9163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789996335.494431:0:9163:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22800/0x4173739f0fc812d1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996335.494438:0:9163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22800/0x4173739f0fc812d1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996335.494480:0:9163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22200/0x4173739f0fc812ca lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35777 expref: 60 pid: 9163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996335.494502:0:9163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e084601b600) 00010000:00010000:1.0:1789996335.494504:0:9163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789996335.494508:0:9163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22200/0x4173739f0fc812ca lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35777 expref: 60 pid: 9163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996335.494517:0:9163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e0876a22200, rc 0) 00000100:00100000:1.0:1789996335.494621:0:9163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086d7f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+59:11504:x1876946927561216:12345-192.168.204.37@tcp:101:lhsmtool_posix.0 Request processed in 535us (4567us total) trans 4294967458 rc 301/301 00000100:00100000:1.0:1789996335.494640:0:9163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 172 00000100:00100000:0.0:1789996335.499217:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1789996335.499293:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927561344 00000100:00100000:1.0:1789996335.499312:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927561344 00000100:00100000:1.0:1789996335.499368:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 173 00000100:00100000:1.0:1789996335.499379:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086d7f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+59:11504:x1876946927561344:12345-192.168.204.37@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789996335.499414:0:5847:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789996335.499762:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086d7f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+59:11504:x1876946927561344:12345-192.168.204.37@tcp:53:lhsmtool_posix.0 Request processed in 383us (551us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996335.499783:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 173 00000100:00100000:3.0:1789996335.503016:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996335.503105:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927561600 00000100:00100000:2.0:1789996335.503115:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927561600 00000100:00100000:2.0:1789996335.503172:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 174 00000100:00100000:2.0:1789996335.503182:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0876a68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+59:11504:x1876946927561600:12345-192.168.204.37@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789996335.503202:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789996335.503205:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789996335.503230:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7200/0x4173739f0fc8128b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35769 expref: 59 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996335.503257:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e084601b500) 00010000:00010000:2.0:1789996335.503262:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789996335.503276:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0841524e00/0x4173739f0fc812df lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b97003095e3577e expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789996335.503934:0:5848:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:2.0:1789996335.504135:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0841524400/0x4173739f0fc812e6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996335.504148:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0841524400/0x4173739f0fc812e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996335.504158:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0841524400/0x4173739f0fc812e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996335.504204:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0841524e00/0x4173739f0fc812df lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e3577e expref: 61 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996335.504219:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0841524400/0x4173739f0fc812e6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e3577e expref: 60 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996335.504227:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8e084601bc00) 00010000:00010000:2.0:1789996335.504230:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789996335.504232:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e0841524400, rc 0) 00000100:00100000:2.0:1789996335.504286:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0876a68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+60:11504:x1876946927561600:12345-192.168.204.37@tcp:101:lhsmtool_posix.0 Request processed in 1106us (1278us total) trans 4294967459 rc 0/0 00000100:00100000:2.0:1789996335.504292:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 174 00000100:00100000:1.0:1789996335.514517:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996335.514584:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927561856 00000100:00100000:2.0:1789996335.514595:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927561856 00000100:00100000:2.0:1789996335.514659:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 175 00000100:00100000:2.0:1789996335.514670:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0876618e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+60:11504:x1876946927561856:12345-192.168.204.37@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789996335.514727:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789996335.514757:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0841524400/0x4173739f0fc812e6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e3577e expref: 60 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996335.514790:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8e084601bc00) 00010000:00010000:2.0:1789996335.514800:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789996335.514823:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4e00/0x4173739f0fc812f4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996335.514838:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4e00/0x4173739f0fc812f4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996335.514848:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4e00/0x4173739f0fc812f4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996335.514861:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5a00/0x4173739f0fc812fb lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xbc5f5032 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996335.514869:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5a00/0x4173739f0fc812fb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xbc5f5032 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996335.514875:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5a00/0x4173739f0fc812fb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xbc5f5032 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996335.514941:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4e00/0x4173739f0fc812f4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996335.514957:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4e00/0x4173739f0fc812f4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996335.514963:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4e00/0x4173739f0fc812f4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996335.514969:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0842de4e00 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:2.0:1789996335.514974:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4e00/0x4173739f0fc812f4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996335.514982:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4e00/0x4173739f0fc812f4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996335.514996:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e084601b500) 00010000:00010000:2.0:1789996335.514999:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789996335.515003:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4e00/0x4173739f0fc812f4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996335.515009:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4e00/0x4173739f0fc812f4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996335.515019:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5a00/0x4173739f0fc812fb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xbc5f5032 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996335.515024:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5a00/0x4173739f0fc812fb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xbc5f5032 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996335.515030:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5a00/0x4173739f0fc812fb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xbc5f5032 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996335.515035:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0842de5a00 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:2.0:1789996335.515043:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5a00/0x4173739f0fc812fb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xbc5f5032 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996335.515049:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5a00/0x4173739f0fc812fb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xbc5f5032 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996335.515057:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xbc5f5032 (ffff8e084601b100) 00010000:00010000:2.0:1789996335.515060:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789996335.515063:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5a00/0x4173739f0fc812fb lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xbc5f5032 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996335.515069:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5a00/0x4173739f0fc812fb lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xbc5f5032 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789996335.515156:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0876618e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+59:11504:x1876946927561856:12345-192.168.204.37@tcp:36:lhsmtool_posix.0 Request processed in 487us (648us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789996335.515164:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 175 00000100:00100000:2.0:1789996335.520954:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1789996335.521029:0:9163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927561984 00000100:00100000:1.0:1789996335.521039:0:9163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927561984 00000100:00100000:1.0:1789996335.521096:0:9163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 176 00000100:00100000:1.0:1789996335.521107:0:9163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fc86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+59:11504:x1876946927561984:12345-192.168.204.37@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789996335.521138:0:9163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789996335.521161:0:9163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22200/0x4173739f0fc81302 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b97003095e35785 expref: -99 pid: 9163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996335.521198:0:9163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22800/0x4173739f0fc81309 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996335.521212:0:9163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22800/0x4173739f0fc81309 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996335.521224:0:9163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22800/0x4173739f0fc81309 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996335.521316:0:9163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22200/0x4173739f0fc81302 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35785 expref: 61 pid: 9163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996335.521331:0:9163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22800/0x4173739f0fc81309 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35785 expref: 60 pid: 9163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996335.521347:0:9163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8e0861fcf000) 00010000:00010000:1.0:1789996335.521350:0:9163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789996335.521354:0:9163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e0876a22800, rc 0) 00000100:00100000:1.0:1789996335.521410:0:9163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fc86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+60:11504:x1876946927561984:12345-192.168.204.37@tcp:101:lhsmtool_posix.0 Request processed in 305us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996335.521418:0:9163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 176 00000100:00100000:3.0:1789996335.523893:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996335.524011:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927562240 00000100:00100000:2.0:1789996335.524020:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927562240 00000100:00100000:2.0:1789996335.524072:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 177 00000100:00100000:2.0:1789996335.524081:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0876a6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+60:11504:x1876946927562240:12345-192.168.204.37@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789996335.524152:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4800/0x4173739f0fc81310 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996335.524167:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4800/0x4173739f0fc81310 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996335.524177:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4800/0x4173739f0fc81310 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789996335.524432:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:2.0:1789996335.524441:0:5846:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 377243897609ns, next at 378243895681ns, rc = 0 00000004:00010000:2.0:1789996335.524529:0:5846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a84dd6b0 reply state 00000000db15e962 transno 4294967460 ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4800/0x4173739f0fc81310 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789996335.524539:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789996335.524672:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0876a6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+62:11504:x1876946927562240:12345-192.168.204.37@tcp:36:lhsmtool_posix.0 Request processed in 591us (783us total) trans 4294967460 rc 0/0 00000100:00100000:2.0:1789996335.524679:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 177 00010000:00010000:0.0:1789996335.534186:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4800/0x4173739f0fc81310 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996335.534204:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4800/0x4173739f0fc81310 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996335.534213:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4800/0x4173739f0fc81310 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996335.534219:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0842de4800 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:0.0:1789996335.534224:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4800/0x4173739f0fc81310 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996335.534247:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4800/0x4173739f0fc81310 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996335.534265:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8e0861fcf000) 00010000:00010000:0.0:1789996335.534268:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789996335.534273:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4800/0x4173739f0fc81310 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996335.534279:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4800/0x4173739f0fc81310 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789996335.539417:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996335.539458:0:9163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927562368 00000100:00100000:2.0:1789996335.539467:0:9163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927562368 00000100:00100000:2.0:1789996335.539557:0:9163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 178 00000100:00100000:2.0:1789996335.539569:0:9163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fc85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+61:11504:x1876946927562368:12345-192.168.204.37@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789996335.539592:0:9163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789996335.539612:0:9163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5a00/0x4173739f0fc81317 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b97003095e3578c expref: -99 pid: 9163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996335.539670:0:9163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5a00/0x4173739f0fc81317 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e3578c expref: 62 pid: 9163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996335.539685:0:9163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5a00/0x4173739f0fc81317 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e3578c expref: 62 pid: 9163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996335.539705:0:9163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8e0861fcf000) 00010000:00010000:2.0:1789996335.539708:0:9163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789996335.539720:0:9163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e0842de5a00, rc 0) 00000100:00100000:2.0:1789996335.539783:0:9163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fc85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+62:11504:x1876946927562368:12345-192.168.204.37@tcp:101:lhsmtool_posix.0 Request processed in 217us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996335.539791:0:9163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 178 00000100:00100000:3.0:1789996335.543953:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1789996335.543989:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927562496 00000100:00100000:3.0:1789996335.543998:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927562496 00000100:00100000:3.0:1789996335.545330:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 50 00000100:00100000:3.0:1789996335.545346:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0876a69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+6:2363:x1876946927562496:12345-192.168.204.37@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1789996335.545727:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0876a69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+7:2363:x1876946927562496:12345-192.168.204.37@tcp:2:lhsmtool_posix.0 Request processed in 384us (1783us total) trans 4294967313 rc 0/0 00000100:00100000:3.0:1789996335.545735:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 50 00000100:00080000:3.0:1789996335.545760:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789996335.550966:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1789996335.552931:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927562752 00000100:00100000:1.0:1789996335.552943:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927562752 00000100:00100000:1.0:1789996335.552994:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 49 00000100:00100000:1.0:1789996335.553003:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0876a6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+62:11504:x1876946927562752:12345-192.168.204.37@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789996335.553237:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0876a6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+63:11504:x1876946927562752:12345-192.168.204.37@tcp:35:lhsmtool_posix.0 Request processed in 234us (2281us total) trans 4294967461 rc 0/0 00000100:00100000:1.0:1789996335.553245:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 49 00000100:00100000:3.0:1789996335.560821:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1789996335.560858:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927563008 00000100:00100000:3.0:1789996335.560868:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927563008 00000100:00100000:3.0:1789996335.560917:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 179 00000100:00100000:3.0:1789996335.560927:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0876a6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+63:11504:x1876946927563008:12345-192.168.204.37@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789996335.561032:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0876a6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+63:11504:x1876946927563008:12345-192.168.204.37@tcp:57:lhsmtool_posix.0 Request processed in 106us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996335.561039:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 179 00000100:00100000:1.0:1789996335.567841:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1789996335.567983:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927563136 00000100:00100000:3.0:1789996335.567994:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927563136 00000100:00100000:3.0:1789996335.568060:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 180 00000100:00100000:3.0:1789996335.568072:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0877abe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+63:11504:x1876946927563136:12345-192.168.204.37@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789996335.568092:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789996335.568111:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856c00/0x4173739f0fc8131e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b97003095e35793 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996335.568183:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857800/0x4173739f0fc81325 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996335.568198:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857800/0x4173739f0fc81325 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996335.568223:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857800/0x4173739f0fc81325 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789996335.568425:0:5848:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789996335.568444:0:5848:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857800/0x4173739f0fc81325 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996335.568466:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856c00/0x4173739f0fc8131e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35793 expref: 65 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996335.568492:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857800/0x4173739f0fc81325 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35793 expref: 64 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996335.568501:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8e0861fcf000) 00010000:00010000:3.0:1789996335.568505:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1789996335.568509:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e087f857800, rc 0) 00000100:00100000:3.0:1789996335.568660:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0877abe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+64:11504:x1876946927563136:12345-192.168.204.37@tcp:101:lhsmtool_posix.0 Request processed in 590us (829us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996335.568667:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 180 00000100:00100000:2.0:1789996335.576683:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996335.576764:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927563264 00000100:00100000:0.0:1789996335.576776:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927563264 00000100:00100000:0.0:1789996335.576833:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 51 00000100:00100000:0.0:1789996335.576845:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fc87100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+7:2362:x1876946927563264:12345-192.168.204.37@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789996335.576863:0:6690:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789996335.576886:0:6690:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c9294bac/0x4173739f0fc8132c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1b97003095e3579a expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789996335.576914:0:6690:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6ab12d30, blocks: 0x1 00010000:00010000:0.0:1789996335.576933:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=377s v=(0 0) 00010000:00010000:0.0:1789996335.576938:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789996335.576947:0:6690:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c9294bac/0x4173739f0fc8132c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e3579a expref: 8 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996335.576964:0:6690:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c9294bac/0x4173739f0fc8132c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e3579a expref: 8 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996335.576991:0:6690:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e086fcb6200, rc 0) 00000100:00100000:0.0:1789996335.577238:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fc87100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+8:2362:x1876946927563264:12345-192.168.204.37@tcp:101:lhsmtool_posix.0 Request processed in 393us (563us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996335.577246:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 51 00000100:00100000:0.0:1789996335.590770:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1789996335.590854:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927563520 00000100:00100000:3.0:1789996335.590865:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927563520 00000100:00100000:3.0:1789996335.590928:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 181 00000100:00100000:3.0:1789996335.590938:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fad8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+64:11504:x1876946927563520:12345-192.168.204.37@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789996335.591048:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fad8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+64:11504:x1876946927563520:12345-192.168.204.37@tcp:57:lhsmtool_posix.0 Request processed in 111us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996335.591055:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 181 00000100:00100000:3.0:1789996335.597773:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996335.599208:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927563648 00000100:00100000:0.0:1789996335.599222:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927563648 00000100:00100000:0.0:1789996335.599385:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 52 00000100:00100000:0.0:1789996335.599395:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e088119df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+8:11504:x1876946927563648:12345-192.168.204.37@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789996335.599413:0:6689:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789996335.599431:0:6689:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002e50c207/0x4173739f0fc81333 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1b97003095e357a1 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996335.599459:0:6689:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c9294bac/0x4173739f0fc8132c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e3579a expref: 9 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996335.599467:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789996335.599471:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789996335.599476:0:6689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002e50c207/0x4173739f0fc81333 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e357a1 expref: 9 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996335.599522:0:6689:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c9294bac/0x4173739f0fc8132c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e3579a expref: 9 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996335.599635:0:6689:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c9294bac/0x4173739f0fc8132c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e3579a expref: 9 pid: 6690 timeout: 477 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789996335.599659:0:6689:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e087f9bad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6689:1876946942237824:192.168.204.37@tcp:104: 00000100:00100000:0.0:1789996335.599782:0:6689:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e07432d6a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789996335.604407:0:6689:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e087f9bad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6689:1876946942237824:192.168.204.37@tcp:104: 00010000:00010000:0.0:1789996335.604443:0:6689:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002e50c207/0x4173739f0fc81333 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.37@tcp remote: 0x1b97003095e357a1 expref: 9 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996335.604465:0:6689:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e086fcb6400, rc 0) 00000100:00100000:0.0:1789996335.604536:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e088119df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+9:11504:x1876946927563648:12345-192.168.204.37@tcp:101:lhsmtool_posix.0 Request processed in 5142us (6772us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996335.604573:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 52 00000100:00100000:3.0:1789996335.604661:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996335.604781:0:8520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927563776 00000100:00100000:0.0:1789996335.604788:0:8520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927563776 00010000:00010000:0.0:1789996335.604817:0:8520:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c9294bac/0x4173739f0fc8132c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e3579a expref: 9 pid: 6690 timeout: 477 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789996335.604854:0:8520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 69 00000100:00100000:0.0:1789996335.604864:0:8520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0870598450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+9:2363:x1876946927563776:12345-192.168.204.37@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789996335.604877:0:8520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789996335.604898:0:8520:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c9294bac/0x4173739f0fc8132c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e3579a expref: 9 pid: 6690 timeout: 477 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996335.604927:0:8520:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c9294bac/0x4173739f0fc8132c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e3579a expref: 9 pid: 6690 timeout: 477 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996335.604949:0:8520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c9294bac/0x4173739f0fc8132c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e3579a expref: 9 pid: 6690 timeout: 477 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996335.604963:0:8520:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789996335.604967:0:8520:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789996335.604975:0:8520:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002e50c207/0x4173739f0fc81333 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.37@tcp remote: 0x1b97003095e357a1 expref: 8 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996335.604984:0:8520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002e50c207/0x4173739f0fc81333 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.37@tcp remote: 0x1b97003095e357a1 expref: 8 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996335.605014:0:8520:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000002e50c207/0x4173739f0fc81333 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.37@tcp remote: 0x1b97003095e357a1 expref: 8 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789996335.605027:0:8520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e087f9bad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8520:1876946942237952:192.168.204.37@tcp:105: 00000100:00100000:0.0:1789996335.605085:0:8520:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e07432d6a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789996335.615231:0:8520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e087f9bad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8520:1876946942237952:192.168.204.37@tcp:105: 00010000:00010000:0.0:1789996335.615259:0:8520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789996335.615320:0:8520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0870598450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+8:2363:x1876946927563776:12345-192.168.204.37@tcp:103:ldlm_bl.0 Request processed in 10456us (10660us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996335.615332:0:8520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 69 00000100:00100000:2.0:1789996335.616427:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1789996335.616538:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927563904 00000100:00100000:1.0:1789996335.616578:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927563904 00002000:00100000:1.0:1789996335.616624:0:6695:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff8e086fc87b80 x1876946927563904/t0(0) o4->189efa8a-c7eb-4b69-9afa-1dd36d6775f1@192.168.204.37@tcp:66/0 lens 504/0 e 0 to 0 dl 1789996346 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789996335.616635:0:6695:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8e086fc87b80 with x1876946927563904 ext(0->8) 00002000:00010000:1.0:1789996335.616640:0:6695:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8e086fc87b80 00000100:00100000:0.0:1789996335.616702:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 4 00000100:00100000:0.0:1789996335.616713:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fc87b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+8:2363:x1876946927563904:12345-192.168.204.37@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1789996335.617113:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fc87b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+10:2363:x1876946927563904:12345-192.168.204.37@tcp:4:lhsmtool_posix.0 Request processed in 400us (689us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1789996335.617122:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 4 00002000:00100000:0.0:1789996335.617129:0:6693:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff8e086fc87b80 x1876946927563904/t4294967314(0) o4->189efa8a-c7eb-4b69-9afa-1dd36d6775f1@192.168.204.37@tcp:66/0 lens 504/448 e 0 to 0 dl 1789996346 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789996335.617138:0:6693:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8e086fc87b80 with x1876946927563904 ext(0->8) 00002000:00010000:0.0:1789996335.617142:0:6693:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8e086fc87b80 00000100:00100000:3.0:1789996335.622744:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1789996335.623207:0:9163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927564032 00000100:00100000:1.0:1789996335.623218:0:9163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927564032 00000100:00100000:1.0:1789996335.623298:0:9163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 182 00000100:00100000:1.0:1789996335.623309:0:9163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e088119c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+64:11504:x1876946927564032:12345-192.168.204.37@tcp:44:lhsmtool_posix.0 00000100:00100000:2.0:1789996335.706780:0:9163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e088119c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+64:11504:x1876946927564032:12345-192.168.204.37@tcp:44:lhsmtool_posix.0 Request processed in 83462us (84045us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996335.706793:0:9163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 182 00000001:00080000:0.0:1789996335.707161:0:5868:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967453 is committed 00000020:00080000:0.0:1789996335.707185:0:5868:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8e0858c43540 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:0.0:1789996335.707189:0:5868:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8e0852b1b200 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8e08487ff540 00000020:00080000:0.0:1789996335.707193:0:5868:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8e0852b1b500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8e0876bac800 00000001:00080000:0.0:1789996335.707234:0:5868:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967461 is committed 00000020:00080000:3.0:1789996335.707276:0:5879:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:3.0:1789996335.707475:0:5879:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000004:00080000:0.0:1789996335.709160:0:5868:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000004:00080000:0.0:1789996335.709189:0:5868:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000100:00100000:1.0:1789996335.709604:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e088119f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876946942238080:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1789996335.709671:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789996335.709935:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942238080 00000100:00100000:3.0:1789996335.709944:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942238080 00000100:00100000:3.0:1789996335.709993:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789996335.710002:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fabed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1876946942238080:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1789996335.710225:0:6688:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1789996335.710229:0:6688:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1789996336 00002000:00010000:3.0:1789996335.710231:0:6688:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1789996335.710233:0:6688:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1789996336 -> 1789996336 00002000:00010000:3.0:1789996335.710235:0:6688:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1789996335.710424:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fabed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3316:x1876946942238080:12345-0@lo:2:osp-syn-1-0.0 Request processed in 422us (752us total) trans 4294967315 rc 0/0 00000100:00100000:3.0:1789996335.710431:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789996335.713472:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fc84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876946942238208:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1789996335.713591:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996335.714188:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942238208 00000100:00100000:1.0:1789996335.714198:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942238208 00000100:00100000:1.0:1789996335.714276:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789996335.714286:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e087f9bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3313:x1876946942238208:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1789996335.714313:0:6690:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:4 count 1 00002000:00010000:1.0:1789996335.714346:0:6690:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6ab12d2d, atime: 0x6ab12d2d, ctime: 0x6ab12d2d, blocks: 0x1 00010000:00010000:1.0:1789996335.714354:0:6690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e7f4bc0f/0x4173739f0fc8133a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996335.714369:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=377s v=(0 0) 00010000:00010000:1.0:1789996335.714373:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789996335.714379:0:6690:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e7f4bc0f/0x4173739f0fc8133a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996335.714395:0:6690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e7f4bc0f/0x4173739f0fc8133a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996335.714405:0:6690:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e7f4bc0f/0x4173739f0fc8133a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996335.714412:0:6690:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e7f4bc0f/0x4173739f0fc8133a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996335.714427:0:6690:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789996335.715012:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e087f9bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3313:x1876946942238208:12345-0@lo:6:osp-syn-0-0.0 Request processed in 726us (1418us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1789996335.715019:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000004:00080000:1.0:1789996335.715075:0:3316:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e088119f800/2, rc 0, transno 4294967315 00000100:00100000:1.0:1789996335.715082:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e088119f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876946942238080:0@lo:2:osp-syn-1-0.0 00000100:00080000:0.0:1789996335.715334:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:0.0:1789996335.715359:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e086fc84380/2, rc 0, transno 4294967307 00000100:00100000:0.0:1789996335.715364:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fc84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876946942238208:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1789996335.715701:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1789996335.715816:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927564160 00000100:00100000:3.0:1789996335.715823:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927564160 00000100:00100000:3.0:1789996335.715908:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 55 00000100:00100000:3.0:1789996335.715917:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0881080380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+10:2362:x1876946927564160:12345-192.168.204.37@tcp:16:lhsmtool_posix.0 00010000:00010000:2.0:1789996335.720400:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789996335.720414:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e7f4bc0f/0x4173739f0fc8133a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996335.720429:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0876a22000 already unused, calling callback (ffffffffc1595910) 00010000:00010000:2.0:1789996335.720435:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e7f4bc0f/0x4173739f0fc8133a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996335.720447:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e7f4bc0f/0x4173739f0fc8133a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996335.720469:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e7f4bc0f/0x4173739f0fc8133a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996335.720489:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e7f4bc0f/0x4173739f0fc8133a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996335.720511:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789996335.720520:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789996335.720522:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789996335.789745:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0881080380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+10:2362:x1876946927564160:12345-192.168.204.37@tcp:16:lhsmtool_posix.0 Request processed in 73816us (74033us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996335.789777:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 55 00000001:00080000:0.0:1789996335.790838:0:7659:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967314 is committed 00000001:00080000:0.0:1789996335.790855:0:7659:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000100:00100000:3.0:1789996335.801806:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996335.802365:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927564416 00000100:00100000:2.0:1789996335.802376:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927564416 00000100:00100000:3.0:1789996335.802836:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 183 00000100:00100000:3.0:1789996335.802848:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e088119ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+18:11504:x1876946927564416:12345-192.168.204.37@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789996335.802902:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789996335.802930:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857800/0x4173739f0fc81325 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35793 expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996335.802970:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8e0861fcf000) 00010000:00010000:3.0:1789996335.802976:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789996335.803005:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856c00/0x4173739f0fc81341 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996335.803019:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856c00/0x4173739f0fc81341 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996335.803030:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856c00/0x4173739f0fc81341 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789996335.803363:0:5846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003b9bfb06 reply state 00000000955c46e3 transno 4294967462 ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856c00/0x4173739f0fc81341 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789996335.803375:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789996335.803596:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e088119ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+19:11504:x1876946927564416:12345-192.168.204.37@tcp:36:lhsmtool_posix.0 Request processed in 742us (1791us total) trans 4294967462 rc 0/0 00000100:00100000:3.0:1789996335.803604:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 183 00010000:00010000:0.0:1789996335.806130:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856c00/0x4173739f0fc81341 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996335.806148:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856c00/0x4173739f0fc81341 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996335.806155:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856c00/0x4173739f0fc81341 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996335.806161:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e087f856c00 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:0.0:1789996335.806166:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856c00/0x4173739f0fc81341 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996335.806173:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856c00/0x4173739f0fc81341 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996335.806187:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8e0861fcf000) 00010000:00010000:0.0:1789996335.806190:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789996335.806195:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856c00/0x4173739f0fc81341 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996335.806201:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856c00/0x4173739f0fc81341 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789996335.808236:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996335.814318:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927564544 00000100:00100000:0.0:1789996335.814335:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927564544 00000100:00100000:0.0:1789996335.814411:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 56 00000100:00100000:0.0:1789996335.814422:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e088119ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+7:2362:x1876946927564544:12345-192.168.204.37@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1789996335.815915:0:6689:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1789996335.815922:0:6689:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1789996336 -> 1789996334 00002000:00010000:0.0:1789996335.815926:0:6689:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1789996333 00002000:00010000:0.0:1789996335.815928:0:6689:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1789996336 -> 1789996334 00002000:00010000:0.0:1789996335.815931:0:6689:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1789996335.816008:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e088119ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+8:2362:x1876946927564544:12345-192.168.204.37@tcp:2:lhsmtool_posix.0 Request processed in 1584us (7778us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1789996335.816018:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 56 00000100:00100000:3.0:1789996335.821654:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1789996335.821932:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927564800 00000100:00100000:1.0:1789996335.821944:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927564800 00000100:00100000:1.0:1789996335.822007:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 184 00000100:00100000:1.0:1789996335.822017:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e088119e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+18:11504:x1876946927564800:12345-192.168.204.37@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1789996335.822088:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22600/0x4173739f0fc81348 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996335.822106:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22800/0x4173739f0fc81309 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35785 expref: 18 pid: 9163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996335.822115:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22600/0x4173739f0fc81348 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996335.822298:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22800/0x4173739f0fc81309 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35785 expref: 18 pid: 9163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996335.822314:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22800/0x4173739f0fc81309 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35785 expref: 18 pid: 9163 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789996335.822328:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0880f7b800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5848:1876946942238336:192.168.204.37@tcp:104: 00000100:00100000:1.0:1789996335.822419:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e08494c9480 going to sleep for 11 seconds 00000100:00100000:2.0:1789996335.839796:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1789996335.839986:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0880f7b800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5848:1876946942238336:192.168.204.37@tcp:104: 00010000:00010000:1.0:1789996335.840031:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22600/0x4173739f0fc81348 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789996335.840399:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927564928 00000100:00100000:3.0:1789996335.840407:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927564928 00010000:00010000:3.0:1789996335.840444:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22800/0x4173739f0fc81309 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35785 expref: 19 pid: 9163 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789996335.840490:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 70 00000100:00100000:3.0:1789996335.840500:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fc86a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+19:2362:x1876946927564928:12345-192.168.204.37@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789996335.840514:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789996335.840528:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22800/0x4173739f0fc81309 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35785 expref: 19 pid: 9163 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996335.840568:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22800/0x4173739f0fc81309 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35785 expref: 19 pid: 9163 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996335.840600:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22800/0x4173739f0fc81309 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35785 expref: 19 pid: 9163 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996335.840615:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8e0861fcf000) 00010000:00010000:3.0:1789996335.840620:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22600/0x4173739f0fc81348 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996335.840629:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22600/0x4173739f0fc81348 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996335.840636:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22600/0x4173739f0fc81348 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996335.840756:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789996335.840809:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fc86a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+18:2362:x1876946927564928:12345-192.168.204.37@tcp:103:ldlm_bl.0 Request processed in 310us (1022us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996335.840816:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 70 00010000:00010000:0.0:1789996335.841033:0:5848:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22600/0x4173739f0fc81348 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996335.841042:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22600/0x4173739f0fc81348 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996335.841068:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22600/0x4173739f0fc81348 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996335.841075:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22600/0x4173739f0fc81348 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996335.841082:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22600/0x4173739f0fc81348 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996335.841088:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0876a22600 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:0.0:1789996335.841092:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22600/0x4173739f0fc81348 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996335.841100:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22600/0x4173739f0fc81348 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996335.841141:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8e0861fcf000) 00010000:00010000:0.0:1789996335.841143:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1789996335.841147:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22600/0x4173739f0fc81348 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996335.841153:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22600/0x4173739f0fc81348 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789996335.841193:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e088119e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+17:11504:x1876946927564800:12345-192.168.204.37@tcp:55:lhsmtool_posix.0 Request processed in 19177us (19558us total) trans 0 rc -22/-22 00000100:00100000:0.0:1789996335.841201:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 184 00000100:00100000:3.0:1789996335.844499:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1789996335.845028:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927565056 00000100:00100000:1.0:1789996335.845038:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927565056 00000100:00100000:1.0:1789996335.845097:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 57 00000100:00100000:1.0:1789996335.845107:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e088119d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+8:2363:x1876946927565056:12345-192.168.204.37@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1789996335.845160:0:6690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e827a41a/0x4173739f0fc8134f lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996335.845181:0:6690:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002e50c207/0x4173739f0fc81333 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.37@tcp remote: 0x1b97003095e357a1 expref: 8 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996335.845191:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789996335.845196:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789996335.845201:0:6690:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e827a41a/0x4173739f0fc8134f lrc: 4/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996335.845236:0:6690:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002e50c207/0x4173739f0fc81333 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.37@tcp remote: 0x1b97003095e357a1 expref: 8 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996335.845252:0:6690:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002e50c207/0x4173739f0fc81333 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.37@tcp remote: 0x1b97003095e357a1 expref: 8 pid: 6689 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789996335.845266:0:6690:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0880f7b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6690:1876946942238464:192.168.204.37@tcp:104: 00000100:00100000:1.0:1789996335.845350:0:6690:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e08494c9480 going to sleep for 11 seconds 00000100:00100000:1.0:1789996335.849905:0:6690:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0880f7b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6690:1876946942238464:192.168.204.37@tcp:104: 00010000:00010000:1.0:1789996335.849938:0:6690:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e827a41a/0x4173739f0fc8134f lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789996335.850392:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996335.851103:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927565184 00000100:00100000:2.0:1789996335.851112:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927565184 00010000:00010000:2.0:1789996335.851162:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002e50c207/0x4173739f0fc81333 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.37@tcp remote: 0x1b97003095e357a1 expref: 9 pid: 6689 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789996335.851203:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 71 00000100:00100000:2.0:1789996335.851212:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e088119c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+9:2363:x1876946927565184:12345-192.168.204.37@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789996335.851226:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789996335.851249:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002e50c207/0x4173739f0fc81333 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.37@tcp remote: 0x1b97003095e357a1 expref: 9 pid: 6689 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996335.851261:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002e50c207/0x4173739f0fc81333 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.37@tcp remote: 0x1b97003095e357a1 expref: 9 pid: 6689 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996335.851284:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002e50c207/0x4173739f0fc81333 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.37@tcp remote: 0x1b97003095e357a1 expref: 9 pid: 6689 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996335.851302:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789996335.851307:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789996335.851312:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e827a41a/0x4173739f0fc8134f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996335.851322:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e827a41a/0x4173739f0fc8134f lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996335.851365:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789996335.851436:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e088119c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+8:2363:x1876946927565184:12345-192.168.204.37@tcp:103:ldlm_bl.0 Request processed in 224us (1045us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996335.851444:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 71 00010000:00010000:1.0:1789996335.852329:0:6690:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e827a41a/0x4173739f0fc8134f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996335.852344:0:6690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e827a41a/0x4173739f0fc8134f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996335.852375:0:6690:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e827a41a/0x4173739f0fc8134f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996335.852383:0:6690:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e827a41a/0x4173739f0fc8134f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996335.852392:0:6690:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e827a41a/0x4173739f0fc8134f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996335.852399:0:6690:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0876a23a00 already unused, calling callback (ffffffffc1595910) 00010000:00010000:1.0:1789996335.852403:0:6690:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e827a41a/0x4173739f0fc8134f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996335.852412:0:6690:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e827a41a/0x4173739f0fc8134f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996335.852441:0:6690:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e827a41a/0x4173739f0fc8134f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996335.852448:0:6690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e827a41a/0x4173739f0fc8134f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789996335.852533:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e088119d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+7:2363:x1876946927565056:12345-192.168.204.37@tcp:1:lhsmtool_posix.0 Request processed in 7426us (8054us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996335.852573:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 57 00000100:00100000:3.0:1789996335.857332:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996335.860378:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927565440 00000100:00100000:0.0:1789996335.860393:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927565440 00000100:00100000:0.0:1789996335.860520:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 185 00000100:00100000:0.0:1789996335.860532:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e088119e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+17:11504:x1876946927565440:12345-192.168.204.37@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1789996335.860673:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6200/0x4173739f0fc81356 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996335.860691:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6200/0x4173739f0fc81356 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996335.860703:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6200/0x4173739f0fc81356 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996335.860902:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7200/0x4173739f0fc8135d lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996335.860915:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5a00/0x4173739f0fc81317 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e3578c expref: 18 pid: 9163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996335.861022:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7200/0x4173739f0fc8135d lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996335.861056:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5a00/0x4173739f0fc81317 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e3578c expref: 18 pid: 9163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996335.861072:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5a00/0x4173739f0fc81317 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e3578c expref: 18 pid: 9163 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789996335.861086:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0881080700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5847:1876946942238592:192.168.204.37@tcp:104: 00000100:00100000:0.0:1789996335.861354:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0741b00c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789996335.873173:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1789996335.873891:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927565568 00000100:00100000:3.0:1789996335.873901:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927565568 00010000:00010000:3.0:1789996335.873955:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5a00/0x4173739f0fc81317 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e3578c expref: 19 pid: 9163 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789996335.874019:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 72 00000100:00100000:3.0:1789996335.874030:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fc85180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+19:2363:x1876946927565568:12345-192.168.204.37@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789996335.874045:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789996335.874052:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5a00/0x4173739f0fc81317 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e3578c expref: 19 pid: 9163 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996335.874066:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5a00/0x4173739f0fc81317 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e3578c expref: 19 pid: 9163 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996335.874090:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8e0861fcf000) 00010000:00010000:3.0:1789996335.874096:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7200/0x4173739f0fc8135d lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996335.874105:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7200/0x4173739f0fc8135d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996335.874114:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7200/0x4173739f0fc8135d lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996335.874147:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789996335.874210:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fc85180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+19:2363:x1876946927565568:12345-192.168.204.37@tcp:103:ldlm_bl.0 Request processed in 181us (1046us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996335.874217:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 72 00010000:00010000:0.0:1789996335.879241:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5a00/0x4173739f0fc81317 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e3578c expref: 18 pid: 9163 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789996335.879267:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0881080700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5847:1876946942238592:192.168.204.37@tcp:104: 00010000:00010000:0.0:1789996335.879289:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7200/0x4173739f0fc8135d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996335.879299:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7200/0x4173739f0fc8135d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996335.879305:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7200/0x4173739f0fc8135d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789996335.879492:0:5847:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:0.0:1789996335.881259:0:5847:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967464 00000001:00080000:0.0:1789996335.881326:0:5847:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:0.0:1789996335.881433:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0881080700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5847:1876946942238720:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1789996335.881504:0:5847:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996335.881840:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0741b00000 going to sleep for 11 seconds 00000100:00100000:1.0:1789996335.887035:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942238720 00000100:00100000:1.0:1789996335.887052:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942238720 00000100:00100000:1.0:1789996335.887165:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789996335.887177:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0881080a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5847:x1876946942238720:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1789996335.887333:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0881080a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5847:x1876946942238720:12345-0@lo:1000:mdt00_001.0 Request processed in 158us (5827us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996335.887341:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789996335.887419:0:5847:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:2.0:1789996335.887425:0:5847:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e088119f800, transno 4294967315 00000100:00100000:2.0:1789996335.887449:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0881080700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5847:1876946942238720:0@lo:1000:mdt00_001.0 00000001:00080000:2.0:1789996335.890018:0:5847:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967466 00000100:00100000:2.0:1789996335.890101:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fc87480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5847:1876946942238848:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1789996335.890176:0:5847:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996335.892034:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942238848 00000100:00100000:0.0:1789996335.892047:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942238848 00000100:00100000:0.0:1789996335.892143:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789996335.892154:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fc85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5847:x1876946942238848:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1789996335.892410:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fc85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5847:x1876946942238848:12345-0@lo:1000:mdt00_001.0 Request processed in 257us (2233us total) trans 4294967317 rc 0/0 00000100:00100000:0.0:1789996335.892418:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789996335.893840:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0848e42900 going to sleep for 11 seconds 00000100:00100000:3.0:1789996335.893888:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fc87480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5847:1876946942238848:0@lo:1000:mdt00_001.0 00010000:00010000:3.0:1789996335.894008:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7200/0x4173739f0fc8135d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996335.894035:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7200/0x4173739f0fc8135d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996335.894042:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7200/0x4173739f0fc8135d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996335.894048:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e086fcb7200 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:3.0:1789996335.894054:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7200/0x4173739f0fc8135d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996335.894061:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7200/0x4173739f0fc8135d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996335.894076:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8e0861fcf000) 00010000:00010000:3.0:1789996335.894079:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789996335.894084:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7200/0x4173739f0fc8135d lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996335.894090:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7200/0x4173739f0fc8135d lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996335.894199:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856a00/0x4173739f0fc81292 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996335.894207:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856a00/0x4173739f0fc81292 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996335.894213:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856a00/0x4173739f0fc81292 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996335.894218:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e087f856a00 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:3.0:1789996335.894228:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856a00/0x4173739f0fc81292 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996335.894235:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856a00/0x4173739f0fc81292 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996335.894244:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e0846583700) 00010000:00010000:3.0:1789996335.894247:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789996335.894250:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856a00/0x4173739f0fc81292 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996335.894256:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856a00/0x4173739f0fc81292 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996335.894278:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857600/0x4173739f0fc81364 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996335.894293:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22a00/0x4173739f0fc812ae lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35770 expref: 21 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996335.894303:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857600/0x4173739f0fc81364 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996335.894340:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22a00/0x4173739f0fc812ae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35770 expref: 21 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996335.894355:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22a00/0x4173739f0fc812ae lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35770 expref: 21 pid: 5847 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789996335.894371:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e088119f800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5847:1876946942238976:192.168.204.37@tcp:104: 00000100:00100000:3.0:1789996335.894512:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e087667e780 going to sleep for 11 seconds 00000100:00100000:3.0:1789996335.903001:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e088119f800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5847:1876946942238976:192.168.204.37@tcp:104: 00010000:00010000:3.0:1789996335.903032:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857600/0x4173739f0fc81364 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789996335.905055:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1789996335.905279:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927565696 00000100:00100000:1.0:1789996335.905289:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927565696 00010000:00010000:1.0:1789996335.905329:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22a00/0x4173739f0fc812ae lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35770 expref: 22 pid: 5847 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789996335.905376:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 73 00000100:00100000:1.0:1789996335.905386:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fc86d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+22:2362:x1876946927565696:12345-192.168.204.37@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789996335.905401:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789996335.905408:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22a00/0x4173739f0fc812ae lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35770 expref: 22 pid: 5847 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996335.905436:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22a00/0x4173739f0fc812ae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35770 expref: 22 pid: 5847 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996335.905460:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22a00/0x4173739f0fc812ae lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35770 expref: 22 pid: 5847 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996335.905486:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e0846583700) 00010000:00010000:1.0:1789996335.905491:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857600/0x4173739f0fc81364 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996335.905500:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857600/0x4173739f0fc81364 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996335.905508:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857600/0x4173739f0fc81364 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996335.906256:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789996335.906312:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fc86d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+21:2362:x1876946927565696:12345-192.168.204.37@tcp:103:ldlm_bl.0 Request processed in 925us (1266us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996335.906321:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 73 00010000:00010000:3.0:1789996335.910310:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857600/0x4173739f0fc81364 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996335.910328:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857600/0x4173739f0fc81364 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996335.910343:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857600/0x4173739f0fc81364 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996335.910349:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857600/0x4173739f0fc81364 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996335.910356:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857600/0x4173739f0fc81364 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996335.910361:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e087f857600 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:3.0:1789996335.910365:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857600/0x4173739f0fc81364 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996335.910372:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857600/0x4173739f0fc81364 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996335.910389:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e0846583700) 00010000:00010000:3.0:1789996335.910392:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789996335.910399:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857600/0x4173739f0fc81364 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996335.910405:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857600/0x4173739f0fc81364 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996335.910437:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6200/0x4173739f0fc81356 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996335.910445:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6200/0x4173739f0fc81356 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996335.910451:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6200/0x4173739f0fc81356 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996335.910456:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e086fcb6200 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:3.0:1789996335.910459:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6200/0x4173739f0fc81356 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996335.910465:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6200/0x4173739f0fc81356 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996335.910484:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e0846583700) 00010000:00010000:3.0:1789996335.910488:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789996335.910491:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6200/0x4173739f0fc81356 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996335.910497:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6200/0x4173739f0fc81356 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789996335.912044:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e088119e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+20:11504:x1876946927565440:12345-192.168.204.37@tcp:57:lhsmtool_posix.0 Request processed in 51503us (54711us total) trans 4294967467 rc 0/0 00000100:00100000:3.0:1789996335.912057:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 185 00000020:00080000:3.0:1789996335.912063:0:5847:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:2.0:1789996335.923670:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1789996335.923735:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927565952 00000100:00100000:3.0:1789996335.923746:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927565952 00000100:00100000:3.0:1789996335.923824:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 50 00000100:00100000:3.0:1789996335.923835:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0850a20050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+20:11504:x1876946927565952:12345-192.168.204.37@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1789996335.925920:0:5850:0:(mdd_object.c:4178:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1789996335.926086:0:5850:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967468 00010000:00010000:3.0:1789996335.927094:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857600/0x4173739f0fc8136b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996335.927114:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857600/0x4173739f0fc8136b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996335.927125:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857600/0x4173739f0fc8136b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996335.927133:0:5850:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857600/0x4173739f0fc8136b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996335.927139:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857600/0x4173739f0fc8136b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996335.927145:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857600/0x4173739f0fc8136b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996335.927168:0:5850:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789996335.927281:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0850a20050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+22:11504:x1876946927565952:12345-192.168.204.37@tcp:35:lhsmtool_posix.0 Request processed in 3443us (3628us total) trans 4294967469 rc 0/0 00000100:00100000:3.0:1789996335.927290:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 50 00000020:00080000:3.0:1789996335.927296:0:5850:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789996335.927536:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789996335.927581:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857600/0x4173739f0fc8136b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996335.927589:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e087f857600 already unused, calling callback (ffffffffc1595910) 00010000:00010000:1.0:1789996335.927592:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857600/0x4173739f0fc8136b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996335.927600:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857600/0x4173739f0fc8136b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996335.927625:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8e0846583700) 00010000:00010000:1.0:1789996335.927628:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789996335.927633:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857600/0x4173739f0fc8136b lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996335.927639:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857600/0x4173739f0fc8136b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996335.927656:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789996335.927658:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789996335.927659:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789996336.489265:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789996336.936760:0:11698:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789996336.936770:0:11698:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789996336.937043:0:11698:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1789996336.937050:0:11698:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:1.0:1789996337.077879:0:12520:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789996337.077889:0:12520:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789996337.077927:0:12520:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1789996337.077938:0:12520:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789996337.205002:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1789996337.207060:0:9163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927566208 00000100:00100000:1.0:1789996337.207075:0:9163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927566208 00000100:00100000:1.0:1789996337.207141:0:9163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 186 00000100:00100000:1.0:1789996337.207151:0:9163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fc85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+22:11522:x1876946927566208:12345-192.168.204.37@tcp:101:lfs.0 00010000:00010000:1.0:1789996337.207175:0:9163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789996337.207194:0:9163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22a00/0x4173739f0fc81372 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b97003095e357a8 expref: -99 pid: 9163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996337.207288:0:9163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23a00/0x4173739f0fc81379 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996337.207303:0:9163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23a00/0x4173739f0fc81379 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996337.207314:0:9163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23a00/0x4173739f0fc81379 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789996337.207334:0:9163:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:1.0:1789996337.207443:0:9163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22a00/0x4173739f0fc81372 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e357a8 expref: 25 pid: 9163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996337.207472:0:9163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23a00/0x4173739f0fc81379 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e357a8 expref: 24 pid: 9163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996337.207480:0:9163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e084601b500) 00010000:00010000:1.0:1789996337.207483:0:9163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789996337.207486:0:9163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e0876a23a00, rc 0) 00000100:00100000:1.0:1789996337.207580:0:9163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fc85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+24:11522:x1876946927566208:12345-192.168.204.37@tcp:101:lfs.0 Request processed in 429us (2587us total) trans 4294967470 rc 0/0 00000100:00100000:1.0:1789996337.207588:0:9163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 186 00000100:00080000:3.0:1789996337.207770:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789996337.216622:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1789996337.216829:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927566336 00000100:00100000:3.0:1789996337.216840:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927566336 00000100:00100000:3.0:1789996337.216898:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 187 00000100:00100000:3.0:1789996337.216919:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fc84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+24:11522:x1876946927566336:12345-192.168.204.37@tcp:34:lfs.0 00010000:00010000:3.0:1789996337.216996:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857800/0x4173739f0fc81387 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996337.217013:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857800/0x4173739f0fc81387 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996337.217025:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857800/0x4173739f0fc81387 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996337.217038:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856a00/0x4173739f0fc8138e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996337.217044:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856a00/0x4173739f0fc8138e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996337.217051:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856a00/0x4173739f0fc8138e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996337.217249:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856e00/0x4173739f0fc81395 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996337.217257:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856e00/0x4173739f0fc81395 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996337.217265:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856e00/0x4173739f0fc81395 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789996337.217303:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856e00/0x4173739f0fc81395 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996337.217314:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857800/0x4173739f0fc81387 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996337.217326:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857800/0x4173739f0fc81387 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996337.217334:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857800/0x4173739f0fc81387 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996337.217340:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e087f857800 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:3.0:1789996337.217886:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857800/0x4173739f0fc81387 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996337.217897:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857800/0x4173739f0fc81387 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996337.217910:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e084601b500) 00010000:00010000:3.0:1789996337.217913:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789996337.217917:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857800/0x4173739f0fc81387 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996337.217923:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857800/0x4173739f0fc81387 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996337.217936:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856a00/0x4173739f0fc8138e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996337.217943:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856a00/0x4173739f0fc8138e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996337.217950:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856a00/0x4173739f0fc8138e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996337.217956:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e087f856a00 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:3.0:1789996337.217966:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856a00/0x4173739f0fc8138e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996337.217972:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856a00/0x4173739f0fc8138e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996337.217980:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8e0846583300) 00010000:00010000:3.0:1789996337.217982:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789996337.217985:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856a00/0x4173739f0fc8138e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996337.217991:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856a00/0x4173739f0fc8138e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996337.218007:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856e00/0x4173739f0fc81395 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996337.218012:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856e00/0x4173739f0fc81395 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996337.218017:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856e00/0x4173739f0fc81395 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996337.218022:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e087f856e00 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:3.0:1789996337.218025:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856e00/0x4173739f0fc81395 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996337.218030:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856e00/0x4173739f0fc81395 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996337.218037:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e0846583000) 00010000:00010000:3.0:1789996337.218039:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789996337.218048:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856e00/0x4173739f0fc81395 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996337.218053:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856e00/0x4173739f0fc81395 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789996337.218144:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fc84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+24:11522:x1876946927566336:12345-192.168.204.37@tcp:34:lfs.0 Request processed in 1224us (1528us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996337.218154:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 187 00000001:00080000:0.0:1789996337.230178:0:6715:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967307 is committed 00000001:00080000:0.0:1789996337.230200:0:6715:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000100:00100000:2.0:1789996337.265242:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1789996337.265574:0:9163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927566592 00000100:00100000:1.0:1789996337.265585:0:9163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927566592 00000100:00100000:1.0:1789996337.265657:0:9163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 188 00000100:00100000:1.0:1789996337.265667:0:9163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fc87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+24:11525:x1876946927566592:12345-192.168.204.37@tcp:101:lfs.0 00010000:00010000:1.0:1789996337.266110:0:9163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789996337.266133:0:9163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22a00/0x4173739f0fc8139c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b97003095e357af expref: -99 pid: 9163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996337.266206:0:9163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23800/0x4173739f0fc813a3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996337.266220:0:9163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23800/0x4173739f0fc813a3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996337.266248:0:9163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23800/0x4173739f0fc813a3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996337.266380:0:9163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23e00/0x4173739f0fc813aa lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996337.266389:0:9163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23e00/0x4173739f0fc813aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996337.266396:0:9163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23e00/0x4173739f0fc813aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996337.266903:0:9163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23400/0x4173739f0fc813b1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996337.266912:0:9163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23400/0x4173739f0fc813b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996337.266919:0:9163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23400/0x4173739f0fc813b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789996337.266928:0:9163:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:1.0:1789996337.267027:0:9163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23800/0x4173739f0fc813a3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996337.267046:0:9163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23800/0x4173739f0fc813a3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996337.267053:0:9163:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23800/0x4173739f0fc813a3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996337.267059:0:9163:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0876a23800 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:1.0:1789996337.267070:0:9163:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23800/0x4173739f0fc813a3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996337.267078:0:9163:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23800/0x4173739f0fc813a3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996337.267091:0:9163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e084601b500) 00010000:00010000:1.0:1789996337.267094:0:9163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789996337.267099:0:9163:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23800/0x4173739f0fc813a3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996337.267105:0:9163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23800/0x4173739f0fc813a3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996337.267117:0:9163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23e00/0x4173739f0fc813aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996337.267124:0:9163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23e00/0x4173739f0fc813aa lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996337.267129:0:9163:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23e00/0x4173739f0fc813aa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996337.267134:0:9163:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0876a23e00 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:1.0:1789996337.267137:0:9163:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23e00/0x4173739f0fc813aa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996337.267142:0:9163:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23e00/0x4173739f0fc813aa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996337.267149:0:9163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8e0861fcf200) 00010000:00010000:1.0:1789996337.267151:0:9163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789996337.267161:0:9163:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23e00/0x4173739f0fc813aa lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996337.267166:0:9163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23e00/0x4173739f0fc813aa lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996337.267211:0:9163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22a00/0x4173739f0fc8139c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e357af expref: 27 pid: 9163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996337.267225:0:9163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23400/0x4173739f0fc813b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e357af expref: 26 pid: 9163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996337.267233:0:9163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e0861fcf500) 00010000:00010000:1.0:1789996337.267235:0:9163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789996337.267237:0:9163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e0876a23400, rc 0) 00000100:00100000:1.0:1789996337.267319:0:9163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fc87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+26:11525:x1876946927566592:12345-192.168.204.37@tcp:101:lfs.0 Request processed in 1653us (2085us total) trans 4294967471 rc 0/0 00000100:00100000:1.0:1789996337.267336:0:9163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 188 00000100:00100000:1.0:1789996337.277854:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1789996337.281428:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927566720 00000100:00100000:3.0:1789996337.281442:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927566720 00000100:00100000:2.0:1789996337.283209:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 189 00000100:00100000:2.0:1789996337.283233:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0880f7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+26:11525:x1876946927566720:12345-192.168.204.37@tcp:54:lfs.0 00010000:00010000:2.0:1789996337.283309:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4200/0x4173739f0fc813bf lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996337.283328:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4200/0x4173739f0fc813bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996337.283342:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4200/0x4173739f0fc813bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996337.283385:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4200/0x4173739f0fc813bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996337.283393:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4200/0x4173739f0fc813bf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996337.283400:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4200/0x4173739f0fc813bf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996337.283406:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0842de4200 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:2.0:1789996337.283410:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4200/0x4173739f0fc813bf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996337.283418:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4200/0x4173739f0fc813bf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996337.283430:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e0861fcf500) 00010000:00010000:2.0:1789996337.283433:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789996337.283438:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4200/0x4173739f0fc813bf lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996337.283444:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4200/0x4173739f0fc813bf lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789996337.283592:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0880f7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+26:11525:x1876946927566720:12345-192.168.204.37@tcp:54:lfs.0 Request processed in 370us (5747us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996337.283601:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 189 00000100:00100000:2.0:1789996337.290210:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1789996337.290389:0:11495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927566976 00000100:00100000:1.0:1789996337.290399:0:11495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927566976 00000100:00100000:1.0:1789996337.290473:0:11495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 51 00000100:00100000:1.0:1789996337.290484:0:11495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fc84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+26:11525:x1876946927566976:12345-192.168.204.37@tcp:35:lfs.0 00000100:00100000:1.0:1789996337.290820:0:11495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fc84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+27:11525:x1876946927566976:12345-192.168.204.37@tcp:35:lfs.0 Request processed in 337us (620us total) trans 4294967472 rc 0/0 00000100:00100000:1.0:1789996337.290829:0:11495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 51 00000100:00100000:3.0:1789996337.320587:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996337.320759:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927567232 00000100:00100000:2.0:1789996337.320769:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927567232 00000100:00100000:2.0:1789996337.320845:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 190 00000100:00100000:2.0:1789996337.320854:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e088119f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+27:11051:x1876946927567232:12345-192.168.204.37@tcp:101:bash.0 00010000:00010000:2.0:1789996337.320878:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789996337.320898:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4200/0x4173739f0fc813c6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b97003095e357b6 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996337.320999:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4800/0x4173739f0fc813cd lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996337.321013:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23400/0x4173739f0fc813b1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e357af expref: 28 pid: 9163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996337.321022:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4800/0x4173739f0fc813cd lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996337.321061:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23400/0x4173739f0fc813b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e357af expref: 28 pid: 9163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996337.321075:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23400/0x4173739f0fc813b1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e357af expref: 28 pid: 9163 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789996337.321089:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fc86680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5848:1876946942239104:192.168.204.37@tcp:104: 00000100:00100000:2.0:1789996337.321178:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0847550000 going to sleep for 11 seconds 00000100:00100000:3.0:1789996337.324251:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fc86680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5848:1876946942239104:192.168.204.37@tcp:104: 00010000:00010000:3.0:1789996337.324279:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4800/0x4173739f0fc813cd lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789996337.326269:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996337.326647:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927567360 00000100:00100000:0.0:1789996337.326656:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927567360 00010000:00010000:0.0:1789996337.326695:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23400/0x4173739f0fc813b1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e357af expref: 29 pid: 9163 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789996337.326737:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 74 00000100:00100000:0.0:1789996337.326747:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e088119dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+29:2362:x1876946927567360:12345-192.168.204.37@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789996337.326764:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789996337.326771:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23400/0x4173739f0fc813b1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e357af expref: 29 pid: 9163 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996337.326785:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23400/0x4173739f0fc813b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e357af expref: 29 pid: 9163 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996337.326823:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23400/0x4173739f0fc813b1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e357af expref: 29 pid: 9163 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996337.326840:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e0861fcf500) 00010000:00010000:0.0:1789996337.326845:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4800/0x4173739f0fc813cd lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996337.326855:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4800/0x4173739f0fc813cd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996337.326864:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4800/0x4173739f0fc813cd lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996337.326890:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789996337.326955:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e088119dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+28:2362:x1876946927567360:12345-192.168.204.37@tcp:103:ldlm_bl.0 Request processed in 208us (695us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996337.326963:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 74 00010000:00010000:3.0:1789996337.327422:0:5848:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4800/0x4173739f0fc813cd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996337.327432:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4800/0x4173739f0fc813cd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789996337.327462:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:3.0:1789996337.327673:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4200/0x4173739f0fc813c6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e357b6 expref: 29 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996337.327690:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4800/0x4173739f0fc813cd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e357b6 expref: 28 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996337.327698:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e0861fcf500) 00010000:00010000:3.0:1789996337.327708:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789996337.327711:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e0842de4800, rc 0) 00000100:00100000:3.0:1789996337.327753:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e088119f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+28:11051:x1876946927567232:12345-192.168.204.37@tcp:101:bash.0 Request processed in 6900us (7211us total) trans 4294967473 rc 0/0 00000100:00100000:3.0:1789996337.327761:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 190 00000100:00100000:3.0:1789996337.329686:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996337.329794:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927567616 00000100:00100000:2.0:1789996337.329803:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927567616 00000100:00100000:2.0:1789996337.329856:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 191 00000100:00100000:2.0:1789996337.329865:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e088119f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+28:11051:x1876946927567616:12345-192.168.204.37@tcp:36:bash.0 00010000:00010000:2.0:1789996337.330178:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4e00/0x4173739f0fc813db lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996337.330205:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4e00/0x4173739f0fc813db lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996337.330217:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4e00/0x4173739f0fc813db lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789996337.330266:0:5846:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967474 00000004:00010000:2.0:1789996337.330289:0:5846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004203cd5d reply state 000000006e4d2c8b transno 4294967475 ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4e00/0x4173739f0fc813db lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789996337.330297:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1789996337.330337:0:5846:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967475 00000100:00100000:2.0:1789996337.330483:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e088119f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+32:11051:x1876946927567616:12345-192.168.204.37@tcp:36:bash.0 Request processed in 618us (803us total) trans 4294967476 rc 0/0 00000100:00100000:2.0:1789996337.330491:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 191 00000020:00080000:2.0:1789996337.330504:0:5846:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1789996337.340502:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1789996337.340598:0:9163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927567744 00000100:00100000:1.0:1789996337.340609:0:9163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927567744 00010000:00010000:0.0:1789996337.340647:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4e00/0x4173739f0fc813db lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996337.340661:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4e00/0x4173739f0fc813db lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996337.340670:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4e00/0x4173739f0fc813db lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996337.340677:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0842de4e00 already unused, calling callback (ffffffffc20074f0) 00000100:00100000:1.0:1789996337.340680:0:9163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 192 00010000:00010000:0.0:1789996337.340683:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4e00/0x4173739f0fc813db lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789996337.340693:0:9163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fc86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+32:11051:x1876946927567744:12345-192.168.204.37@tcp:101:bash.0 00010000:00010000:0.0:1789996337.340709:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4e00/0x4173739f0fc813db lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996337.340723:0:9163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789996337.340726:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e0861fcf500) 00010000:00010000:0.0:1789996337.340730:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789996337.340735:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4e00/0x4173739f0fc813db lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996337.340744:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4e00/0x4173739f0fc813db lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996337.340745:0:9163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22a00/0x4173739f0fc813e2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b97003095e357bd expref: -99 pid: 9163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996337.340808:0:9163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22a00/0x4173739f0fc813e2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e357bd expref: 32 pid: 9163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996337.340822:0:9163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22a00/0x4173739f0fc813e2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e357bd expref: 32 pid: 9163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996337.340840:0:9163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e0861fcf500) 00010000:00010000:1.0:1789996337.340843:0:9163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789996337.340845:0:9163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e0876a22a00, rc 0) 00000100:00100000:1.0:1789996337.340907:0:9163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fc86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+32:11051:x1876946927567744:12345-192.168.204.37@tcp:101:bash.0 Request processed in 216us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996337.340914:0:9163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 192 00000100:00100000:0.0:1789996337.343320:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996337.343401:0:8222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927567872 00000100:00100000:2.0:1789996337.343410:0:8222:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927567872 00000100:00100000:2.0:1789996337.343494:0:8222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 58 00000100:00080000:3.0:1789996337.343501:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789996337.343507:0:8222:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0881082680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+7:11051:x1876946927567872:12345-192.168.204.37@tcp:101:bash.0 00010000:00010000:2.0:1789996337.343523:0:8222:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789996337.345497:0:8222:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000284a25be/0x4173739f0fc813e9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1b97003095e357c4 expref: -99 pid: 8222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789996337.345562:0:8222:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6ab12d2e, atime: 0x6ab12d2d, ctime: 0x6ab12d2e, blocks: 0xb 00010000:00010000:2.0:1789996337.345588:0:8222:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=379s v=(0 0) 00010000:00010000:2.0:1789996337.345593:0:8222:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789996337.345622:0:8222:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000284a25be/0x4173739f0fc813e9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e357c4 expref: 8 pid: 8222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996337.345640:0:8222:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000284a25be/0x4173739f0fc813e9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e357c4 expref: 8 pid: 8222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996337.345653:0:8222:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e0842de5a00, rc 0) 00000100:00100000:2.0:1789996337.345719:0:8222:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0881082680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+8:11051:x1876946927567872:12345-192.168.204.37@tcp:101:bash.0 Request processed in 2217us (2408us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996337.345729:0:8222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 58 00000100:00100000:3.0:1789996337.348894:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996337.348989:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927568000 00000100:00100000:0.0:1789996337.349001:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927568000 00002000:00010000:0.0:1789996337.349043:0:6694:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:0.0:1789996337.349049:0:6694:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8e088119fb80 with x1876946927568000 ext(0->18446744073709551615) 00002000:00010000:0.0:1789996337.349060:0:6694:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8e088119fb80. 00000100:00100000:0.0:1789996337.349096:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 5 00000100:00100000:0.0:1789996337.349106:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e088119fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+8:2363:x1876946927568000:12345-192.168.204.37@tcp:10:bash.0 00002000:00010000:0.0:1789996337.349385:0:6694:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1789996337.349389:0:6694:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1789996334 -> 1789996338 00002000:00010000:0.0:1789996337.349392:0:6694:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 1789996333 -> 1789996333 00002000:00010000:0.0:1789996337.349394:0:6694:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1789996334 -> 1789996338 00002000:00010000:0.0:1789996337.349396:0:6694:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:0.0:1789996337.349538:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e088119fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+9:2363:x1876946927568000:12345-192.168.204.37@tcp:10:bash.0 Request processed in 432us (653us total) trans 4294967318 rc 0/0 00000100:00100000:0.0:1789996337.349576:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 5 00002000:00010000:0.0:1789996337.349593:0:6694:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:0.0:1789996337.349596:0:6694:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8e088119fb80 with x1876946927568000 ext(0->18446744073709551615) 00002000:00010000:0.0:1789996337.349600:0:6694:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8e088119fb80. 00000100:00100000:1.0:1789996337.431219:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996337.436689:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927568128 00000100:00100000:0.0:1789996337.436708:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927568128 00000100:00100000:0.0:1789996337.436855:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 193 00000100:00100000:0.0:1789996337.436868:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0880f7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+32:11539:x1876946927568128:12345-192.168.204.37@tcp:34:lfs.0 00010000:00010000:0.0:1789996337.436950:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7000/0x4173739f0fc813f0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996337.436969:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7000/0x4173739f0fc813f0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996337.436981:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7000/0x4173739f0fc813f0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996337.437001:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6a00/0x4173739f0fc813f7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996337.437021:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6a00/0x4173739f0fc813f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996337.437029:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6a00/0x4173739f0fc813f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996337.437256:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7600/0x4173739f0fc813fe lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996337.437266:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7600/0x4173739f0fc813fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996337.437273:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7600/0x4173739f0fc813fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789996337.437321:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7600/0x4173739f0fc813fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996337.437333:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7000/0x4173739f0fc813f0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996337.437339:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7000/0x4173739f0fc813f0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996337.437347:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7000/0x4173739f0fc813f0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996337.437353:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e086fcb7000 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:0.0:1789996337.437357:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7000/0x4173739f0fc813f0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996337.437363:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7000/0x4173739f0fc813f0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996337.437375:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e084601b500) 00010000:00010000:0.0:1789996337.437378:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789996337.437383:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7000/0x4173739f0fc813f0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996337.437389:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7000/0x4173739f0fc813f0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996337.437421:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6a00/0x4173739f0fc813f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996337.437428:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6a00/0x4173739f0fc813f7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996337.437439:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6a00/0x4173739f0fc813f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996337.437456:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e086fcb6a00 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:0.0:1789996337.437460:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6a00/0x4173739f0fc813f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996337.437466:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6a00/0x4173739f0fc813f7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996337.437476:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8e0850c28100) 00010000:00010000:0.0:1789996337.437478:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789996337.437482:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6a00/0x4173739f0fc813f7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996337.437487:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6a00/0x4173739f0fc813f7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996337.437503:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7600/0x4173739f0fc813fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996337.437510:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7600/0x4173739f0fc813fe lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996337.437515:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7600/0x4173739f0fc813fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996337.437520:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e086fcb7600 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:0.0:1789996337.437522:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7600/0x4173739f0fc813fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996337.437538:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7600/0x4173739f0fc813fe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996337.437595:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e0861fcf500) 00010000:00010000:0.0:1789996337.437598:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789996337.437602:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7600/0x4173739f0fc813fe lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996337.437608:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7600/0x4173739f0fc813fe lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789996337.437687:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0880f7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+32:11539:x1876946927568128:12345-192.168.204.37@tcp:34:lfs.0 Request processed in 819us (6476us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996337.437695:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 193 00000100:00100000:1.0:1789996337.486582:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1789996337.486706:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927568384 00000100:00100000:3.0:1789996337.486717:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927568384 00000100:00100000:3.0:1789996337.486774:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 194 00000100:00100000:3.0:1789996337.486783:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0880f7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+32:11542:x1876946927568384:12345-192.168.204.37@tcp:101:lfs.0 00010000:00010000:3.0:1789996337.486802:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789996337.486824:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856e00/0x4173739f0fc81405 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b97003095e357cb expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996337.486894:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856a00/0x4173739f0fc8140c lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996337.486907:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856a00/0x4173739f0fc8140c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996337.486917:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856a00/0x4173739f0fc8140c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996337.486931:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857800/0x4173739f0fc81413 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996337.486937:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857800/0x4173739f0fc81413 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996337.486965:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857800/0x4173739f0fc81413 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996337.487213:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857600/0x4173739f0fc8141a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996337.487222:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857600/0x4173739f0fc8141a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996337.487229:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857600/0x4173739f0fc8141a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789996337.487239:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1789996337.487334:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856a00/0x4173739f0fc8140c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996337.487342:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856a00/0x4173739f0fc8140c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996337.487348:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856a00/0x4173739f0fc8140c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996337.487354:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e087f856a00 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:3.0:1789996337.487359:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856a00/0x4173739f0fc8140c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996337.487366:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856a00/0x4173739f0fc8140c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996337.487377:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e084601b500) 00010000:00010000:3.0:1789996337.487380:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789996337.487391:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856a00/0x4173739f0fc8140c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996337.487398:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856a00/0x4173739f0fc8140c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996337.487412:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857800/0x4173739f0fc81413 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996337.487418:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857800/0x4173739f0fc81413 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996337.487423:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857800/0x4173739f0fc81413 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996337.487428:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e087f857800 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:3.0:1789996337.487430:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857800/0x4173739f0fc81413 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996337.487436:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857800/0x4173739f0fc81413 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996337.487456:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8e0846583000) 00010000:00010000:3.0:1789996337.487458:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789996337.487462:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857800/0x4173739f0fc81413 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996337.487467:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857800/0x4173739f0fc81413 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996337.487517:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856e00/0x4173739f0fc81405 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e357cb expref: 35 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996337.487604:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857600/0x4173739f0fc8141a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e357cb expref: 34 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996337.487612:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e0861fcf500) 00010000:00010000:3.0:1789996337.487614:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1789996337.487616:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e087f857600, rc 0) 00000100:00100000:3.0:1789996337.487679:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0880f7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+34:11542:x1876946927568384:12345-192.168.204.37@tcp:101:lfs.0 Request processed in 897us (1107us total) trans 4294967477 rc 0/0 00000100:00100000:3.0:1789996337.487687:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 194 00000100:00100000:1.0:1789996337.490916:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1789996337.490992:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927568512 00000100:00100000:3.0:1789996337.491000:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927568512 00000100:00100000:3.0:1789996337.491053:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 195 00000100:00100000:3.0:1789996337.491062:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fc98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+34:11542:x1876946927568512:12345-192.168.204.37@tcp:54:lfs.0 00010000:00010000:3.0:1789996337.491128:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856c00/0x4173739f0fc81428 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996337.491144:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4800/0x4173739f0fc813cd lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e357b6 expref: 34 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996337.491152:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856c00/0x4173739f0fc81428 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996337.491182:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4800/0x4173739f0fc813cd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e357b6 expref: 34 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996337.491194:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4800/0x4173739f0fc813cd lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e357b6 expref: 34 pid: 5848 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789996337.491216:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e088119c380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5846:1876946942239232:192.168.204.37@tcp:104: 00000100:00100000:3.0:1789996337.491308:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e087667ea80 going to sleep for 11 seconds 00000100:00100000:3.0:1789996337.494187:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e088119c380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5846:1876946942239232:192.168.204.37@tcp:104: 00010000:00010000:3.0:1789996337.494219:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856c00/0x4173739f0fc81428 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789996337.494914:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1789996337.494993:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927568768 00000100:00100000:3.0:1789996337.495001:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927568768 00000100:00100000:3.0:1789996337.495055:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 52 00000100:00100000:3.0:1789996337.495065:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fc98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+35:5599:x1876946927568768:12345-192.168.204.37@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1789996337.495388:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fc98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+36:5599:x1876946927568768:12345-192.168.204.37@tcp:35:ldlm_bl.0 Request processed in 323us (475us total) trans 4294967478 rc 0/0 00000100:00100000:3.0:1789996337.495396:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 52 00000100:00100000:0.0:1789996337.497090:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1789996337.497170:0:8520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927568896 00000100:00100000:3.0:1789996337.497177:0:8520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927568896 00010000:00010000:3.0:1789996337.497209:0:8520:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4800/0x4173739f0fc813cd lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e357b6 expref: 36 pid: 5848 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789996337.497248:0:8520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 75 00000100:00100000:3.0:1789996337.497258:0:8520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0881080000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+36:2363:x1876946927568896:12345-192.168.204.37@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789996337.497270:0:8520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789996337.497277:0:8520:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4800/0x4173739f0fc813cd lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e357b6 expref: 36 pid: 5848 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996337.497306:0:8520:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4800/0x4173739f0fc813cd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e357b6 expref: 36 pid: 5848 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996337.497332:0:8520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4800/0x4173739f0fc813cd lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e357b6 expref: 36 pid: 5848 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996337.497362:0:8520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e0861fcf500) 00010000:00010000:3.0:1789996337.497367:0:8520:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856c00/0x4173739f0fc81428 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996337.497376:0:8520:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856c00/0x4173739f0fc81428 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996337.497383:0:8520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856c00/0x4173739f0fc81428 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996337.497418:0:8520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789996337.497474:0:8520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0881080000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+35:2363:x1876946927568896:12345-192.168.204.37@tcp:103:ldlm_bl.0 Request processed in 217us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996337.497481:0:8520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 75 00010000:00010000:2.0:1789996337.497591:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856c00/0x4173739f0fc81428 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996337.497602:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856c00/0x4173739f0fc81428 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996337.497632:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856c00/0x4173739f0fc81428 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996337.497641:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856c00/0x4173739f0fc81428 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996337.497648:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856c00/0x4173739f0fc81428 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996337.497654:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e087f856c00 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:2.0:1789996337.497672:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856c00/0x4173739f0fc81428 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996337.497681:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856c00/0x4173739f0fc81428 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996337.497699:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e0861fcf500) 00010000:00010000:2.0:1789996337.497703:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789996337.497707:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856c00/0x4173739f0fc81428 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996337.497713:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856c00/0x4173739f0fc81428 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789996337.497770:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fc98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+34:11542:x1876946927568512:12345-192.168.204.37@tcp:54:lfs.0 Request processed in 6708us (6862us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996337.497779:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 195 00000100:00100000:0.0:1789996337.499693:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1789996337.499777:0:11495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927569152 00000100:00100000:1.0:1789996337.499786:0:11495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927569152 00000100:00100000:1.0:1789996337.499840:0:11495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 53 00000100:00100000:1.0:1789996337.499851:0:11495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0881083b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+34:11542:x1876946927569152:12345-192.168.204.37@tcp:35:lfs.0 00000100:00100000:1.0:1789996337.500068:0:11495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0881083b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+35:11542:x1876946927569152:12345-192.168.204.37@tcp:35:lfs.0 Request processed in 218us (381us total) trans 4294967479 rc 0/0 00000100:00100000:1.0:1789996337.500091:0:11495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 53 00010000:00010000:1.0:1789996337.513615:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789996337.588759:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1789996337.588986:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927569408 00000100:00100000:3.0:1789996337.588996:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927569408 00000100:00100000:3.0:1789996337.589105:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 196 00000100:00100000:3.0:1789996337.589116:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0881080700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+35:11553:x1876946927569408:12345-192.168.204.37@tcp:101:cat.0 00010000:00010000:3.0:1789996337.589142:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789996337.589165:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856e00/0x4173739f0fc8142f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b97003095e357d2 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996337.589265:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857800/0x4173739f0fc81436 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996337.589280:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857800/0x4173739f0fc81436 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996337.589293:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857800/0x4173739f0fc81436 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996337.589308:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856a00/0x4173739f0fc8143d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996337.589315:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856a00/0x4173739f0fc8143d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996337.589322:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856a00/0x4173739f0fc8143d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996337.589719:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857200/0x4173739f0fc81444 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996337.589730:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857200/0x4173739f0fc81444 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996337.589737:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857200/0x4173739f0fc81444 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789996337.589748:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:3.0:1789996337.590423:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857800/0x4173739f0fc81436 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996337.590433:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857800/0x4173739f0fc81436 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996337.590462:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857800/0x4173739f0fc81436 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996337.590468:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e087f857800 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:3.0:1789996337.590473:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857800/0x4173739f0fc81436 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996337.590482:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857800/0x4173739f0fc81436 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996337.590494:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e084601b500) 00010000:00010000:3.0:1789996337.590498:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789996337.590599:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857800/0x4173739f0fc81436 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996337.590607:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857800/0x4173739f0fc81436 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996337.590622:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856a00/0x4173739f0fc8143d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996337.590629:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856a00/0x4173739f0fc8143d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996337.590635:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856a00/0x4173739f0fc8143d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996337.590641:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e087f856a00 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:3.0:1789996337.590644:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856a00/0x4173739f0fc8143d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996337.590662:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856a00/0x4173739f0fc8143d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996337.590670:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8e0846583000) 00010000:00010000:3.0:1789996337.590673:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789996337.590676:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856a00/0x4173739f0fc8143d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996337.590682:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856a00/0x4173739f0fc8143d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996337.590731:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856e00/0x4173739f0fc8142f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e357d2 expref: 38 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996337.590743:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857200/0x4173739f0fc81444 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e357d2 expref: 37 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996337.590750:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e0861fcf500) 00010000:00010000:3.0:1789996337.590752:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789996337.590755:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e087f857200, rc 0) 00000100:00100000:3.0:1789996337.590880:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0881080700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+37:11553:x1876946927569408:12345-192.168.204.37@tcp:101:cat.0 Request processed in 1766us (2131us total) trans 4294967480 rc 0/0 00000100:00100000:3.0:1789996337.590889:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 196 00000100:00100000:0.0:1789996337.595253:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1789996337.595362:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927569664 00000100:00100000:1.0:1789996337.595372:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927569664 00000100:00100000:1.0:1789996337.595430:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 54 00000100:00100000:1.0:1789996337.595452:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0876a6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+37:11553:x1876946927569664:12345-192.168.204.37@tcp:35:cat.0 00000100:00100000:1.0:1789996337.595970:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0876a6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+38:11553:x1876946927569664:12345-192.168.204.37@tcp:35:cat.0 Request processed in 529us (726us total) trans 4294967481 rc 0/0 00000100:00100000:1.0:1789996337.595978:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 54 00000100:00100000:0.0:1789996337.616402:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1789996337.616842:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927569920 00000100:00100000:3.0:1789996337.616853:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927569920 00000100:00100000:3.0:1789996337.616911:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 197 00000100:00100000:3.0:1789996337.616921:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0876a6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+38:11554:x1876946927569920:12345-192.168.204.37@tcp:36:rm.0 00010000:00010000:3.0:1789996337.616995:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1789996337.617023:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857200/0x4173739f0fc81444 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e357d2 expref: 38 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996337.617042:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857600/0x4173739f0fc8141a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e357cb expref: 37 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996337.617053:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22a00/0x4173739f0fc813e2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e357bd expref: 36 pid: 9163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996337.617063:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e0861fcf500) 00010000:00010000:3.0:1789996337.617073:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789996337.617094:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856e00/0x4173739f0fc81452 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996337.617107:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856e00/0x4173739f0fc81452 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996337.617118:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856e00/0x4173739f0fc81452 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996337.617130:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856a00/0x4173739f0fc81459 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996337.617138:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856a00/0x4173739f0fc81459 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996337.617144:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856a00/0x4173739f0fc81459 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996337.618518:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857800/0x4173739f0fc81460 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996337.618534:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857800/0x4173739f0fc81460 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996337.618637:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857800/0x4173739f0fc81460 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789996337.619273:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00000004:00080000:3.0:1789996337.619285:0:5847:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 379338741399ns, next at 380338738849ns, rc = 0 00010000:00010000:3.0:1789996337.619369:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856200/0x4173739f0fc81467 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996337.619381:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856200/0x4173739f0fc81467 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996337.619392:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856200/0x4173739f0fc81467 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996337.619400:0:5847:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856200/0x4173739f0fc81467 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996337.619406:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856200/0x4173739f0fc81467 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996337.619413:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856200/0x4173739f0fc81467 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996337.619448:0:5847:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789996337.619471:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857800/0x4173739f0fc81460 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996337.619485:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857800/0x4173739f0fc81460 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996337.619491:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857800/0x4173739f0fc81460 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996337.619498:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e087f857800 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:3.0:1789996337.619502:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857800/0x4173739f0fc81460 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996337.619510:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857800/0x4173739f0fc81460 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996337.619523:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e0846583300) 00010000:00010000:3.0:1789996337.619526:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1789996337.619531:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857800/0x4173739f0fc81460 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996337.619537:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857800/0x4173739f0fc81460 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996337.619589:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856e00/0x4173739f0fc81452 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996337.619596:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856e00/0x4173739f0fc81452 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996337.619601:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856e00/0x4173739f0fc81452 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996337.619606:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e087f856e00 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:3.0:1789996337.619616:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856e00/0x4173739f0fc81452 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996337.619623:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856e00/0x4173739f0fc81452 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996337.619632:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e084601b500) 00010000:00010000:3.0:1789996337.619634:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789996337.619637:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856e00/0x4173739f0fc81452 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996337.619642:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856e00/0x4173739f0fc81452 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789996337.619652:0:5847:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000014a82bab reply state 000000006b53db8f transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856a00/0x4173739f0fc81459 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789996337.619660:0:5847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789996337.619753:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0876a6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+37:11554:x1876946927569920:12345-192.168.204.37@tcp:36:rm.0 Request processed in 2830us (3358us total) trans 4294967482 rc 0/0 00000100:00100000:3.0:1789996337.619762:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 197 00010000:00010000:2.0:1789996337.619928:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789996337.619935:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856200/0x4173739f0fc81467 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996337.619941:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e087f856200 already unused, calling callback (ffffffffc1595910) 00010000:00010000:2.0:1789996337.619944:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856200/0x4173739f0fc81467 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996337.619950:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856200/0x4173739f0fc81467 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996337.619959:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e0846583300) 00010000:00010000:2.0:1789996337.619962:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789996337.619965:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856200/0x4173739f0fc81467 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996337.619971:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856200/0x4173739f0fc81467 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996337.619996:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789996337.619998:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789996337.620000:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789996337.624968:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856a00/0x4173739f0fc81459 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996337.624988:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856a00/0x4173739f0fc81459 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996337.624995:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856a00/0x4173739f0fc81459 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996337.625002:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e087f856a00 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:3.0:1789996337.625007:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856a00/0x4173739f0fc81459 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996337.625031:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856a00/0x4173739f0fc81459 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996337.625048:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8e0846583000) 00010000:00010000:3.0:1789996337.625051:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789996337.625056:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856a00/0x4173739f0fc81459 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996337.625063:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856a00/0x4173739f0fc81459 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789996337.657671:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1789996337.661531:0:9163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927570176 00000100:00100000:1.0:1789996337.661560:0:9163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927570176 00000100:00100000:1.0:1789996337.661632:0:9163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 198 00000100:00100000:1.0:1789996337.661642:0:9163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0876a68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+36:11560:x1876946927570176:12345-192.168.204.37@tcp:101:bash.0 00010000:00010000:1.0:1789996337.661665:0:9163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789996337.661686:0:9163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22e00/0x4173739f0fc8146e lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b97003095e357d9 expref: -99 pid: 9163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996337.661793:0:9163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22600/0x4173739f0fc81475 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996337.661807:0:9163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22600/0x4173739f0fc81475 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996337.661819:0:9163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22600/0x4173739f0fc81475 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996337.661832:0:9163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22800/0x4173739f0fc8147c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996337.661854:0:9163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22800/0x4173739f0fc8147c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996337.661862:0:9163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22800/0x4173739f0fc8147c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789996337.663247:0:9163:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:1.0:1789996337.663707:0:9163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22000/0x4173739f0fc81483 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996337.663721:0:9163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22000/0x4173739f0fc81483 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996337.663732:0:9163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22000/0x4173739f0fc81483 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996337.663769:0:9163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22600/0x4173739f0fc81475 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996337.663778:0:9163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22600/0x4173739f0fc81475 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996337.663785:0:9163:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22600/0x4173739f0fc81475 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996337.663792:0:9163:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0876a22600 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:1.0:1789996337.663797:0:9163:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22600/0x4173739f0fc81475 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996337.663805:0:9163:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22600/0x4173739f0fc81475 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996337.663830:0:9163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e084601b500) 00010000:00010000:1.0:1789996337.663833:0:9163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789996337.663838:0:9163:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22600/0x4173739f0fc81475 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996337.663844:0:9163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22600/0x4173739f0fc81475 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789996337.663858:0:9163:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000eec5c8c2 reply state 0000000097c75faa transno 4294967483 ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22800/0x4173739f0fc8147c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789996337.663866:0:9163:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789996337.663899:0:9163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22e00/0x4173739f0fc8146e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e357d9 expref: 39 pid: 9163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996337.663914:0:9163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22000/0x4173739f0fc81483 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e357d9 expref: 38 pid: 9163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996337.663921:0:9163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e0861fcf600) 00010000:00010000:1.0:1789996337.663924:0:9163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789996337.663926:0:9163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e0876a22000, rc 0) 00000100:00100000:1.0:1789996337.664061:0:9163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0876a68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+39:11560:x1876946927570176:12345-192.168.204.37@tcp:101:bash.0 Request processed in 2420us (6399us total) trans 4294967483 rc 0/0 00000100:00100000:1.0:1789996337.664083:0:9163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 198 00010000:00010000:1.0:1789996337.669832:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22800/0x4173739f0fc8147c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996337.669851:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22800/0x4173739f0fc8147c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996337.669871:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22800/0x4173739f0fc8147c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996337.669877:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0876a22800 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:1.0:1789996337.669882:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22800/0x4173739f0fc8147c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996337.669890:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22800/0x4173739f0fc8147c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996337.669906:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8e0861fcf200) 00010000:00010000:1.0:1789996337.669910:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789996337.669915:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22800/0x4173739f0fc8147c lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996337.669921:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22800/0x4173739f0fc8147c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789996337.670182:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1789996337.670308:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927570304 00000100:00100000:3.0:1789996337.670318:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927570304 00000100:00080000:0.0:1789996337.670561:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789996337.670585:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 59 00000100:00100000:1.0:1789996337.670597:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0876a69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+5:2363:x1876946927570304:12345-192.168.204.37@tcp:101:bash.0 00010000:00010000:1.0:1789996337.670615:0:6690:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789996337.670634:0:6690:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000750c79a8/0x4173739f0fc81491 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1b97003095e357e0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789996337.670664:0:6690:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789996337.670681:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=379s v=(0 0) 00010000:00010000:1.0:1789996337.670686:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789996337.670696:0:6690:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000750c79a8/0x4173739f0fc81491 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e357e0 expref: 6 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996337.670727:0:6690:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000750c79a8/0x4173739f0fc81491 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e357e0 expref: 6 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996337.670738:0:6690:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e0876a22c00, rc 0) 00000100:00100000:1.0:1789996337.671029:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0876a69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+6:2363:x1876946927570304:12345-192.168.204.37@tcp:101:bash.0 Request processed in 433us (850us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996337.671036:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 59 00000100:00100000:0.0:1789996337.674465:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996337.674660:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927570432 00000100:00100000:2.0:1789996337.674670:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927570432 00000100:00100000:2.0:1789996337.674758:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 60 00000100:00100000:2.0:1789996337.674769:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086f885180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+6:11560:x1876946927570432:12345-192.168.204.37@tcp:101:bash.0 00010000:00010000:2.0:1789996337.674786:0:6689:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789996337.674806:0:6689:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079b23514/0x4173739f0fc81498 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1b97003095e357e7 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996337.674835:0:6689:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000750c79a8/0x4173739f0fc81491 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e357e0 expref: 7 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996337.674844:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789996337.674849:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789996337.674854:0:6689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000079b23514/0x4173739f0fc81498 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e357e7 expref: 7 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996337.674907:0:6689:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000750c79a8/0x4173739f0fc81491 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e357e0 expref: 7 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996337.674920:0:6689:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000750c79a8/0x4173739f0fc81491 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e357e0 expref: 7 pid: 6690 timeout: 479 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789996337.674934:0:6689:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0881221180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6689:1876946942239360:192.168.204.37@tcp:104: 00000100:00100000:2.0:1789996337.675059:0:6689:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0847550c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789996337.677484:0:6689:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0881221180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6689:1876946942239360:192.168.204.37@tcp:104: 00010000:00010000:2.0:1789996337.677516:0:6689:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000079b23514/0x4173739f0fc81498 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.37@tcp remote: 0x1b97003095e357e7 expref: 7 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996337.677535:0:6689:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e0842de4800, rc 0) 00000100:00100000:2.0:1789996337.677611:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086f885180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+7:11560:x1876946927570432:12345-192.168.204.37@tcp:101:bash.0 Request processed in 2844us (3153us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996337.677619:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 60 00000100:00100000:1.0:1789996337.678006:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996337.678418:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927570560 00000100:00100000:2.0:1789996337.678426:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927570560 00010000:00010000:2.0:1789996337.678468:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000750c79a8/0x4173739f0fc81491 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e357e0 expref: 7 pid: 6690 timeout: 479 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789996337.678607:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 76 00000100:00100000:2.0:1789996337.678616:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e087059ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+7:2362:x1876946927570560:12345-192.168.204.37@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789996337.678628:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789996337.678649:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000750c79a8/0x4173739f0fc81491 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e357e0 expref: 7 pid: 6690 timeout: 479 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996337.678661:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000750c79a8/0x4173739f0fc81491 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e357e0 expref: 7 pid: 6690 timeout: 479 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996337.678683:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000750c79a8/0x4173739f0fc81491 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e357e0 expref: 7 pid: 6690 timeout: 479 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996337.678714:0:5832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789996337.678718:0:5832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789996337.678725:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000079b23514/0x4173739f0fc81498 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.37@tcp remote: 0x1b97003095e357e7 expref: 6 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996337.678733:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000079b23514/0x4173739f0fc81498 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.37@tcp remote: 0x1b97003095e357e7 expref: 6 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996337.678764:0:5832:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000079b23514/0x4173739f0fc81498 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.37@tcp remote: 0x1b97003095e357e7 expref: 6 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789996337.678778:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0881221180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5832:1876946942239488:192.168.204.37@tcp:105: 00000100:00100000:2.0:1789996337.678848:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0847550c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789996337.681255:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0881221180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5832:1876946942239488:192.168.204.37@tcp:105: 00010000:00010000:2.0:1789996337.681278:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789996337.681322:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e087059ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+6:2362:x1876946927570560:12345-192.168.204.37@tcp:103:ldlm_bl.0 Request processed in 2707us (3317us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996337.681332:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 76 00000100:00100000:1.0:1789996337.683898:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1789996337.683982:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927570816 00000100:00100000:3.0:1789996337.683990:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927570816 00000100:00100000:3.0:1789996337.684036:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 55 00000100:00100000:3.0:1789996337.684044:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fc9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+38:11560:x1876946927570816:12345-192.168.204.37@tcp:35:bash.0 00000100:00100000:3.0:1789996337.684386:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fc9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+39:11560:x1876946927570816:12345-192.168.204.37@tcp:35:bash.0 Request processed in 342us (496us total) trans 4294967484 rc 0/0 00000100:00100000:3.0:1789996337.684393:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 55 00000100:00100000:1.0:1789996337.804192:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996337.804303:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927570944 00000100:00100000:2.0:1789996337.804315:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927570944 00000100:00100000:2.0:1789996337.804390:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 199 00000100:00100000:2.0:1789996337.804402:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fc99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+39:11576:x1876946927570944:12345-192.168.204.37@tcp:101:lfs.0 00010000:00010000:2.0:1789996337.804425:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789996337.804458:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4e00/0x4173739f0fc8149f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b97003095e357ee expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996337.804579:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4200/0x4173739f0fc814a6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996337.804594:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4200/0x4173739f0fc814a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996337.804606:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4200/0x4173739f0fc814a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789996337.804638:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:2.0:1789996337.804642:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789996337.804660:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4200/0x4173739f0fc814a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996337.804684:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4e00/0x4173739f0fc8149f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e357ee expref: 41 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996337.804701:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4200/0x4173739f0fc814a6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e357ee expref: 40 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996337.804709:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e084601b500) 00010000:00010000:2.0:1789996337.804712:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789996337.804716:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e0842de4200, rc 0) 00000100:00100000:2.0:1789996337.804778:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fc99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+40:11576:x1876946927570944:12345-192.168.204.37@tcp:101:lfs.0 Request processed in 378us (598us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996337.804784:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 199 00000100:00100000:0.0:1789996337.809417:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1789996337.809520:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927571200 00000100:00100000:3.0:1789996337.809532:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927571200 00000100:00100000:3.0:1789996337.809639:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 200 00000100:00100000:3.0:1789996337.809650:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0877b7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+40:11576:x1876946927571200:12345-192.168.204.37@tcp:101:lfs.0 00010000:00010000:3.0:1789996337.809672:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789996337.809697:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856a00/0x4173739f0fc814ad lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b97003095e357f5 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996337.809834:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856e00/0x4173739f0fc814b4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996337.809849:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856e00/0x4173739f0fc814b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996337.809862:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856e00/0x4173739f0fc814b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789996337.809873:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1789996337.809999:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856a00/0x4173739f0fc814ad lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e357f5 expref: 43 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996337.810018:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856e00/0x4173739f0fc814b4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e357f5 expref: 42 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996337.810026:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e0861fcf600) 00010000:00010000:3.0:1789996337.810029:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789996337.810032:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e087f856e00, rc 0) 00000100:00100000:3.0:1789996337.810088:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0877b7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+42:11576:x1876946927571200:12345-192.168.204.37@tcp:101:lfs.0 Request processed in 441us (683us total) trans 4294967485 rc 0/0 00000100:00100000:3.0:1789996337.810096:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 200 00000100:00100000:1.0:1789996337.815539:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1789996337.815605:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996337.815692:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927571456 00000100:00100000:2.0:1789996337.815704:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927571456 00000100:00100000:2.0:1789996337.815797:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 201 00000100:00100000:2.0:1789996337.815808:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fc98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+42:11576:x1876946927571456:12345-192.168.204.37@tcp:101:lfs.0 00010000:00010000:2.0:1789996337.815832:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789996337.815852:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4e00/0x4173739f0fc814c2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b97003095e357fc expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996337.815948:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0841524400/0x4173739f0fc814c9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996337.815963:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0841524400/0x4173739f0fc814c9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996337.815974:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0841524400/0x4173739f0fc814c9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789996337.815986:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1789996337.816106:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4e00/0x4173739f0fc814c2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e357fc expref: 45 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996337.816124:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0841524400/0x4173739f0fc814c9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e357fc expref: 44 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996337.816132:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e0861fcf600) 00010000:00010000:2.0:1789996337.816135:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789996337.816139:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e0841524400, rc 0) 00000100:00100000:2.0:1789996337.816208:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fc98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+44:11576:x1876946927571456:12345-192.168.204.37@tcp:101:lfs.0 Request processed in 402us (681us total) trans 4294967486 rc 0/0 00000100:00100000:2.0:1789996337.816216:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 201 00000100:00100000:3.0:1789996337.817038:0:8520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927571584 00000100:00100000:3.0:1789996337.817046:0:8520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927571584 00000100:00100000:3.0:1789996337.817129:0:8520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 14 00000100:00100000:3.0:1789996337.817139:0:8520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fc9a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+44:2363:x1876946927571584:12345-192.168.204.37@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789996337.817152:0:8520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789996337.817190:0:8520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856e00/0x4173739f0fc814b4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e357f5 expref: 44 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996337.817203:0:8520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e0861fcf600) 00010000:00010000:3.0:1789996337.817207:0:8520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789996337.817238:0:8520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fc9a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+43:2363:x1876946927571584:12345-192.168.204.37@tcp:103:ldlm_bl.0 Request processed in 102us (1633us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996337.817245:0:8520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 14 00000100:00100000:3.0:1789996337.823969:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1789996337.824006:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927571712 00000100:00100000:3.0:1789996337.824015:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927571712 00000100:00100000:3.0:1789996337.824065:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 61 00000100:00100000:3.0:1789996337.824075:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e088119c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+6:2365:x1876946927571712:12345-192.168.204.37@tcp:1:lfs.0 00010000:00010000:3.0:1789996337.824120:0:6688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003dedaba5/0x4173739f0fc814d7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996337.824140:0:6688:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000079b23514/0x4173739f0fc81498 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.37@tcp remote: 0x1b97003095e357e7 expref: 6 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996337.824149:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789996337.824153:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789996337.824158:0:6688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003dedaba5/0x4173739f0fc814d7 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996337.824194:0:6688:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000079b23514/0x4173739f0fc81498 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.37@tcp remote: 0x1b97003095e357e7 expref: 6 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996337.824228:0:6688:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000079b23514/0x4173739f0fc81498 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.37@tcp remote: 0x1b97003095e357e7 expref: 6 pid: 6689 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789996337.824242:0:6688:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e088119ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6688:1876946942239616:192.168.204.37@tcp:104: 00000100:00100000:3.0:1789996337.824323:0:6688:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e087667ee40 going to sleep for 11 seconds 00000100:00100000:1.0:1789996337.827621:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1789996337.827732:0:6688:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e088119ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6688:1876946942239616:192.168.204.37@tcp:104: 00010000:00010000:3.0:1789996337.827758:0:6688:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003dedaba5/0x4173739f0fc814d7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789996337.827948:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927571840 00000100:00100000:1.0:1789996337.827955:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927571840 00002000:00100000:1.0:1789996337.827999:0:6695:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff8e086fc99c00 x1876946927571840/t0(0) o4->189efa8a-c7eb-4b69-9afa-1dd36d6775f1@192.168.204.37@tcp:68/0 lens 504/0 e 0 to 0 dl 1789996348 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789996337.828009:0:6695:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8e086fc99c00 with x1876946927571840 ext(0->8) 00010000:00010000:1.0:1789996337.828016:0:6695:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000079b23514/0x4173739f0fc81498 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.37@tcp remote: 0x1b97003095e357e7 expref: 7 pid: 6689 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996337.828030:0:6695:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000079b23514/0x4173739f0fc81498 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.37@tcp remote: 0x1b97003095e357e7 expref: 7 pid: 6689 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789996337.828038:0:6695:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8e086fc99c00 00000100:00100000:1.0:1789996337.828082:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 3 00000100:00100000:1.0:1789996337.828091:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fc99c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+7:2363:x1876946927571840:12345-192.168.204.37@tcp:4:lfs.0 00000100:00100000:1.0:1789996337.828668:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fc99c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+9:2363:x1876946927571840:12345-192.168.204.37@tcp:4:lfs.0 Request processed in 576us (1056us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1789996337.828676:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 3 00002000:00100000:1.0:1789996337.828683:0:6695:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff8e086fc99c00 x1876946927571840/t4294967308(0) o4->189efa8a-c7eb-4b69-9afa-1dd36d6775f1@192.168.204.37@tcp:68/0 lens 504/448 e 0 to 0 dl 1789996348 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789996337.828690:0:6695:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8e086fc99c00 with x1876946927571840 ext(0->8) 00010000:00010000:1.0:1789996337.828697:0:6695:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000079b23514/0x4173739f0fc81498 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.37@tcp remote: 0x1b97003095e357e7 expref: 9 pid: 6689 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996337.828709:0:6695:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000079b23514/0x4173739f0fc81498 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.37@tcp remote: 0x1b97003095e357e7 expref: 9 pid: 6689 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789996337.828716:0:6695:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8e086fc99c00 00000100:00100000:1.0:1789996337.831247:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996337.831332:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927571968 00000100:00100000:0.0:1789996337.831340:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927571968 00010000:00010000:0.0:1789996337.831376:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000079b23514/0x4173739f0fc81498 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.37@tcp remote: 0x1b97003095e357e7 expref: 9 pid: 6689 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789996337.831476:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 77 00000100:00100000:0.0:1789996337.831486:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fc9b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+9:2364:x1876946927571968:12345-192.168.204.37@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789996337.831511:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1789996337.831531:0:5831:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1789996337.831533:0:5831:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1789996338 00002000:00010000:0.0:1789996337.831535:0:5831:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1789996338 00002000:00010000:0.0:1789996337.831538:0:5831:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1789996338 00010000:00010000:0.0:1789996337.831578:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000079b23514/0x4173739f0fc81498 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.37@tcp remote: 0x1b97003095e357e7 expref: 9 pid: 6689 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996337.831590:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000079b23514/0x4173739f0fc81498 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.37@tcp remote: 0x1b97003095e357e7 expref: 9 pid: 6689 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996337.831614:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079b23514/0x4173739f0fc81498 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.37@tcp remote: 0x1b97003095e357e7 expref: 9 pid: 6689 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996337.831629:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789996337.831633:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789996337.831640:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003dedaba5/0x4173739f0fc814d7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996337.831649:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003dedaba5/0x4173739f0fc814d7 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996337.831676:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789996337.831722:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fc9b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+8:2364:x1876946927571968:12345-192.168.204.37@tcp:103:ldlm_bl.0 Request processed in 238us (484us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996337.831729:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 77 00010000:00010000:3.0:1789996337.831803:0:6688:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003dedaba5/0x4173739f0fc814d7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996337.831813:0:6688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003dedaba5/0x4173739f0fc814d7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996337.831837:0:6688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003dedaba5/0x4173739f0fc814d7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996337.831845:0:6688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003dedaba5/0x4173739f0fc814d7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996337.831854:0:6688:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003dedaba5/0x4173739f0fc814d7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996337.831872:0:6688:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e087f856a00 already unused, calling callback (ffffffffc1595910) 00010000:00010000:3.0:1789996337.831876:0:6688:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003dedaba5/0x4173739f0fc814d7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996337.831884:0:6688:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003dedaba5/0x4173739f0fc814d7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996337.831895:0:6688:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003dedaba5/0x4173739f0fc814d7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996337.831902:0:6688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003dedaba5/0x4173739f0fc814d7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789996337.831947:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e088119c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+7:2365:x1876946927571712:12345-192.168.204.37@tcp:1:lfs.0 Request processed in 7873us (7989us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996337.831955:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 61 00000100:00100000:1.0:1789996337.833854:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996337.834010:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927572224 00000100:00100000:2.0:1789996337.834029:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927572224 00000100:00100000:2.0:1789996337.834084:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 56 00000100:00100000:2.0:1789996337.834094:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0850a23c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+43:11576:x1876946927572224:12345-192.168.204.37@tcp:35:lfs.0 00000004:00010000:2.0:1789996337.834153:0:5849:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e0841524400/0x4173739f0fc814c9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e357fc expref: 43 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789996337.834408:0:5849:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:2.0:1789996337.834467:0:5849:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967488 00000001:00080000:2.0:1789996337.835271:0:5849:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967489 00010000:00010000:2.0:1789996337.835330:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0841524e00/0x4173739f0fc814de lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996337.835348:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22000/0x4173739f0fc81483 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e357d9 expref: 47 pid: 9163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996337.835357:0:5849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0841524e00/0x4173739f0fc814de lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996337.835393:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22000/0x4173739f0fc81483 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e357d9 expref: 47 pid: 9163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996337.835408:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22000/0x4173739f0fc81483 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e357d9 expref: 47 pid: 9163 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789996337.835422:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0881221180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5849:1876946942239744:192.168.204.37@tcp:104: 00000100:00100000:2.0:1789996337.835757:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0847550d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789996337.838249:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1789996337.838317:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927572352 00000100:00100000:3.0:1789996337.838326:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927572352 00010000:00010000:3.0:1789996337.838362:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22000/0x4173739f0fc81483 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e357d9 expref: 48 pid: 9163 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789996337.838403:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 78 00000100:00100000:3.0:1789996337.838412:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fc9bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+48:2362:x1876946927572352:12345-192.168.204.37@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789996337.838427:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789996337.838434:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22000/0x4173739f0fc81483 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e357d9 expref: 48 pid: 9163 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996337.838470:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22000/0x4173739f0fc81483 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e357d9 expref: 48 pid: 9163 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996337.838504:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e0861fcf600) 00010000:00010000:3.0:1789996337.838510:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e0841524e00/0x4173739f0fc814de lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996337.838520:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0841524e00/0x4173739f0fc814de lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996337.838528:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0841524e00/0x4173739f0fc814de lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996337.838574:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789996337.838626:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fc9bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+48:2362:x1876946927572352:12345-192.168.204.37@tcp:103:ldlm_bl.0 Request processed in 215us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996337.838633:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 78 00010000:00010000:2.0:1789996337.839718:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22000/0x4173739f0fc81483 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e357d9 expref: 47 pid: 9163 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789996337.839750:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0881221180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5849:1876946942239744:192.168.204.37@tcp:104: 00010000:00010000:2.0:1789996337.839774:0:5849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e0841524e00/0x4173739f0fc814de lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996337.839909:0:5849:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e0841524e00/0x4173739f0fc814de lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996337.839915:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0841524e00/0x4173739f0fc814de lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789996337.840030:0:5849:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967490 00000001:00080000:2.0:1789996337.840218:0:5849:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:2.0:1789996337.840313:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0881221180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5849:1876946942239872:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1789996337.840362:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996337.840455:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0847550a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789996337.843762:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942239872 00000100:00100000:1.0:1789996337.843776:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942239872 00000100:00100000:1.0:1789996337.843916:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789996337.843925:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0881223480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5849:x1876946942239872:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1789996337.844047:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0881223480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5849:x1876946942239872:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 123us (3684us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996337.844055:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789996337.844127:0:5849:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967307 gen 2 00000004:00080000:1.0:1789996337.844133:0:5849:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967307 00000004:00080000:1.0:1789996337.844154:0:5849:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e086fc84380, transno 4294967307 00000100:00100000:1.0:1789996337.844169:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0881221180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5849:1876946942239872:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1789996337.844936:0:5849:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967492 00000100:00100000:1.0:1789996337.845023:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fc98380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5849:1876946942240000:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1789996337.845070:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996337.845135:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e08494c90c0 going to sleep for 11 seconds 00000100:00080000:0.0:1789996337.845445:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789996337.845666:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942240000 00000100:00100000:3.0:1789996337.845674:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942240000 00000100:00100000:1.0:1789996337.845835:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789996337.845844:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fc9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5849:x1876946942240000:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1789996337.846254:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fc9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5849:x1876946942240000:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 410us (1182us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1789996337.846262:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789996337.846351:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fc98380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5849:1876946942240000:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1789996337.846410:0:5849:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:2.0:1789996337.846461:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0841524e00/0x4173739f0fc814de lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996337.846471:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0841524e00/0x4173739f0fc814de lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996337.846477:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e0841524e00/0x4173739f0fc814de lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996337.846494:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0841524e00 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:2.0:1789996337.846499:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0841524e00/0x4173739f0fc814de lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996337.846517:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0841524e00/0x4173739f0fc814de lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996337.846533:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e0861fcf600) 00010000:00010000:2.0:1789996337.846536:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1789996337.846672:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e0841524e00/0x4173739f0fc814de lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996337.846681:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0841524e00/0x4173739f0fc814de lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789996337.846986:0:5849:0:(mdd_object.c:4178:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1789996337.847072:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:3.0:1789996337.847084:0:5849:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 379566540409ns, next at 380566538469ns, rc = 0 00000001:00080000:3.0:1789996337.847091:0:5849:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967494 00010000:00010000:3.0:1789996337.847128:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e0861fcf600) 00010000:00010000:3.0:1789996337.847132:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1789996337.847140:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0841524400/0x4173739f0fc814c9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e357fc expref: 51 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789996337.847297:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0850a23c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+50:11576:x1876946927572224:12345-192.168.204.37@tcp:35:lfs.0 Request processed in 13204us (13449us total) trans 4294967495 rc 0/0 00000100:00100000:3.0:1789996337.847306:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 56 00000020:00080000:3.0:1789996337.847311:0:5849:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1789996337.849457:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996337.849707:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927572480 00000100:00100000:2.0:1789996337.849716:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927572480 00000100:00100000:0.0:1789996337.849874:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 202 00000100:00100000:0.0:1789996337.849884:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fc99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+50:11576:x1876946927572480:12345-192.168.204.37@tcp:101:lfs.0 00010000:00010000:0.0:1789996337.849904:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789996337.849927:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6200/0x4173739f0fc814e5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b97003095e35803 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996337.849991:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6200/0x4173739f0fc814e5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35803 expref: 51 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996337.850006:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6200/0x4173739f0fc814e5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35803 expref: 51 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996337.850024:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e0850c28100) 00010000:00010000:0.0:1789996337.850026:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789996337.850030:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e086fcb6200, rc 0) 00000100:00100000:0.0:1789996337.850088:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fc99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+51:11576:x1876946927572480:12345-192.168.204.37@tcp:101:lfs.0 Request processed in 205us (649us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996337.850095:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 202 00000100:00100000:1.0:1789996337.853409:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996337.853499:0:11495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927572736 00000100:00100000:2.0:1789996337.853509:0:11495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927572736 00000100:00100000:2.0:1789996337.853600:0:11495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 57 00000100:00100000:2.0:1789996337.853611:0:11495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fc9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+51:11576:x1876946927572736:12345-192.168.204.37@tcp:35:lfs.0 00000100:00100000:2.0:1789996337.853852:0:11495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fc9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+52:11576:x1876946927572736:12345-192.168.204.37@tcp:35:lfs.0 Request processed in 241us (451us total) trans 4294967496 rc 0/0 00000100:00100000:2.0:1789996337.853860:0:11495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 57 00000100:00100000:3.0:1789996337.927662:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996337.927765:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927572864 00000100:00100000:2.0:1789996337.927776:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927572864 00000100:00100000:2.0:1789996337.927840:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 203 00000100:00100000:2.0:1789996337.927851:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e088119ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+52:11586:x1876946927572864:12345-192.168.204.37@tcp:34:lfs.0 00010000:00010000:2.0:1789996337.927930:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0841524e00/0x4173739f0fc814ec lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996337.927947:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0841524e00/0x4173739f0fc814ec lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996337.927971:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0841524e00/0x4173739f0fc814ec lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996337.927986:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0841524400/0x4173739f0fc814f3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996337.927992:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0841524400/0x4173739f0fc814f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996337.927998:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0841524400/0x4173739f0fc814f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996337.928080:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4800/0x4173739f0fc814fa lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996337.928088:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4800/0x4173739f0fc814fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996337.928095:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4800/0x4173739f0fc814fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789996337.928134:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4800/0x4173739f0fc814fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996337.928146:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0841524e00/0x4173739f0fc814ec lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996337.928153:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0841524e00/0x4173739f0fc814ec lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996337.928159:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e0841524e00/0x4173739f0fc814ec lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996337.928174:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0841524e00 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:2.0:1789996337.928178:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0841524e00/0x4173739f0fc814ec lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996337.928185:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0841524e00/0x4173739f0fc814ec lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996337.928197:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e084601b500) 00010000:00010000:2.0:1789996337.928200:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789996337.928204:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e0841524e00/0x4173739f0fc814ec lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996337.928209:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0841524e00/0x4173739f0fc814ec lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996337.928222:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0841524400/0x4173739f0fc814f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996337.928227:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0841524400/0x4173739f0fc814f3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996337.928233:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e0841524400/0x4173739f0fc814f3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996337.928238:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0841524400 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:2.0:1789996337.928240:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0841524400/0x4173739f0fc814f3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996337.928246:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0841524400/0x4173739f0fc814f3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996337.928266:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8e084601b400) 00010000:00010000:2.0:1789996337.928268:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789996337.928271:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e0841524400/0x4173739f0fc814f3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996337.928276:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0841524400/0x4173739f0fc814f3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996337.928288:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4800/0x4173739f0fc814fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996337.928294:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4800/0x4173739f0fc814fa lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996337.928298:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4800/0x4173739f0fc814fa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996337.928303:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0842de4800 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:2.0:1789996337.928305:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4800/0x4173739f0fc814fa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996337.928310:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4800/0x4173739f0fc814fa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996337.928317:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e0850c28100) 00010000:00010000:2.0:1789996337.928319:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789996337.928322:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4800/0x4173739f0fc814fa lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996337.928327:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4800/0x4173739f0fc814fa lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789996337.928416:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e088119ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+52:11586:x1876946927572864:12345-192.168.204.37@tcp:34:lfs.0 Request processed in 567us (764us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996337.928424:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 203 00000100:00100000:1.0:1789996337.961873:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996337.961972:0:9163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927573120 00000100:00100000:2.0:1789996337.961982:0:9163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927573120 00000100:00100000:2.0:1789996337.962039:0:9163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 204 00000100:00100000:2.0:1789996337.962049:0:9163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fc99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+52:11589:x1876946927573120:12345-192.168.204.37@tcp:101:lfs.0 00010000:00010000:2.0:1789996337.962070:0:9163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789996337.962239:0:9163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4800/0x4173739f0fc81501 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b97003095e3580a expref: -99 pid: 9163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996337.962312:0:9163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4e00/0x4173739f0fc81508 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996337.962326:0:9163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4e00/0x4173739f0fc81508 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996337.962336:0:9163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4e00/0x4173739f0fc81508 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996337.962350:0:9163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0841524400/0x4173739f0fc8150f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996337.962357:0:9163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0841524400/0x4173739f0fc8150f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996337.962364:0:9163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0841524400/0x4173739f0fc8150f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996337.962514:0:9163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0841524e00/0x4173739f0fc81516 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996337.962522:0:9163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0841524e00/0x4173739f0fc81516 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996337.962529:0:9163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0841524e00/0x4173739f0fc81516 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789996337.962539:0:9163:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1789996337.962870:0:9163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4e00/0x4173739f0fc81508 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996337.962880:0:9163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4e00/0x4173739f0fc81508 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996337.962887:0:9163:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4e00/0x4173739f0fc81508 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996337.962892:0:9163:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0842de4e00 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:3.0:1789996337.962897:0:9163:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4e00/0x4173739f0fc81508 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996337.962904:0:9163:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4e00/0x4173739f0fc81508 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996337.962916:0:9163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e084601b500) 00010000:00010000:3.0:1789996337.962919:0:9163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789996337.962924:0:9163:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4e00/0x4173739f0fc81508 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996337.962930:0:9163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4e00/0x4173739f0fc81508 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996337.962942:0:9163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0841524400/0x4173739f0fc8150f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996337.962955:0:9163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0841524400/0x4173739f0fc8150f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996337.962961:0:9163:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e0841524400/0x4173739f0fc8150f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996337.962966:0:9163:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0841524400 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:3.0:1789996337.962969:0:9163:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0841524400/0x4173739f0fc8150f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996337.962974:0:9163:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0841524400/0x4173739f0fc8150f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996337.962981:0:9163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8e084601b400) 00010000:00010000:3.0:1789996337.962983:0:9163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789996337.962986:0:9163:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e0841524400/0x4173739f0fc8150f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996337.962991:0:9163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0841524400/0x4173739f0fc8150f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996337.963028:0:9163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4800/0x4173739f0fc81501 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e3580a expref: 55 pid: 9163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996337.963041:0:9163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0841524e00/0x4173739f0fc81516 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e3580a expref: 54 pid: 9163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996337.963048:0:9163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e0850c28100) 00010000:00010000:3.0:1789996337.963051:0:9163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789996337.963057:0:9163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e0841524e00, rc 0) 00000100:00100000:3.0:1789996337.963358:0:9163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fc99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+54:11589:x1876946927573120:12345-192.168.204.37@tcp:101:lfs.0 Request processed in 1309us (1495us total) trans 4294967497 rc 0/0 00000100:00100000:3.0:1789996337.963366:0:9163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 204 00000100:00100000:1.0:1789996337.972811:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996337.973061:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927573248 00000100:00100000:2.0:1789996337.973072:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927573248 00000100:00100000:2.0:1789996337.973190:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 205 00000100:00100000:2.0:1789996337.973203:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fc9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+54:11589:x1876946927573248:12345-192.168.204.37@tcp:54:lfs.0 00010000:00010000:2.0:1789996337.973275:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0841524400/0x4173739f0fc81524 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996337.973292:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0841524400/0x4173739f0fc81524 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996337.973305:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0841524400/0x4173739f0fc81524 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996337.973335:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0841524400/0x4173739f0fc81524 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996337.973358:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0841524400/0x4173739f0fc81524 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996337.973365:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e0841524400/0x4173739f0fc81524 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996337.973385:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0841524400 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:2.0:1789996337.973391:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0841524400/0x4173739f0fc81524 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996337.973398:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0841524400/0x4173739f0fc81524 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996337.973412:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e0850c28100) 00010000:00010000:2.0:1789996337.973415:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789996337.973421:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e0841524400/0x4173739f0fc81524 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996337.973428:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0841524400/0x4173739f0fc81524 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789996337.973618:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fc9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+54:11589:x1876946927573248:12345-192.168.204.37@tcp:54:lfs.0 Request processed in 416us (815us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996337.973627:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 205 00000100:00100000:1.0:1789996337.976150:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1789996337.976251:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927573504 00000100:00100000:3.0:1789996337.976260:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927573504 00000100:00100000:3.0:1789996337.976311:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 58 00000100:00100000:3.0:1789996337.976319:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fc99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+54:11589:x1876946927573504:12345-192.168.204.37@tcp:35:lfs.0 00000100:00100000:3.0:1789996337.976979:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fc99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+55:11589:x1876946927573504:12345-192.168.204.37@tcp:35:lfs.0 Request processed in 657us (836us total) trans 4294967498 rc 0/0 00000100:00100000:3.0:1789996337.976987:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 58 00000100:00100000:3.0:1789996338.071349:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996338.071465:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927573760 00000100:00100000:0.0:1789996338.071477:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927573760 00000100:00100000:3.0:1789996338.071749:0:9163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 206 00000100:00100000:3.0:1789996338.071762:0:9163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e088119d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+55:11599:x1876946927573760:12345-192.168.204.37@tcp:101:bash.0 00010000:00010000:3.0:1789996338.071801:0:9163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789996338.071805:0:9163:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789996338.071831:0:9163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4200/0x4173739f0fc814a6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e357ee expref: 55 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996338.071852:0:9163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e084601b500) 00010000:00010000:3.0:1789996338.071857:0:9163:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789996338.071870:0:9163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856a00/0x4173739f0fc8152b lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b97003095e35811 expref: -99 pid: 9163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996338.071970:0:9163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856e00/0x4173739f0fc81532 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996338.072007:0:9163:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0841524e00/0x4173739f0fc81516 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e3580a expref: 55 pid: 9163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996338.072014:0:9163:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856e00/0x4173739f0fc81532 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996338.072045:0:9163:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e0841524e00/0x4173739f0fc81516 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e3580a expref: 55 pid: 9163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996338.072058:0:9163:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0841524e00/0x4173739f0fc81516 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e3580a expref: 55 pid: 9163 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789996338.072071:0:9163:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e088119f480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9163:1876946942240128:192.168.204.37@tcp:104: 00000100:00100000:3.0:1789996338.072180:0:9163:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e087667e000 going to sleep for 11 seconds 00000100:00100000:3.0:1789996338.077905:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996338.078036:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927573888 00000100:00100000:2.0:1789996338.078047:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927573888 00010000:00010000:2.0:1789996338.078095:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0841524e00/0x4173739f0fc81516 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e3580a expref: 56 pid: 9163 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789996338.078144:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 79 00000100:00100000:2.0:1789996338.078155:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e088119d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+56:2362:x1876946927573888:12345-192.168.204.37@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789996338.078172:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789996338.078179:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e0841524e00/0x4173739f0fc81516 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e3580a expref: 56 pid: 9163 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996338.078213:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e0841524e00/0x4173739f0fc81516 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e3580a expref: 56 pid: 9163 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996338.078239:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e0850c28100) 00010000:00010000:2.0:1789996338.078245:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856e00/0x4173739f0fc81532 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996338.078257:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856e00/0x4173739f0fc81532 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996338.078266:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856e00/0x4173739f0fc81532 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996338.078287:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789996338.078350:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e088119d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+56:2362:x1876946927573888:12345-192.168.204.37@tcp:103:ldlm_bl.0 Request processed in 196us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996338.078359:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 79 00010000:00010000:0.0:1789996338.078730:0:9163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0841524e00/0x4173739f0fc81516 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e3580a expref: 55 pid: 9163 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789996338.078749:0:9163:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e088119f480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9163:1876946942240128:192.168.204.37@tcp:104: 00010000:00010000:0.0:1789996338.078794:0:9163:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856e00/0x4173739f0fc81532 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996338.078805:0:9163:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856e00/0x4173739f0fc81532 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996338.078811:0:9163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856e00/0x4173739f0fc81532 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789996338.078842:0:9163:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1789996338.078991:0:9163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856a00/0x4173739f0fc8152b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35811 expref: 56 pid: 9163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996338.079007:0:9163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856e00/0x4173739f0fc81532 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35811 expref: 55 pid: 9163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996338.079014:0:9163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e0850c28100) 00010000:00010000:0.0:1789996338.079017:0:9163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789996338.079020:0:9163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e087f856e00, rc 0) 00000100:00100000:0.0:1789996338.079062:0:9163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e088119d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+55:11599:x1876946927573760:12345-192.168.204.37@tcp:101:bash.0 Request processed in 7304us (7723us total) trans 4294967499 rc 0/0 00000100:00100000:0.0:1789996338.079068:0:9163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 206 00000100:00100000:3.0:1789996338.081414:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996338.081635:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927574144 00000100:00100000:0.0:1789996338.081647:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927574144 00000100:00100000:0.0:1789996338.081708:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 207 00000100:00100000:0.0:1789996338.081729:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e088119ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+55:11599:x1876946927574144:12345-192.168.204.37@tcp:36:bash.0 00010000:00010000:0.0:1789996338.082141:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6800/0x4173739f0fc81540 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996338.082176:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6800/0x4173739f0fc81540 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996338.082189:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6800/0x4173739f0fc81540 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789996338.082239:0:5847:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967500 00000004:00010000:0.0:1789996338.082260:0:5847:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000035119c74 reply state 000000004e9e23de transno 4294967501 ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6800/0x4173739f0fc81540 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789996338.082269:0:5847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789996338.082363:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e088119ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+58:11599:x1876946927574144:12345-192.168.204.37@tcp:36:bash.0 Request processed in 636us (959us total) trans 4294967501 rc 0/0 00000100:00100000:0.0:1789996338.082370:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 207 00000020:00080000:0.0:1789996338.082375:0:5847:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789996338.087626:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6800/0x4173739f0fc81540 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996338.087649:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6800/0x4173739f0fc81540 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996338.087658:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6800/0x4173739f0fc81540 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996338.087665:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e086fcb6800 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:0.0:1789996338.087670:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6800/0x4173739f0fc81540 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996338.087679:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6800/0x4173739f0fc81540 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996338.087930:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e0850c28100) 00010000:00010000:0.0:1789996338.088000:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789996338.088006:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6800/0x4173739f0fc81540 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996338.088013:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6800/0x4173739f0fc81540 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789996338.100705:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996338.101246:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927574272 00000100:00100000:0.0:1789996338.101258:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927574272 00000100:00100000:0.0:1789996338.101834:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 208 00000100:00100000:0.0:1789996338.101847:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fc98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+57:11599:x1876946927574272:12345-192.168.204.37@tcp:101:bash.0 00010000:00010000:0.0:1789996338.101873:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789996338.102183:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6c00/0x4173739f0fc81547 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b97003095e35818 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996338.102269:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7000/0x4173739f0fc8154e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996338.102287:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856e00/0x4173739f0fc81532 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35811 expref: 58 pid: 9163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996338.102296:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7000/0x4173739f0fc8154e lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996338.102332:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856e00/0x4173739f0fc81532 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35811 expref: 58 pid: 9163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996338.102347:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856e00/0x4173739f0fc81532 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35811 expref: 58 pid: 9163 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789996338.102377:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0877b7d500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5848:1876946942240256:192.168.204.37@tcp:104: 00000100:00100000:0.0:1789996338.102491:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0842e04600 going to sleep for 11 seconds 00000100:00100000:0.0:1789996338.106420:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996338.106710:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927574400 00000100:00100000:2.0:1789996338.106731:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927574400 00010000:00010000:2.0:1789996338.106775:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856e00/0x4173739f0fc81532 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35811 expref: 59 pid: 9163 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789996338.106905:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 80 00000100:00100000:2.0:1789996338.106916:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0881227100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+59:2362:x1876946927574400:12345-192.168.204.37@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789996338.107056:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789996338.107067:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856e00/0x4173739f0fc81532 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35811 expref: 59 pid: 9163 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996338.107095:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856e00/0x4173739f0fc81532 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35811 expref: 59 pid: 9163 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996338.107119:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e0850c28100) 00010000:00010000:2.0:1789996338.107124:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7000/0x4173739f0fc8154e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996338.107133:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7000/0x4173739f0fc8154e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996338.107142:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7000/0x4173739f0fc8154e lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996338.107160:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789996338.107270:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0881227100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+59:2362:x1876946927574400:12345-192.168.204.37@tcp:103:ldlm_bl.0 Request processed in 355us (875us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996338.107279:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 80 00010000:00010000:3.0:1789996338.108345:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856e00/0x4173739f0fc81532 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35811 expref: 58 pid: 9163 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789996338.108368:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0877b7d500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5848:1876946942240256:192.168.204.37@tcp:104: 00010000:00010000:3.0:1789996338.108408:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7000/0x4173739f0fc8154e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996338.108617:0:5848:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7000/0x4173739f0fc8154e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996338.108626:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7000/0x4173739f0fc8154e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789996338.108677:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1789996338.108682:0:5848:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789996338.108703:0:5848:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7000/0x4173739f0fc8154e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996338.108747:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6c00/0x4173739f0fc81547 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35818 expref: 58 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996338.108781:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7000/0x4173739f0fc8154e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35818 expref: 57 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996338.108799:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e0850c28100) 00010000:00010000:2.0:1789996338.108802:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789996338.108805:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e086fcb7000, rc 0) 00000100:00100000:2.0:1789996338.108856:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fc98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+57:11599:x1876946927574272:12345-192.168.204.37@tcp:101:bash.0 Request processed in 7012us (8160us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996338.108864:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 208 00000100:00100000:2.0:1789996338.118158:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1789996338.118283:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927574656 00000100:00100000:3.0:1789996338.118293:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927574656 00000100:00100000:1.0:1789996338.118636:0:11495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 59 00000100:00100000:1.0:1789996338.118653:0:11495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0881221500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+57:11599:x1876946927574656:12345-192.168.204.37@tcp:35:bash.0 00000100:00100000:1.0:1789996338.119336:0:11495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0881221500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+58:11599:x1876946927574656:12345-192.168.204.37@tcp:35:bash.0 Request processed in 676us (1176us total) trans 4294967502 rc 0/0 00000100:00100000:1.0:1789996338.119346:0:11495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 59 00000100:00100000:2.0:1789996338.154085:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789996338.154111:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fc9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876946942240384:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789996338.154189:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789996338.154303:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942240384 00000100:00100000:3.0:1789996338.154313:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942240384 00000100:00100000:3.0:1789996338.154394:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789996338.154404:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0881222d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1876946942240384:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789996338.154443:0:6692:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 52756480 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789996338.154508:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0881222d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1876946942240384:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996338.154516:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789996338.154752:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fc9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876946942240384:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789996338.204992:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996338.205190:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927574784 00000100:00100000:0.0:1789996338.205200:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927574784 00000100:00100000:0.0:1789996338.205264:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 209 00000100:00100000:0.0:1789996338.205276:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0881221f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+58:11605:x1876946927574784:12345-192.168.204.37@tcp:101:lfs.0 00010000:00010000:0.0:1789996338.205299:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789996338.205322:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6a00/0x4173739f0fc81555 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b97003095e3581f expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996338.205398:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7600/0x4173739f0fc8155c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996338.205413:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7600/0x4173739f0fc8155c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996338.205425:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7600/0x4173739f0fc8155c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789996338.205471:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:0.0:1789996338.205475:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789996338.205493:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7600/0x4173739f0fc8155c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996338.205519:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6a00/0x4173739f0fc81555 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e3581f expref: 60 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996338.205598:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7600/0x4173739f0fc8155c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e3581f expref: 59 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996338.205607:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e084601b500) 00010000:00010000:0.0:1789996338.205611:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789996338.205615:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e086fcb7600, rc 0) 00000100:00100000:0.0:1789996338.205681:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0881221f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+59:11605:x1876946927574784:12345-192.168.204.37@tcp:101:lfs.0 Request processed in 407us (699us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996338.205689:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 209 00000100:00100000:0.0:1789996338.212044:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1789996338.212144:0:9163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927574912 00000100:00100000:3.0:1789996338.212156:0:9163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927574912 00000100:00100000:3.0:1789996338.212224:0:9163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 210 00000100:00100000:3.0:1789996338.212235:0:9163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0881227b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+59:11605:x1876946927574912:12345-192.168.204.37@tcp:101:lfs.0 00010000:00010000:3.0:1789996338.212256:0:9163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789996338.212277:0:9163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856e00/0x4173739f0fc81563 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b97003095e35826 expref: -99 pid: 9163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996338.212355:0:9163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857800/0x4173739f0fc8156a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996338.212371:0:9163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857800/0x4173739f0fc8156a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996338.212383:0:9163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857800/0x4173739f0fc8156a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996338.212401:0:9163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857600/0x4173739f0fc81571 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996338.212408:0:9163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857600/0x4173739f0fc81571 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996338.212415:0:9163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857600/0x4173739f0fc81571 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996338.212637:0:9163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857200/0x4173739f0fc81578 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996338.212647:0:9163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857200/0x4173739f0fc81578 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996338.212655:0:9163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857200/0x4173739f0fc81578 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789996338.212689:0:9163:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1789996338.212693:0:9163:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789996338.213103:0:9163:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857200/0x4173739f0fc81578 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996338.213116:0:9163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857200/0x4173739f0fc81578 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996338.213126:0:9163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857800/0x4173739f0fc8156a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996338.213133:0:9163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857800/0x4173739f0fc8156a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996338.213141:0:9163:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857800/0x4173739f0fc8156a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996338.213148:0:9163:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e087f857800 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:3.0:1789996338.213152:0:9163:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857800/0x4173739f0fc8156a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996338.213160:0:9163:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857800/0x4173739f0fc8156a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996338.213183:0:9163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e084601b500) 00010000:00010000:3.0:1789996338.213186:0:9163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789996338.213191:0:9163:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857800/0x4173739f0fc8156a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996338.213197:0:9163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857800/0x4173739f0fc8156a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996338.213211:0:9163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857600/0x4173739f0fc81571 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996338.213217:0:9163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857600/0x4173739f0fc81571 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996338.213223:0:9163:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857600/0x4173739f0fc81571 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996338.213228:0:9163:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e087f857600 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:3.0:1789996338.213231:0:9163:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857600/0x4173739f0fc81571 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996338.213237:0:9163:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857600/0x4173739f0fc81571 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996338.213245:0:9163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8e0846583000) 00010000:00010000:3.0:1789996338.213247:0:9163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789996338.213250:0:9163:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857600/0x4173739f0fc81571 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996338.213255:0:9163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857600/0x4173739f0fc81571 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996338.213300:0:9163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856e00/0x4173739f0fc81563 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35826 expref: 61 pid: 9163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996338.213316:0:9163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857200/0x4173739f0fc81578 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35826 expref: 60 pid: 9163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996338.213338:0:9163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e0850c28100) 00010000:00010000:3.0:1789996338.213340:0:9163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789996338.213343:0:9163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e087f857200, rc 0) 00000100:00100000:3.0:1789996338.213417:0:9163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0881227b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+60:11605:x1876946927574912:12345-192.168.204.37@tcp:101:lfs.0 Request processed in 1182us (1635us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996338.213425:0:9163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 210 00000100:00100000:2.0:1789996338.219531:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1789996338.219756:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927575040 00000100:00100000:1.0:1789996338.219766:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927575040 00000100:00100000:1.0:1789996338.219847:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 15 00000100:00100000:1.0:1789996338.219859:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0881220700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+60:2362:x1876946927575040:12345-192.168.204.37@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789996338.219887:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789996338.219917:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857200/0x4173739f0fc81578 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35826 expref: 60 pid: 9163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996338.220260:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e0850c28100) 00010000:00010000:1.0:1789996338.220266:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789996338.220320:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0881220700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+59:2362:x1876946927575040:12345-192.168.204.37@tcp:103:ldlm_bl.0 Request processed in 464us (799us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996338.220329:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 15 00000100:00100000:2.0:1789996338.223795:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996338.224108:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927575296 00000100:00100000:0.0:1789996338.224118:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927575296 00000100:00100000:0.0:1789996338.224181:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 211 00000100:00100000:0.0:1789996338.224191:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0881223800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+59:11605:x1876946927575296:12345-192.168.204.37@tcp:101:lfs.0 00010000:00010000:0.0:1789996338.224215:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789996338.224237:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7e00/0x4173739f0fc8157f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b97003095e3582d expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996338.224364:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6000/0x4173739f0fc81586 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996338.224381:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7000/0x4173739f0fc8154e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35818 expref: 60 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996338.224391:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6000/0x4173739f0fc81586 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996338.224454:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7000/0x4173739f0fc8154e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35818 expref: 60 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996338.224468:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7000/0x4173739f0fc8154e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35818 expref: 60 pid: 5848 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789996338.224493:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0881224380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5847:1876946942240512:192.168.204.37@tcp:104: 00000100:00100000:0.0:1789996338.224637:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0842e04a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789996338.230156:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0881224380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5847:1876946942240512:192.168.204.37@tcp:104: 00010000:00010000:1.0:1789996338.230201:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6000/0x4173739f0fc81586 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789996338.232236:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1789996338.233052:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927575424 00000100:00100000:3.0:1789996338.233063:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927575424 00010000:00010000:3.0:1789996338.233107:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7000/0x4173739f0fc8154e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35818 expref: 61 pid: 5848 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789996338.233158:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 81 00000100:00100000:3.0:1789996338.233168:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e087059a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+61:2363:x1876946927575424:12345-192.168.204.37@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789996338.233183:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789996338.233191:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7000/0x4173739f0fc8154e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35818 expref: 61 pid: 5848 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996338.233205:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7000/0x4173739f0fc8154e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35818 expref: 61 pid: 5848 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996338.233248:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7000/0x4173739f0fc8154e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35818 expref: 61 pid: 5848 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996338.233266:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e0850c28100) 00010000:00010000:3.0:1789996338.233271:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6000/0x4173739f0fc81586 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996338.233281:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6000/0x4173739f0fc81586 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996338.233289:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6000/0x4173739f0fc81586 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996338.233332:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789996338.233400:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e087059a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+60:2363:x1876946927575424:12345-192.168.204.37@tcp:103:ldlm_bl.0 Request processed in 233us (1175us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996338.233407:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 81 00010000:00010000:1.0:1789996338.233604:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6000/0x4173739f0fc81586 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996338.233613:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6000/0x4173739f0fc81586 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789996338.233632:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1789996338.233821:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7e00/0x4173739f0fc8157f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e3582d expref: 61 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996338.233837:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6000/0x4173739f0fc81586 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e3582d expref: 60 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996338.233851:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e0850c28100) 00010000:00010000:1.0:1789996338.233853:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789996338.233855:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e086fcb6000, rc 0) 00000100:00100000:1.0:1789996338.233882:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0881223800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+60:11605:x1876946927575296:12345-192.168.204.37@tcp:101:lfs.0 Request processed in 9694us (10113us total) trans 4294967503 rc 0/0 00000100:00100000:1.0:1789996338.233889:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 211 00000100:00100000:0.0:1789996338.239646:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1789996338.239747:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927575680 00000100:00100000:3.0:1789996338.239758:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927575680 00000100:00100000:3.0:1789996338.239832:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 16 00000100:00100000:3.0:1789996338.239844:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0881226a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+60:11605:x1876946927575680:12345-192.168.204.37@tcp:103:lfs.0 00010000:00010000:3.0:1789996338.239860:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789996338.239896:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6200/0x4173739f0fc814e5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35803 expref: 60 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996338.239914:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e0850c28100) 00010000:00010000:3.0:1789996338.239918:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789996338.240006:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0881226a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+59:11605:x1876946927575680:12345-192.168.204.37@tcp:103:lfs.0 Request processed in 164us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996338.240014:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 16 00000100:00100000:2.0:1789996338.243742:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996338.244111:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927575808 00000100:00100000:0.0:1789996338.244121:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927575808 00000100:00100000:0.0:1789996338.244182:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 212 00000100:00100000:0.0:1789996338.244192:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0881220e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+59:11605:x1876946927575808:12345-192.168.204.37@tcp:58:lfs.0 00010000:00010000:0.0:1789996338.244289:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7800/0x4173739f0fc81594 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996338.244305:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7800/0x4173739f0fc81594 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996338.244317:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7800/0x4173739f0fc81594 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789996338.245390:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:0.0:1789996338.246060:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0881220e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+59:11605:x1876946927575808:12345-192.168.204.37@tcp:58:lfs.0 Request processed in 1863us (2322us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996338.246072:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 212 00000100:00100000:0.0:1789996338.252150:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996338.252452:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927575936 00000100:00100000:2.0:1789996338.252464:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927575936 00000100:00100000:2.0:1789996338.252655:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 213 00000100:00100000:2.0:1789996338.252667:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0881225180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+59:11605:x1876946927575936:12345-192.168.204.37@tcp:101:lfs.0 00010000:00010000:2.0:1789996338.252689:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789996338.252719:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0841524e00/0x4173739f0fc8159b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b97003095e35834 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996338.253109:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7800/0x4173739f0fc81594 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996338.253123:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0841524e00/0x4173739f0fc8159b lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35834 expref: 60 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996338.253143:0:5846:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7800/0x4173739f0fc81594 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996338.253157:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0841524e00/0x4173739f0fc8159b lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35834 expref: 60 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996338.253170:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e0850c28100) 00010000:00010000:2.0:1789996338.253174:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789996338.253178:0:5846:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e0841524e00/0x4173739f0fc8159b lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35834 expref: 60 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996338.253186:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e0841524e00, rc 0) 00000100:00100000:2.0:1789996338.253250:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0881225180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+60:11605:x1876946927575936:12345-192.168.204.37@tcp:101:lfs.0 Request processed in 586us (1113us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996338.253258:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 213 00010000:00010000:1.0:1789996338.536829:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789996338.984902:0:11698:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789996338.984911:0:11698:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789996338.984946:0:11698:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:0.0:1789996338.984954:0:11698:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789996338.985077:0:11698:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0881227480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11698:1876946942240640:192.168.204.37@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789996338.985257:0:11698:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0842e04480 going to sleep for 11 seconds 00000100:00100000:3.0:1789996338.988925:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1789996338.989074:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1789996338.989127:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1789996338.989154:0:8222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927576320 00000100:00100000:3.0:1789996338.989163:0:8222:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927576320 00000100:00100000:3.0:1789996338.989213:0:8222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 82 00000100:00100000:3.0:1789996338.989224:0:8222:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e088119f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+7:2364:x1876946927576320:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:3.0:1789996338.989384:0:8222:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e088119f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+7:2364:x1876946927576320:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 159us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996338.989393:0:8222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 82 00000100:00100000:0.0:1789996338.989684:0:9163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927576192 00000100:00100000:0.0:1789996338.989689:0:9163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927576192 00000100:00100000:0.0:1789996338.989729:0:9163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 142 00000100:00100000:0.0:1789996338.989737:0:9163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e088119d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+61:2364:x1876946927576192:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:0.0:1789996338.989774:0:9163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e088119d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+61:2364:x1876946927576192:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 38us (699us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996338.989782:0:9163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 142 00000100:00100000:1.0:1789996338.990894:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927576064 00000100:00100000:1.0:1789996338.990903:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927576064 00000100:00100000:1.0:1789996338.990952:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 290 00000100:00100000:1.0:1789996338.990960:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852ba2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f78f7903-47ba-48a7-bb82-1f616cb85fc0+13:2364:x1876946927576064:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:1.0:1789996338.991061:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852ba2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f78f7903-47ba-48a7-bb82-1f616cb85fc0+13:2364:x1876946927576064:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 101us (2146us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996338.991068:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 290 00000100:00100000:2.0:1789996338.992498:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996338.992641:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996338.992714:0:11698:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0881227480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11698:1876946942240640:192.168.204.37@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789996338.992880:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1789996338.992955:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927576448 00000100:00100000:1.0:1789996338.992963:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927576448 00000100:00100000:1.0:1789996338.993008:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 83 00000100:00100000:1.0:1789996338.993016:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0881220a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+9:2364:x1876946927576448:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:3.0:1789996338.994046:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927576576 00000100:00100000:3.0:1789996338.994054:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927576576 00000100:00080000:3.0:1789996338.994096:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789996338.994131:0:9163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927576704 00000100:00100000:3.0:1789996338.994135:0:9163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927576704 00000100:00100000:3.0:1789996338.994160:0:9163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 143 00000100:00100000:3.0:1789996338.994169:0:9163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0881222680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cfc759a1-09a6-40ba-80a8-7399de51b555+5:2365:x1876946927576576:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:3.0:1789996338.996399:0:9163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0881222680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cfc759a1-09a6-40ba-80a8-7399de51b555+5:2365:x1876946927576576:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 2221us (3747us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996338.996412:0:9163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 143 00000100:00100000:3.0:1789996338.996457:0:9163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 214 00000100:00100000:3.0:1789996338.996859:0:9163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0881221880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+60:11606:x1876946927576704:12345-192.168.204.37@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789996338.996891:0:9163:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789996338.997001:0:9163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0881221880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+60:11606:x1876946927576704:12345-192.168.204.37@tcp:53:lhsmtool_posix.0 Request processed in 154us (4120us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996338.997008:0:9163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 214 00000100:00100000:1.0:1789996338.997090:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0881220a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+9:2364:x1876946927576448:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 4071us (4595us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996338.997268:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 83 00000100:00100000:2.0:1789996339.001296:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1789996339.001408:0:9163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927576832 00000100:00100000:3.0:1789996339.001430:0:9163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927576832 00000100:00100000:3.0:1789996339.001522:0:9163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 215 00000100:00100000:3.0:1789996339.001534:0:9163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0881220000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+60:11606:x1876946927576832:12345-192.168.204.37@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1789996339.001634:0:9163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856e00/0x4173739f0fc815a2 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789996339.001636:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789996339.001655:0:9163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856e00/0x4173739f0fc815a2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996339.001669:0:9163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856e00/0x4173739f0fc815a2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996339.001685:0:9163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857600/0x4173739f0fc815a9 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996339.001692:0:9163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857600/0x4173739f0fc815a9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996339.001699:0:9163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857600/0x4173739f0fc815a9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996339.001723:0:9163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857800/0x4173739f0fc815b0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996339.001733:0:9163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857800/0x4173739f0fc815b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996339.001740:0:9163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857800/0x4173739f0fc815b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789996339.001982:0:9163:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1789996339.001987:0:9163:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789996339.002001:0:9163:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857800/0x4173739f0fc815b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996339.002012:0:9163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856e00/0x4173739f0fc815a2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996339.002019:0:9163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856e00/0x4173739f0fc815a2 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996339.002027:0:9163:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856e00/0x4173739f0fc815a2 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996339.002034:0:9163:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e087f856e00 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:3.0:1789996339.002039:0:9163:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856e00/0x4173739f0fc815a2 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996339.002046:0:9163:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856e00/0x4173739f0fc815a2 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996339.002059:0:9163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e084601b600) 00010000:00010000:3.0:1789996339.002062:0:9163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789996339.002067:0:9163:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856e00/0x4173739f0fc815a2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996339.002073:0:9163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856e00/0x4173739f0fc815a2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996339.002088:0:9163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857600/0x4173739f0fc815a9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996339.002104:0:9163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857600/0x4173739f0fc815a9 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996339.002110:0:9163:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857600/0x4173739f0fc815a9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996339.002115:0:9163:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e087f857600 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:3.0:1789996339.002118:0:9163:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857600/0x4173739f0fc815a9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996339.002125:0:9163:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857600/0x4173739f0fc815a9 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996339.002134:0:9163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff8e0846583000) 00010000:00010000:3.0:1789996339.002137:0:9163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789996339.002140:0:9163:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857600/0x4173739f0fc815a9 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996339.002146:0:9163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857600/0x4173739f0fc815a9 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996339.002161:0:9163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857800/0x4173739f0fc815b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996339.002168:0:9163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857800/0x4173739f0fc815b0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996339.002174:0:9163:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857800/0x4173739f0fc815b0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996339.002178:0:9163:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e087f857800 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:3.0:1789996339.002189:0:9163:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857800/0x4173739f0fc815b0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996339.002195:0:9163:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857800/0x4173739f0fc815b0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996339.002204:0:9163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e0850c28100) 00010000:00010000:3.0:1789996339.002207:0:9163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789996339.002210:0:9163:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857800/0x4173739f0fc815b0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996339.002216:0:9163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857800/0x4173739f0fc815b0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789996339.002302:0:9163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0881220000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+60:11606:x1876946927576832:12345-192.168.204.37@tcp:34:lhsmtool_posix.0 Request processed in 768us (1013us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996339.002310:0:9163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 215 00000100:00100000:0.0:1789996339.004833:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1789996339.004995:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927577088 00000100:00100000:3.0:1789996339.005005:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927577088 00000100:00100000:3.0:1789996339.005067:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 216 00000100:00100000:3.0:1789996339.005077:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0881225500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+60:11606:x1876946927577088:12345-192.168.204.37@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789996339.005098:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789996339.005120:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857000/0x4173739f0fc815b7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b97003095e3583b expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996339.005217:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857c00/0x4173739f0fc815be lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996339.005231:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857c00/0x4173739f0fc815be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996339.005260:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857c00/0x4173739f0fc815be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789996339.005273:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1789996339.005390:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857c00/0x4173739f0fc815be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996339.005398:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857c00/0x4173739f0fc815be lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996339.005405:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857c00/0x4173739f0fc815be lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996339.005411:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e087f857c00 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:3.0:1789996339.005428:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857c00/0x4173739f0fc815be lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996339.005437:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857c00/0x4173739f0fc815be lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996339.005449:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e0850c28100) 00010000:00010000:3.0:1789996339.005453:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789996339.005457:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857c00/0x4173739f0fc815be lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996339.005474:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857c00/0x4173739f0fc815be lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996339.005517:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857000/0x4173739f0fc815b7 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e3583b expref: 62 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996339.005571:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e084601b600) 00010000:00010000:3.0:1789996339.005574:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789996339.005580:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857000/0x4173739f0fc815b7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e3583b expref: 62 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996339.005591:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e087f857000, rc 0) 00000100:00100000:3.0:1789996339.005648:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0881225500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+61:11606:x1876946927577088:12345-192.168.204.37@tcp:101:lhsmtool_posix.0 Request processed in 572us (825us total) trans 4294967504 rc 301/301 00000100:00100000:3.0:1789996339.005656:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 216 00000100:00100000:0.0:1789996339.007744:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1789996339.007833:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927577216 00000100:00100000:1.0:1789996339.007844:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927577216 00000100:00100000:1.0:1789996339.007900:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 217 00000100:00100000:1.0:1789996339.007910:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0881226d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+61:11606:x1876946927577216:12345-192.168.204.37@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789996339.007956:0:5848:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789996339.008912:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0881226d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+61:11606:x1876946927577216:12345-192.168.204.37@tcp:53:lhsmtool_posix.0 Request processed in 999us (1172us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996339.008925:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 217 00000100:00100000:0.0:1789996339.012692:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1789996339.012902:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927577472 00000100:00100000:3.0:1789996339.012913:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927577472 00000100:00100000:3.0:1789996339.013049:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 218 00000100:00100000:3.0:1789996339.013060:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0881225f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+61:11606:x1876946927577472:12345-192.168.204.37@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789996339.013080:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789996339.013084:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789996339.013112:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7600/0x4173739f0fc8155c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e3581f expref: 61 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996339.013134:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e084601b500) 00010000:00010000:3.0:1789996339.013139:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789996339.013156:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857c00/0x4173739f0fc815cc lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b97003095e35842 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789996339.013623:0:5847:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6:0x0], index 1: 0 00010000:00010000:3.0:1789996339.013831:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857800/0x4173739f0fc815d3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996339.013858:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857800/0x4173739f0fc815d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996339.013869:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857800/0x4173739f0fc815d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996339.013925:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857c00/0x4173739f0fc815cc lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35842 expref: 63 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996339.013941:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857800/0x4173739f0fc815d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35842 expref: 62 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996339.013949:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8e0846583000) 00010000:00010000:3.0:1789996339.013952:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789996339.013955:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e087f857800, rc 0) 00000100:00100000:3.0:1789996339.014015:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0881225f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+62:11606:x1876946927577472:12345-192.168.204.37@tcp:101:lhsmtool_posix.0 Request processed in 956us (1333us total) trans 4294967505 rc 0/0 00000100:00100000:3.0:1789996339.014023:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 218 00000100:00100000:0.0:1789996339.017305:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1789996339.017387:0:9163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927577728 00000100:00100000:3.0:1789996339.017397:0:9163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927577728 00000100:00100000:3.0:1789996339.017477:0:9163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 219 00000100:00100000:3.0:1789996339.017487:0:9163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0881224700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+62:11606:x1876946927577728:12345-192.168.204.37@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789996339.017569:0:9163:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789996339.017596:0:9163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857800/0x4173739f0fc815d3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35842 expref: 62 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996339.017615:0:9163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8e0846583000) 00010000:00010000:3.0:1789996339.017639:0:9163:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789996339.017661:0:9163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857600/0x4173739f0fc815e1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996339.017675:0:9163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857600/0x4173739f0fc815e1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996339.017685:0:9163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857600/0x4173739f0fc815e1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996339.017699:0:9163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856e00/0x4173739f0fc815e8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xe8515855 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996339.017705:0:9163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856e00/0x4173739f0fc815e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xe8515855 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996339.017712:0:9163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856e00/0x4173739f0fc815e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xe8515855 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996339.017776:0:9163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857600/0x4173739f0fc815e1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996339.017946:0:9163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857600/0x4173739f0fc815e1 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996339.017952:0:9163:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857600/0x4173739f0fc815e1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996339.017959:0:9163:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e087f857600 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:3.0:1789996339.017964:0:9163:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857600/0x4173739f0fc815e1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996339.017972:0:9163:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857600/0x4173739f0fc815e1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996339.017989:0:9163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e084601b500) 00010000:00010000:3.0:1789996339.017992:0:9163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789996339.017996:0:9163:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857600/0x4173739f0fc815e1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996339.018002:0:9163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857600/0x4173739f0fc815e1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996339.018013:0:9163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856e00/0x4173739f0fc815e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xe8515855 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996339.018020:0:9163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856e00/0x4173739f0fc815e8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xe8515855 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996339.018025:0:9163:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856e00/0x4173739f0fc815e8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xe8515855 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996339.018030:0:9163:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e087f856e00 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:3.0:1789996339.018033:0:9163:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856e00/0x4173739f0fc815e8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xe8515855 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996339.018039:0:9163:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856e00/0x4173739f0fc815e8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xe8515855 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996339.018047:0:9163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xe8515855 (ffff8e0846583a00) 00010000:00010000:3.0:1789996339.018049:0:9163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789996339.018052:0:9163:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856e00/0x4173739f0fc815e8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xe8515855 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996339.018057:0:9163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856e00/0x4173739f0fc815e8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xe8515855 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789996339.018193:0:9163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0881224700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+61:11606:x1876946927577728:12345-192.168.204.37@tcp:36:lhsmtool_posix.0 Request processed in 706us (896us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789996339.018201:0:9163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 219 00000100:00100000:0.0:1789996339.021400:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996339.021525:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927577856 00000100:00100000:2.0:1789996339.021536:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927577856 00000100:00100000:2.0:1789996339.021620:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 220 00000100:00100000:2.0:1789996339.021631:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0881227800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+61:11606:x1876946927577856:12345-192.168.204.37@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789996339.021651:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789996339.021674:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e08429c7200/0x4173739f0fc815ef lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b97003095e35849 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996339.021709:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e08429c6600/0x4173739f0fc815f6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996339.021722:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e08429c6600/0x4173739f0fc815f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996339.021733:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e08429c6600/0x4173739f0fc815f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996339.022146:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e08429c7200/0x4173739f0fc815ef lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35849 expref: 63 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996339.022164:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e08429c6600/0x4173739f0fc815f6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35849 expref: 62 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996339.022174:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8e084601ba00) 00010000:00010000:2.0:1789996339.022176:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789996339.022181:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e08429c6600, rc 0) 00000100:00100000:2.0:1789996339.022282:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0881227800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+62:11606:x1876946927577856:12345-192.168.204.37@tcp:101:lhsmtool_posix.0 Request processed in 653us (888us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996339.022290:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 220 00000100:00100000:0.0:1789996339.024985:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1789996339.025165:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927578112 00000100:00100000:1.0:1789996339.025176:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927578112 00000100:00100000:1.0:1789996339.025275:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 221 00000100:00100000:1.0:1789996339.025287:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0881224e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+62:11606:x1876946927578112:12345-192.168.204.37@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789996339.025379:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22a00/0x4173739f0fc815fd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996339.025396:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22a00/0x4173739f0fc815fd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996339.025407:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22a00/0x4173739f0fc815fd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789996339.025884:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00080000:1.0:1789996339.025894:0:5848:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 380745350845ns, next at 381745348861ns, rc = 0 00000004:00010000:1.0:1789996339.025980:0:5848:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000405c0473 reply state 0000000057eb493a transno 4294967506 ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22a00/0x4173739f0fc815fd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789996339.025990:0:5848:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789996339.026097:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0881224e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+64:11606:x1876946927578112:12345-192.168.204.37@tcp:36:lhsmtool_posix.0 Request processed in 811us (1120us total) trans 4294967506 rc 0/0 00000100:00100000:1.0:1789996339.026105:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 221 00000100:00100000:0.0:1789996339.031506:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1789996339.031839:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927578240 00000100:00100000:3.0:1789996339.031850:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927578240 00000100:00100000:3.0:1789996339.031916:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 222 00000100:00100000:3.0:1789996339.031927:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0881224a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+64:11606:x1876946927578240:12345-192.168.204.37@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789996339.031952:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789996339.031975:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856e00/0x4173739f0fc81604 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b97003095e35850 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996339.032036:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856e00/0x4173739f0fc81604 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35850 expref: 65 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996339.032052:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856e00/0x4173739f0fc81604 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35850 expref: 65 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996339.032072:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8e084601ba00) 00010000:00010000:3.0:1789996339.032085:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789996339.032090:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e087f856e00, rc 0) 00000100:00100000:3.0:1789996339.032150:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0881224a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+65:11606:x1876946927578240:12345-192.168.204.37@tcp:101:lhsmtool_posix.0 Request processed in 224us (654us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996339.032158:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 222 00010000:00010000:1.0:1789996339.032169:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22a00/0x4173739f0fc815fd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996339.032208:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22a00/0x4173739f0fc815fd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996339.032217:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22a00/0x4173739f0fc815fd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996339.032224:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0876a22a00 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:1.0:1789996339.032229:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22a00/0x4173739f0fc815fd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996339.032238:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22a00/0x4173739f0fc815fd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996339.032252:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8e084601ba00) 00010000:00010000:1.0:1789996339.032255:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789996339.032259:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22a00/0x4173739f0fc815fd lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996339.032265:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22a00/0x4173739f0fc815fd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789996339.035763:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996339.036009:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927578368 00000100:00100000:2.0:1789996339.036019:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927578368 00000100:00100000:2.0:1789996339.036099:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 62 00000100:00100000:2.0:1789996339.036109:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0881226680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+9:2363:x1876946927578368:12345-192.168.204.37@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1789996339.036441:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0881226680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+10:2363:x1876946927578368:12345-192.168.204.37@tcp:2:lhsmtool_posix.0 Request processed in 331us (687us total) trans 4294967319 rc 0/0 00000100:00100000:2.0:1789996339.036449:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 62 00000100:00080000:0.0:1789996339.036523:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789996339.038491:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1789996339.038570:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927578624 00000100:00100000:3.0:1789996339.038580:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927578624 00000100:00100000:3.0:1789996339.038636:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 60 00000100:00100000:3.0:1789996339.038660:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0881225880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+64:11606:x1876946927578624:12345-192.168.204.37@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789996339.038887:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0881225880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+65:11606:x1876946927578624:12345-192.168.204.37@tcp:35:lhsmtool_posix.0 Request processed in 228us (404us total) trans 4294967507 rc 0/0 00000100:00100000:3.0:1789996339.038895:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 60 00000100:00100000:2.0:1789996339.046954:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1789996339.047167:0:9163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927578880 00000100:00100000:3.0:1789996339.047179:0:9163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927578880 00000100:00100000:3.0:1789996339.047252:0:9163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 223 00000100:00100000:3.0:1789996339.047264:0:9163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0881222300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+65:11606:x1876946927578880:12345-192.168.204.37@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789996339.047399:0:9163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0881222300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+65:11606:x1876946927578880:12345-192.168.204.37@tcp:57:lhsmtool_posix.0 Request processed in 137us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996339.047408:0:9163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 223 00000100:00100000:0.0:1789996339.050641:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996339.052201:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927579008 00000100:00100000:2.0:1789996339.052217:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927579008 00000100:00100000:2.0:1789996339.052305:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 224 00000100:00100000:2.0:1789996339.052316:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0881224000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+65:11606:x1876946927579008:12345-192.168.204.37@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789996339.052340:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789996339.052362:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e08429c7200/0x4173739f0fc8160b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b97003095e35857 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996339.052443:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e08429c6000/0x4173739f0fc81612 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996339.052458:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e08429c6000/0x4173739f0fc81612 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996339.052470:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e08429c6000/0x4173739f0fc81612 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789996339.052505:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789996339.052523:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e08429c6000/0x4173739f0fc81612 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996339.052584:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e08429c7200/0x4173739f0fc8160b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35857 expref: 67 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996339.052605:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e08429c6000/0x4173739f0fc81612 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35857 expref: 66 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996339.052613:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8e084601ba00) 00010000:00010000:2.0:1789996339.052616:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789996339.052620:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e08429c6000, rc 0) 00000100:00100000:2.0:1789996339.052680:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0881224000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+66:11606:x1876946927579008:12345-192.168.204.37@tcp:101:lhsmtool_posix.0 Request processed in 365us (2147us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996339.052687:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 224 00000100:00100000:0.0:1789996339.055339:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1789996339.055446:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927579136 00000100:00100000:3.0:1789996339.055457:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927579136 00000100:00100000:3.0:1789996339.055524:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 63 00000100:00100000:3.0:1789996339.055535:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0881226300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+10:2365:x1876946927579136:12345-192.168.204.37@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789996339.055592:0:6688:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789996339.055619:0:6688:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bc277d92/0x4173739f0fc81619 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1b97003095e3585e expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789996339.055730:0:6688:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6ab12d33, blocks: 0x1 00010000:00010000:3.0:1789996339.055753:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=380s v=(0 0) 00010000:00010000:3.0:1789996339.055759:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789996339.055769:0:6688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bc277d92/0x4173739f0fc81619 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e3585e expref: 11 pid: 6688 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996339.055813:0:6688:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000bc277d92/0x4173739f0fc81619 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e3585e expref: 11 pid: 6688 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996339.055841:0:6688:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e087f857600, rc 0) 00000100:00100000:0.0:1789996339.056053:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0881226300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+11:2365:x1876946927579136:12345-192.168.204.37@tcp:101:lhsmtool_posix.0 Request processed in 517us (720us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996339.056068:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 63 00000100:00100000:0.0:1789996339.062663:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1789996339.062708:0:9163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927579392 00000100:00100000:3.0:1789996339.062719:0:9163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927579392 00000100:00100000:3.0:1789996339.062776:0:9163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 225 00000100:00100000:3.0:1789996339.062786:0:9163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0881225c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+66:11606:x1876946927579392:12345-192.168.204.37@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789996339.062893:0:9163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0881225c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+66:11606:x1876946927579392:12345-192.168.204.37@tcp:57:lhsmtool_posix.0 Request processed in 109us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996339.062901:0:9163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 225 00000100:00100000:3.0:1789996339.064929:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996339.065146:0:8222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927579520 00000100:00100000:0.0:1789996339.065156:0:8222:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927579520 00000100:00100000:0.0:1789996339.065220:0:8222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 64 00000100:00100000:0.0:1789996339.065231:0:8222:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e088119c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+11:11606:x1876946927579520:12345-192.168.204.37@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789996339.065248:0:8222:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789996339.065266:0:8222:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000018022673/0x4173739f0fc81620 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1b97003095e35865 expref: -99 pid: 8222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996339.065298:0:8222:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000bc277d92/0x4173739f0fc81619 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e3585e expref: 12 pid: 6688 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996339.065308:0:8222:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789996339.065313:0:8222:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789996339.065319:0:8222:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000018022673/0x4173739f0fc81620 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35865 expref: 12 pid: 8222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996339.065357:0:8222:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000bc277d92/0x4173739f0fc81619 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e3585e expref: 12 pid: 6688 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996339.065385:0:8222:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000bc277d92/0x4173739f0fc81619 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e3585e expref: 12 pid: 6688 timeout: 480 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789996339.065400:0:8222:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0881227480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8222:1876946942240768:192.168.204.37@tcp:104: 00000100:00100000:0.0:1789996339.065525:0:8222:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0842e04180 going to sleep for 11 seconds 00000100:00100000:0.0:1789996339.068525:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1789996339.068842:0:8222:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0881227480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8222:1876946942240768:192.168.204.37@tcp:104: 00000100:00100000:2.0:1789996339.069024:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927579648 00000100:00100000:2.0:1789996339.069034:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927579648 00010000:00010000:2.0:1789996339.069073:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000bc277d92/0x4173739f0fc81619 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e3585e expref: 13 pid: 6688 timeout: 480 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789996339.069111:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 82 00000100:00100000:2.0:1789996339.069122:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0881227100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+13:2363:x1876946927579648:12345-192.168.204.37@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789996339.069136:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789996339.069160:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000bc277d92/0x4173739f0fc81619 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e3585e expref: 13 pid: 6688 timeout: 480 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996339.069165:0:8222:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000018022673/0x4173739f0fc81620 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 5 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35865 expref: 13 pid: 8222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996339.069181:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000bc277d92/0x4173739f0fc81619 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e3585e expref: 13 pid: 6688 timeout: 480 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996339.069516:0:8222:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e086fcb6a00, rc 0) 00000100:00100000:3.0:1789996339.069623:0:8222:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e088119c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+13:11606:x1876946927579520:12345-192.168.204.37@tcp:101:lhsmtool_posix.0 Request processed in 4393us (4709us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996339.069631:0:8222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 64 00010000:00010000:2.0:1789996339.072060:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bc277d92/0x4173739f0fc81619 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e3585e expref: 12 pid: 6688 timeout: 480 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996339.072086:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789996339.072091:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789996339.072100:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000018022673/0x4173739f0fc81620 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35865 expref: 11 pid: 8222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996339.072111:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000018022673/0x4173739f0fc81620 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35865 expref: 11 pid: 8222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996339.072164:0:5833:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000018022673/0x4173739f0fc81620 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35865 expref: 11 pid: 8222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789996339.072180:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0881221c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5833:1876946942240896:192.168.204.37@tcp:105: 00000100:00100000:2.0:1789996339.072331:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0847550000 going to sleep for 11 seconds 00000100:00100000:2.0:1789996339.075930:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0881221c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5833:1876946942240896:192.168.204.37@tcp:105: 00010000:00010000:2.0:1789996339.075959:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789996339.076016:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0881227100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+11:2363:x1876946927579648:12345-192.168.204.37@tcp:103:ldlm_bl.0 Request processed in 6894us (7500us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996339.076028:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 82 00000100:00100000:1.0:1789996339.077167:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996339.077232:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927579776 00000100:00100000:0.0:1789996339.077240:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927579776 00002000:00100000:0.0:1789996339.077284:0:6694:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff8e086fc9b800 x1876946927579776/t0(0) o4->189efa8a-c7eb-4b69-9afa-1dd36d6775f1@192.168.204.37@tcp:70/0 lens 504/0 e 0 to 0 dl 1789996350 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789996339.077296:0:6694:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8e086fc9b800 with x1876946927579776 ext(0->12) 00002000:00010000:0.0:1789996339.077300:0:6694:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8e086fc9b800 00000100:00100000:0.0:1789996339.077330:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 6 00000100:00100000:0.0:1789996339.077340:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fc9b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+11:2362:x1876946927579776:12345-192.168.204.37@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1789996339.078005:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fc9b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+13:2362:x1876946927579776:12345-192.168.204.37@tcp:4:lhsmtool_posix.0 Request processed in 665us (843us total) trans 4294967320 rc 0/0 00000100:00100000:0.0:1789996339.078013:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 6 00002000:00100000:0.0:1789996339.078020:0:6694:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff8e086fc9b800 x1876946927579776/t4294967320(0) o4->189efa8a-c7eb-4b69-9afa-1dd36d6775f1@192.168.204.37@tcp:70/0 lens 504/448 e 0 to 0 dl 1789996350 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789996339.078029:0:6694:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8e086fc9b800 with x1876946927579776 ext(0->12) 00002000:00010000:0.0:1789996339.078033:0:6694:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8e086fc9b800 00000100:00100000:3.0:1789996339.082944:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1789996339.083105:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927579904 00000100:00100000:1.0:1789996339.083116:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927579904 00000100:00100000:1.0:1789996339.083180:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 226 00000100:00100000:1.0:1789996339.083191:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e088119dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+66:11606:x1876946927579904:12345-192.168.204.37@tcp:44:lhsmtool_posix.0 00000100:00100000:1.0:1789996339.119057:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e088119dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+66:11606:x1876946927579904:12345-192.168.204.37@tcp:44:lhsmtool_posix.0 Request processed in 35857us (36112us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996339.119071:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 226 00000001:00080000:2.0:1789996339.119518:0:5868:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967501 is committed 00000001:00080000:2.0:1789996339.119559:0:5868:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000004:00080000:2.0:1789996339.119564:0:5868:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 9 committed 00000020:00080000:2.0:1789996339.119603:0:5868:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8e08494c93c0 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:2.0:1789996339.119607:0:5868:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8e084754f600 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8e08494c9d80 00000020:00080000:2.0:1789996339.119610:0:5868:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8e084754f200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8e0876ad7400 00000020:00080000:2.0:1789996339.119661:0:5868:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8e0848e420c0 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:2.0:1789996339.119665:0:5868:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8e0846f8b200 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8e0848e42480 00000020:00080000:2.0:1789996339.119668:0:5868:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8e0846f8bf00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8e0877ab3400 00000001:00080000:2.0:1789996339.119675:0:5868:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967507 is committed 00000004:00080000:2.0:1789996339.119686:0:5868:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000004:00080000:2.0:1789996339.119702:0:5868:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000020:00080000:2.0:1789996339.119720:0:5868:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000100:00100000:2.0:1789996339.119842:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0881221c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876946942241024:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1789996339.119892:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996339.119945:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942241024 00000100:00100000:2.0:1789996339.119953:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942241024 00000100:00100000:2.0:1789996339.120001:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789996339.120010:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0881223100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3315:x1876946942241024:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1789996339.120033:0:6690:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00002000:00010000:2.0:1789996339.120064:0:6690:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6ab12d32, atime: 0x6ab12d32, ctime: 0x6ab12d32, blocks: 0x1 00010000:00010000:2.0:1789996339.120072:0:6690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004df7f958/0x4173739f0fc81627 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996339.120088:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=380s v=(0 0) 00010000:00010000:2.0:1789996339.120092:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789996339.120099:0:6690:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004df7f958/0x4173739f0fc81627 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996339.120126:0:6690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004df7f958/0x4173739f0fc81627 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996339.120137:0:6690:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004df7f958/0x4173739f0fc81627 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996339.120146:0:6690:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004df7f958/0x4173739f0fc81627 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996339.120162:0:6690:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000020:00080000:1.0:1789996339.120586:0:5879:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:1.0:1789996339.120729:0:5879:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:2.0:1789996339.121148:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0881223100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3315:x1876946942241024:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1137us (1253us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1789996339.121157:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:2.0:1789996339.121184:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789996339.121197:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789996339.121205:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004df7f958/0x4173739f0fc81627 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996339.121216:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e08429c6a00 already unused, calling callback (ffffffffc1595910) 00010000:00010000:2.0:1789996339.121221:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004df7f958/0x4173739f0fc81627 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996339.121231:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004df7f958/0x4173739f0fc81627 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996339.121262:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004df7f958/0x4173739f0fc81627 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996339.121269:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004df7f958/0x4173739f0fc81627 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996339.121292:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789996339.121294:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789996339.121296:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789996339.121310:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0881224380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876946942241152:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1789996339.121344:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996339.121387:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942241152 00000100:00100000:2.0:1789996339.121395:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942241152 00000100:00100000:2.0:1789996339.121446:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789996339.121454:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0881223b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3316:x1876946942241152:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1789996339.121480:0:6689:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00010000:00010000:2.0:1789996339.121499:0:6689:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d3f2e53c/0x4173739f0fc8162e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996339.121515:0:6689:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000284a25be/0x4173739f0fc813e9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e357c4 expref: 12 pid: 8222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996339.121524:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1789996339.121529:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789996339.121534:0:6689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d3f2e53c/0x4173739f0fc8162e lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996339.121588:0:6689:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000284a25be/0x4173739f0fc813e9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.204.37@tcp remote: 0x1b97003095e357c4 expref: 12 pid: 8222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996339.121603:0:6689:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000284a25be/0x4173739f0fc813e9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.204.37@tcp remote: 0x1b97003095e357c4 expref: 12 pid: 8222 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789996339.121615:0:6689:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0881220380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6689:1876946942241280:192.168.204.37@tcp:104: 00000100:00100000:2.0:1789996339.121669:0:6689:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0847550e40 going to sleep for 11 seconds 00000100:00080000:2.0:1789996339.121680:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789996339.122041:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789996339.122051:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0881227480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876946942241408:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1789996339.122083:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996339.123530:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942241408 00000100:00100000:2.0:1789996339.123555:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942241408 00000100:00100000:2.0:1789996339.123601:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789996339.123610:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e08810ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3314:x1876946942241408:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1789996339.123773:0:6690:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1789996339.123777:0:6690:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1789996339 00002000:00010000:2.0:1789996339.123779:0:6690:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1789996339.123781:0:6690:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1789996339 -> 1789996339 00002000:00010000:2.0:1789996339.123783:0:6690:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1789996339.123837:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e08810ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3314:x1876946942241408:12345-0@lo:2:osp-syn-1-0.0 Request processed in 228us (1752us total) trans 4294967321 rc 0/0 00000100:00100000:2.0:1789996339.123844:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000004:00080000:2.0:1789996339.123896:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e0881227480/2, rc 0, transno 4294967321 00000100:00100000:2.0:1789996339.123903:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0881227480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876946942241408:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1789996339.124289:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e0881221c00/2, rc 0, transno 4294967310 00000100:00100000:1.0:1789996339.124295:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0881221c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876946942241024:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1789996339.124957:0:6689:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0881220380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6689:1876946942241280:192.168.204.37@tcp:104: 00010000:00010000:2.0:1789996339.124991:0:6689:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d3f2e53c/0x4173739f0fc8162e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789996339.127393:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1789996339.127714:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927580032 00000100:00100000:3.0:1789996339.127724:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927580032 00010000:00010000:3.0:1789996339.127761:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000284a25be/0x4173739f0fc813e9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.37@tcp remote: 0x1b97003095e357c4 expref: 13 pid: 8222 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789996339.127810:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 83 00000100:00100000:3.0:1789996339.127819:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086faeed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+13:2363:x1876946927580032:12345-192.168.204.37@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789996339.127833:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789996339.127838:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000284a25be/0x4173739f0fc813e9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.37@tcp remote: 0x1b97003095e357c4 expref: 13 pid: 8222 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996339.127852:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000284a25be/0x4173739f0fc813e9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.204.37@tcp remote: 0x1b97003095e357c4 expref: 13 pid: 8222 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996339.127876:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000284a25be/0x4173739f0fc813e9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.204.37@tcp remote: 0x1b97003095e357c4 expref: 13 pid: 8222 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996339.127893:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789996339.127898:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789996339.127904:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d3f2e53c/0x4173739f0fc8162e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996339.127914:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d3f2e53c/0x4173739f0fc8162e lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996339.127942:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789996339.128000:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086faeed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+12:2363:x1876946927580032:12345-192.168.204.37@tcp:103:ldlm_bl.0 Request processed in 179us (616us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996339.128007:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 83 00010000:00010000:2.0:1789996339.128245:0:6689:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d3f2e53c/0x4173739f0fc8162e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996339.128257:0:6689:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d3f2e53c/0x4173739f0fc8162e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996339.128267:0:6689:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d3f2e53c/0x4173739f0fc8162e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996339.128275:0:6689:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d3f2e53c/0x4173739f0fc8162e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996339.128298:0:6689:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789996339.128863:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0881223b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3316:x1876946942241152:12345-0@lo:6:osp-syn-1-0.0 Request processed in 7406us (7515us total) trans 4294967322 rc 0/0 00000100:00100000:2.0:1789996339.128871:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00010000:00010000:0.0:1789996339.129131:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789996339.129150:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d3f2e53c/0x4173739f0fc8162e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996339.129170:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e08429c7c00 already unused, calling callback (ffffffffc1595910) 00010000:00010000:0.0:1789996339.129174:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d3f2e53c/0x4173739f0fc8162e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996339.129182:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d3f2e53c/0x4173739f0fc8162e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996339.129198:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d3f2e53c/0x4173739f0fc8162e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996339.129206:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d3f2e53c/0x4173739f0fc8162e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996339.129225:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789996339.129227:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789996339.129228:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1789996339.129571:0:3316:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e0881224380/2, rc 0, transno 4294967322 00000100:00100000:3.0:1789996339.129581:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0881224380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876946942241152:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1789996339.130341:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996339.130408:0:8222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927580160 00000100:00100000:2.0:1789996339.130756:0:8222:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927580160 00000100:00100000:2.0:1789996339.130847:0:8222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 68 00000100:00100000:2.0:1789996339.130869:0:8222:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e088119df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+12:2365:x1876946927580160:12345-192.168.204.37@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1789996339.176909:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0881220a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e0c28cd8-555e-481f-bd03-c3b02aee51c5:3314:1876946942241536:0@lo:400:kworker.0 00000100:00100000:2.0:1789996339.176982:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996339.177030:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789996339.177046:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0881220380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3314:1876946942241920:0@lo:400:kworker.0 00000100:00100000:2.0:1789996339.177087:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996339.177120:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0881223100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876946942241664:0@lo:400:kworker.0 00000100:00100000:2.0:1789996339.177144:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996339.177162:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789996339.177168:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0881223b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1876946942241792:0@lo:400:kworker.0 00000100:00100000:2.0:1789996339.177187:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996339.177214:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942241536 00000100:00100000:2.0:1789996339.177221:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942241536 00000100:00100000:2.0:1789996339.177260:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:2.0:1789996339.177268:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852ba3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0c28cd8-555e-481f-bd03-c3b02aee51c5+19:3314:x1876946942241536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789996339.177316:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852ba3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e0c28cd8-555e-481f-bd03-c3b02aee51c5+19:3314:x1876946942241536:12345-0@lo:400:kworker.0 Request processed in 48us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996339.177323:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:2.0:1789996339.177358:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942241920 00000100:00100000:2.0:1789996339.177361:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942241920 00000100:00100000:2.0:1789996339.177395:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942241664 00000100:00100000:2.0:1789996339.177398:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942241664 00000100:00100000:2.0:1789996339.177424:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942241792 00000100:00100000:2.0:1789996339.177427:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942241792 00000100:00100000:2.0:1789996339.177444:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1789996339.177450:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0881222a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876946942241920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789996339.177488:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0881222a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876946942241920:12345-0@lo:400:kworker.0 Request processed in 38us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996339.177494:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1789996339.177506:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1789996339.177512:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0881220700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876946942241664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789996339.177575:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0881220700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876946942241664:12345-0@lo:400:kworker.0 Request processed in 63us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996339.177582:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1789996339.177595:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1789996339.177602:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0881221180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876946942241792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789996339.177628:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0881221180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876946942241792:12345-0@lo:400:kworker.0 Request processed in 27us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996339.177634:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00080000:2.0:1789996339.177658:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789996339.177690:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0881223b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1876946942241792:0@lo:400:kworker.0 00000100:00100000:2.0:1789996339.177701:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0881223100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876946942241664:0@lo:400:kworker.0 00000100:00100000:2.0:1789996339.177732:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0881220380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3314:1876946942241920:0@lo:400:kworker.0 00000100:00100000:2.0:1789996339.177740:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0881220a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e0c28cd8-555e-481f-bd03-c3b02aee51c5:3314:1876946942241536:0@lo:400:kworker.0 00000100:00100000:2.0:1789996339.184867:0:8222:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e088119df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+12:2365:x1876946927580160:12345-192.168.204.37@tcp:16:lhsmtool_posix.0 Request processed in 54000us (54519us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996339.184881:0:8222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 68 00000001:00080000:2.0:1789996339.184920:0:7659:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967320 is committed 00000001:00080000:2.0:1789996339.184935:0:7659:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967317 is committed 00000001:00080000:2.0:1789996339.184942:0:7659:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967322 is committed 00000100:00100000:2.0:1789996339.195849:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1789996339.196207:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927580416 00000100:00100000:1.0:1789996339.196218:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927580416 00000100:00100000:1.0:1789996339.196321:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 227 00000100:00100000:1.0:1789996339.196333:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0881220a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+20:11606:x1876946927580416:12345-192.168.204.37@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789996339.196385:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789996339.196422:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e08429c6000/0x4173739f0fc81612 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35857 expref: 20 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996339.196446:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8e084601ba00) 00010000:00010000:1.0:1789996339.196452:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789996339.196491:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22800/0x4173739f0fc81635 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996339.196506:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22800/0x4173739f0fc81635 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996339.196516:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22800/0x4173739f0fc81635 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789996339.196812:0:5848:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006a06d7a1 reply state 00000000bbb56220 transno 4294967508 ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22800/0x4173739f0fc81635 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789996339.196821:0:5848:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789996339.196926:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0881220a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+21:11606:x1876946927580416:12345-192.168.204.37@tcp:36:lhsmtool_posix.0 Request processed in 594us (1086us total) trans 4294967508 rc 0/0 00000100:00100000:1.0:1789996339.196952:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 227 00000100:00100000:2.0:1789996339.200759:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00010000:00010000:0.0:1789996339.200851:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22800/0x4173739f0fc81635 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996339.200863:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22800/0x4173739f0fc81635 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996339.200870:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22800/0x4173739f0fc81635 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996339.200876:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0876a22800 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:0.0:1789996339.200881:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22800/0x4173739f0fc81635 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996339.200902:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22800/0x4173739f0fc81635 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996339.200918:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8e084601ba00) 00010000:00010000:0.0:1789996339.200921:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789996339.200926:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22800/0x4173739f0fc81635 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996339.200932:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22800/0x4173739f0fc81635 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789996339.201313:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927580544 00000100:00100000:3.0:1789996339.201323:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927580544 00000100:00100000:3.0:1789996339.201377:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 69 00000100:00100000:3.0:1789996339.201387:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0881220380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+7:2363:x1876946927580544:12345-192.168.204.37@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1789996339.201674:0:6688:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1789996339.201679:0:6688:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1789996339 -> 1789996338 00002000:00010000:3.0:1789996339.201681:0:6688:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 1789996338 00002000:00010000:3.0:1789996339.201683:0:6688:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1789996339 -> 1789996338 00002000:00010000:3.0:1789996339.201686:0:6688:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1789996339.201751:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0881220380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+8:2363:x1876946927580544:12345-192.168.204.37@tcp:2:lhsmtool_posix.0 Request processed in 364us (1001us total) trans 4294967323 rc 0/0 00000100:00100000:3.0:1789996339.201758:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 69 00000100:00100000:0.0:1789996339.205886:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996339.205947:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927580800 00000100:00100000:2.0:1789996339.205956:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927580800 00000100:00100000:2.0:1789996339.206011:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 228 00000100:00100000:2.0:1789996339.206021:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086faedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+20:11606:x1876946927580800:12345-192.168.204.37@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1789996339.206096:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e08429c6e00/0x4173739f0fc8163c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996339.206112:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e08429c6600/0x4173739f0fc815f6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35849 expref: 20 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996339.206121:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e08429c6e00/0x4173739f0fc8163c lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996339.206152:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e08429c6600/0x4173739f0fc815f6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35849 expref: 20 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996339.206165:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e08429c6600/0x4173739f0fc815f6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35849 expref: 20 pid: 5846 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789996339.206178:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0881223100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5847:1876946942242048:192.168.204.37@tcp:104: 00000100:00100000:2.0:1789996339.206257:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0847550540 going to sleep for 11 seconds 00000100:00100000:0.0:1789996339.217037:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1789996339.217497:0:8520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927580928 00000100:00100000:3.0:1789996339.217508:0:8520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927580928 00010000:00010000:3.0:1789996339.217593:0:8520:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e08429c6600/0x4173739f0fc815f6 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35849 expref: 21 pid: 5846 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789996339.217631:0:8520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 84 00000100:00100000:3.0:1789996339.217642:0:8520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086faec700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+21:2362:x1876946927580928:12345-192.168.204.37@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789996339.217656:0:8520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789996339.217663:0:8520:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e08429c6600/0x4173739f0fc815f6 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35849 expref: 21 pid: 5846 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996339.217697:0:8520:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e08429c6600/0x4173739f0fc815f6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35849 expref: 21 pid: 5846 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996339.217721:0:8520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8e084601ba00) 00010000:00010000:3.0:1789996339.217727:0:8520:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e08429c6e00/0x4173739f0fc8163c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996339.217736:0:8520:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e08429c6e00/0x4173739f0fc8163c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996339.217745:0:8520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e08429c6e00/0x4173739f0fc8163c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996339.217767:0:8520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789996339.217830:0:8520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086faec700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+21:2362:x1876946927580928:12345-192.168.204.37@tcp:103:ldlm_bl.0 Request processed in 190us (805us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996339.217838:0:8520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 84 00010000:00010000:2.0:1789996339.220793:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e08429c6600/0x4173739f0fc815f6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35849 expref: 20 pid: 5846 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789996339.220825:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0881223100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5847:1876946942242048:192.168.204.37@tcp:104: 00010000:00010000:2.0:1789996339.220855:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e08429c6e00/0x4173739f0fc8163c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996339.220867:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e08429c6e00/0x4173739f0fc8163c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996339.220874:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e08429c6e00/0x4173739f0fc8163c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996339.220934:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e08429c6e00/0x4173739f0fc8163c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996339.220942:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e08429c6e00/0x4173739f0fc8163c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996339.220951:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e08429c6e00/0x4173739f0fc8163c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996339.220958:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e08429c6e00 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:2.0:1789996339.220964:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e08429c6e00/0x4173739f0fc8163c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996339.220972:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e08429c6e00/0x4173739f0fc8163c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996339.220989:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8e084601ba00) 00010000:00010000:2.0:1789996339.220992:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1789996339.220997:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e08429c6e00/0x4173739f0fc8163c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996339.221004:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e08429c6e00/0x4173739f0fc8163c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789996339.221444:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086faedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+19:11606:x1876946927580800:12345-192.168.204.37@tcp:55:lhsmtool_posix.0 Request processed in 15422us (15566us total) trans 0 rc -22/-22 00000100:00100000:2.0:1789996339.221465:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 228 00000100:00100000:0.0:1789996339.236110:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996339.239754:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927581056 00000100:00100000:2.0:1789996339.239771:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927581056 00000100:00100000:2.0:1789996339.239853:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 70 00000100:00100000:2.0:1789996339.239882:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086faef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+8:2363:x1876946927581056:12345-192.168.204.37@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1789996339.239931:0:6690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000004df7f958/0x4173739f0fc81643 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996339.239952:0:6690:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000018022673/0x4173739f0fc81620 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35865 expref: 8 pid: 8222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996339.239961:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789996339.239965:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789996339.239970:0:6690:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004df7f958/0x4173739f0fc81643 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996339.240007:0:6690:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000018022673/0x4173739f0fc81620 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35865 expref: 8 pid: 8222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996339.240022:0:6690:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000018022673/0x4173739f0fc81620 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35865 expref: 8 pid: 8222 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789996339.240037:0:6690:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0881223100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6690:1876946942242176:192.168.204.37@tcp:104: 00000100:00100000:2.0:1789996339.240145:0:6690:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0847550540 going to sleep for 11 seconds 00000100:00100000:2.0:1789996339.252842:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1789996339.252943:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927581184 00000100:00100000:3.0:1789996339.252953:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927581184 00010000:00010000:3.0:1789996339.252994:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000018022673/0x4173739f0fc81620 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35865 expref: 9 pid: 8222 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789996339.253047:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 85 00000100:00100000:3.0:1789996339.253058:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0881223b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+9:2362:x1876946927581184:12345-192.168.204.37@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789996339.253073:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789996339.253098:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000018022673/0x4173739f0fc81620 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35865 expref: 9 pid: 8222 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996339.253132:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000018022673/0x4173739f0fc81620 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35865 expref: 9 pid: 8222 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996339.253159:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789996339.253164:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789996339.253170:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004df7f958/0x4173739f0fc81643 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996339.253179:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004df7f958/0x4173739f0fc81643 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996339.253200:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789996339.253276:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0881223b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+9:2362:x1876946927581184:12345-192.168.204.37@tcp:103:ldlm_bl.0 Request processed in 220us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996339.253284:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 85 00010000:00010000:0.0:1789996339.256718:0:6690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000018022673/0x4173739f0fc81620 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35865 expref: 8 pid: 8222 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789996339.256744:0:6690:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0881223100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6690:1876946942242176:192.168.204.37@tcp:104: 00010000:00010000:0.0:1789996339.256771:0:6690:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000004df7f958/0x4173739f0fc81643 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996339.256785:0:6690:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000004df7f958/0x4173739f0fc81643 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996339.256793:0:6690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004df7f958/0x4173739f0fc81643 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996339.256853:0:6690:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000004df7f958/0x4173739f0fc81643 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996339.256863:0:6690:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004df7f958/0x4173739f0fc81643 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996339.256872:0:6690:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004df7f958/0x4173739f0fc81643 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996339.256892:0:6690:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e08429c6a00 already unused, calling callback (ffffffffc1595910) 00010000:00010000:0.0:1789996339.256896:0:6690:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004df7f958/0x4173739f0fc81643 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996339.256905:0:6690:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004df7f958/0x4173739f0fc81643 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996339.256925:0:6690:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004df7f958/0x4173739f0fc81643 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996339.256933:0:6690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004df7f958/0x4173739f0fc81643 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789996339.257038:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086faef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+7:2363:x1876946927581056:12345-192.168.204.37@tcp:1:lhsmtool_posix.0 Request processed in 17158us (20936us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996339.257047:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 70 00000100:00100000:2.0:1789996339.269949:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1789996339.270443:0:9163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927581440 00000100:00100000:3.0:1789996339.270836:0:9163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927581440 00000100:00100000:2.0:1789996339.271239:0:9163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 229 00000100:00100000:2.0:1789996339.271252:0:9163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0881223100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+19:11606:x1876946927581440:12345-192.168.204.37@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1789996339.271360:0:9163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e08429c7c00/0x4173739f0fc8164a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996339.271394:0:9163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e08429c7c00/0x4173739f0fc8164a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996339.271406:0:9163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e08429c7c00/0x4173739f0fc8164a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996339.272019:0:9163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e08429c6200/0x4173739f0fc81651 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996339.272036:0:9163:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856e00/0x4173739f0fc81604 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35850 expref: 20 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996339.272046:0:9163:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e08429c6200/0x4173739f0fc81651 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996339.272086:0:9163:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856e00/0x4173739f0fc81604 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35850 expref: 20 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996339.272104:0:9163:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856e00/0x4173739f0fc81604 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35850 expref: 20 pid: 5847 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789996339.272118:0:9163:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0876a04000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9163:1876946942242304:192.168.204.37@tcp:104: 00000100:00100000:2.0:1789996339.272223:0:9163:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0847550600 going to sleep for 11 seconds 00000100:00100000:2.0:1789996339.279853:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996339.279992:0:9163:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0876a04000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9163:1876946942242304:192.168.204.37@tcp:104: 00010000:00010000:0.0:1789996339.280022:0:9163:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e08429c6200/0x4173739f0fc81651 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789996339.283885:0:8520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927581568 00000100:00100000:3.0:1789996339.283903:0:8520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927581568 00010000:00010000:2.0:1789996339.284198:0:8520:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856e00/0x4173739f0fc81604 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35850 expref: 21 pid: 5847 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789996339.284387:0:8520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 86 00000100:00100000:2.0:1789996339.284423:0:8520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e084755ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+21:2363:x1876946927581568:12345-192.168.204.37@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789996339.284439:0:8520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789996339.284446:0:8520:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856e00/0x4173739f0fc81604 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35850 expref: 21 pid: 5847 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996339.284526:0:8520:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856e00/0x4173739f0fc81604 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35850 expref: 21 pid: 5847 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996339.284570:0:8520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856e00/0x4173739f0fc81604 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35850 expref: 21 pid: 5847 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996339.284655:0:8520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8e084601ba00) 00010000:00010000:2.0:1789996339.284662:0:8520:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e08429c6200/0x4173739f0fc81651 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996339.284672:0:8520:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e08429c6200/0x4173739f0fc81651 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996339.284679:0:8520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e08429c6200/0x4173739f0fc81651 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996339.284763:0:8520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789996339.284832:0:8520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e084755ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+20:2363:x1876946927581568:12345-192.168.204.37@tcp:103:ldlm_bl.0 Request processed in 422us (4988us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996339.284840:0:8520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 86 00010000:00010000:3.0:1789996339.285077:0:9163:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e08429c6200/0x4173739f0fc81651 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996339.285086:0:9163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e08429c6200/0x4173739f0fc81651 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789996339.285365:0:9163:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:3.0:1789996339.286532:0:9163:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967510 00000001:00080000:3.0:1789996339.286782:0:9163:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:2.0:1789996339.287154:0:9163:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e088119ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9163:1876946942242432:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1789996339.287296:0:9163:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996339.287418:0:9163:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0847550000 going to sleep for 11 seconds 00000100:00100000:3.0:1789996339.287480:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942242432 00000100:00100000:3.0:1789996339.287489:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942242432 00000100:00100000:3.0:1789996339.287628:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789996339.287639:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e084755e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:9163:x1876946942242432:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1789996339.287718:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e084755e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:9163:x1876946942242432:12345-0@lo:1000:mdt00_003.0 Request processed in 80us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996339.287725:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789996339.287805:0:9163:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967322 gen 2 00000004:00080000:2.0:1789996339.287811:0:9163:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967322 00000004:00080000:2.0:1789996339.287830:0:9163:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e0881227480, transno 4294967321 00000004:00080000:2.0:1789996339.287847:0:9163:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e0881224380, transno 4294967322 00000100:00100000:2.0:1789996339.287854:0:9163:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e088119ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9163:1876946942242432:0@lo:1000:mdt00_003.0 00000001:00080000:2.0:1789996339.288448:0:9163:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967512 00000100:00100000:2.0:1789996339.288514:0:9163:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0877abf100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9163:1876946942242560:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1789996339.288581:0:9163:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996339.289037:0:9163:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0847550d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789996339.289130:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942242560 00000100:00100000:1.0:1789996339.289137:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942242560 00000100:00100000:1.0:1789996339.289171:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789996339.289180:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0877abea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:9163:x1876946942242560:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1789996339.289611:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0877abea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:9163:x1876946942242560:12345-0@lo:1000:mdt00_003.0 Request processed in 431us (1028us total) trans 4294967324 rc 0/0 00000100:00100000:1.0:1789996339.289619:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789996339.289767:0:9163:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0877abf100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9163:1876946942242560:0@lo:1000:mdt00_003.0 00010000:00010000:2.0:1789996339.289801:0:9163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e08429c6200/0x4173739f0fc81651 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996339.289811:0:9163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e08429c6200/0x4173739f0fc81651 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996339.289819:0:9163:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e08429c6200/0x4173739f0fc81651 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996339.289826:0:9163:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e08429c6200 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:2.0:1789996339.289830:0:9163:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e08429c6200/0x4173739f0fc81651 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996339.289838:0:9163:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e08429c6200/0x4173739f0fc81651 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996339.289852:0:9163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8e084601ba00) 00010000:00010000:2.0:1789996339.289855:0:9163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789996339.289860:0:9163:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e08429c6200/0x4173739f0fc81651 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996339.289930:0:9163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e08429c6200/0x4173739f0fc81651 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996339.289965:0:9163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7800/0x4173739f0fc81594 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996339.289971:0:9163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7800/0x4173739f0fc81594 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996339.289977:0:9163:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7800/0x4173739f0fc81594 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996339.289983:0:9163:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e086fcb7800 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:2.0:1789996339.289986:0:9163:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7800/0x4173739f0fc81594 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996339.289992:0:9163:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7800/0x4173739f0fc81594 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996339.290000:0:9163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e0850c28100) 00010000:00010000:2.0:1789996339.290003:0:9163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789996339.290077:0:9163:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e0841524e00/0x4173739f0fc8159b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35834 expref: 23 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996339.290090:0:9163:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0841524e00/0x4173739f0fc8159b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35834 expref: 23 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996339.290100:0:9163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0841524e00/0x4173739f0fc8159b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35834 expref: 23 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996339.290140:0:9163:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e0841524e00/0x4173739f0fc8159b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35834 expref: 23 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789996339.290153:0:9163:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0877abd500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9163:1876946942242688:192.168.204.37@tcp:105: 00000100:00100000:2.0:1789996339.290391:0:9163:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0847550d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789996339.297939:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996339.298059:0:9163:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0877abd500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9163:1876946942242688:192.168.204.37@tcp:105: 00010000:00010000:0.0:1789996339.298088:0:9163:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7800/0x4173739f0fc81594 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996339.298100:0:9163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7800/0x4173739f0fc81594 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996339.298131:0:9163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6a00/0x4173739f0fc81658 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996339.298145:0:9163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6a00/0x4173739f0fc81658 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996339.298156:0:9163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6a00/0x4173739f0fc81658 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996339.298166:0:9163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6a00/0x4173739f0fc81658 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996339.298173:0:9163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6a00/0x4173739f0fc81658 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996339.298179:0:9163:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6a00/0x4173739f0fc81658 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996339.298184:0:9163:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e086fcb6a00 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:0.0:1789996339.298187:0:9163:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6a00/0x4173739f0fc81658 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996339.298209:0:9163:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6a00/0x4173739f0fc81658 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996339.298235:0:9163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e0850c28100) 00010000:00010000:0.0:1789996339.298239:0:9163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789996339.298243:0:9163:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6a00/0x4173739f0fc81658 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996339.298249:0:9163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6a00/0x4173739f0fc81658 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996339.298260:0:9163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e08429c7c00/0x4173739f0fc8164a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996339.298265:0:9163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e08429c7c00/0x4173739f0fc8164a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996339.298271:0:9163:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e08429c7c00/0x4173739f0fc8164a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996339.298277:0:9163:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e08429c7c00 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:0.0:1789996339.298280:0:9163:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e08429c7c00/0x4173739f0fc8164a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996339.298285:0:9163:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e08429c7c00/0x4173739f0fc8164a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996339.298292:0:9163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e0850c28100) 00010000:00010000:0.0:1789996339.298294:0:9163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789996339.298297:0:9163:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e08429c7c00/0x4173739f0fc8164a lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996339.298324:0:9163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e08429c7c00/0x4173739f0fc8164a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789996339.298882:0:9163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0881223100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+23:11606:x1876946927581440:12345-192.168.204.37@tcp:57:lhsmtool_posix.0 Request processed in 27630us (28941us total) trans 4294967513 rc 0/0 00000100:00100000:0.0:1789996339.298893:0:9163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 229 00000020:00080000:0.0:1789996339.298899:0:9163:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:1.0:1789996339.299003:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927581696 00000100:00100000:1.0:1789996339.299012:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927581696 00000100:00100000:1.0:1789996339.299053:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 61 00000100:00100000:1.0:1789996339.299062:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0877abfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+23:11605:x1876946927581696:12345-192.168.204.37@tcp:49:lfs.0 00000100:00100000:1.0:1789996339.299159:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0877abfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+23:11605:x1876946927581696:12345-192.168.204.37@tcp:49:lfs.0 Request processed in 98us (1232us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996339.299166:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 61 00000040:00080000:2.0:1789996339.299351:0:11698:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789996339.299355:0:11698:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789996339.300311:0:11698:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1789996339.300327:0:11698:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789996339.306996:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996339.307126:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927581952 00000100:00100000:2.0:1789996339.307137:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927581952 00000100:00100000:2.0:1789996339.307199:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 230 00000100:00100000:2.0:1789996339.307210:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e088119d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+23:11605:x1876946927581952:12345-192.168.204.37@tcp:58:lfs.0 00000040:00080000:2.0:1789996339.308517:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:3.0:1789996339.309157:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996339.309356:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e088119d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+23:11605:x1876946927581952:12345-192.168.204.37@tcp:58:lfs.0 Request processed in 2147us (2372us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996339.309369:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 230 00000100:00100000:1.0:1789996339.312074:0:11495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927582208 00000100:00100000:1.0:1789996339.312087:0:11495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927582208 00000100:00100000:1.0:1789996339.312157:0:11495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 62 00000100:00100000:1.0:1789996339.312171:0:11495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0850a21050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+23:11606:x1876946927582208:12345-192.168.204.37@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1789996339.313682:0:11495:0:(mdd_object.c:4178:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1789996339.313809:0:11495:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967514 00010000:00010000:1.0:1789996339.313861:0:11495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22800/0x4173739f0fc8165f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996339.313877:0:11495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22800/0x4173739f0fc8165f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 11495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996339.313903:0:11495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22800/0x4173739f0fc8165f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 11495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996339.313911:0:11495:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22800/0x4173739f0fc8165f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 11495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996339.313919:0:11495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22800/0x4173739f0fc8165f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 11495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996339.313925:0:11495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22800/0x4173739f0fc8165f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 11495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996339.314002:0:11495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789996339.314157:0:11495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0850a21050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+25:11606:x1876946927582208:12345-192.168.204.37@tcp:35:lhsmtool_posix.0 Request processed in 1983us (4999us total) trans 4294967515 rc 0/0 00000100:00100000:1.0:1789996339.314167:0:11495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 62 00000020:00080000:1.0:1789996339.314173:0:11495:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789996339.314380:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789996339.314389:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22800/0x4173739f0fc8165f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 11495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996339.314396:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0876a22800 already unused, calling callback (ffffffffc1595910) 00010000:00010000:2.0:1789996339.314400:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22800/0x4173739f0fc8165f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 11495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996339.314418:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22800/0x4173739f0fc8165f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 11495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996339.314440:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8e0861fcf200) 00010000:00010000:2.0:1789996339.314443:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789996339.314448:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22800/0x4173739f0fc8165f lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 11495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996339.314462:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22800/0x4173739f0fc8165f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 11495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996339.314483:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789996339.314485:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789996339.314487:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789996339.336919:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1789996339.337181:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927582336 00000100:00100000:1.0:1789996339.337192:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927582336 00000100:00100000:1.0:1789996339.337261:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 231 00000100:00100000:1.0:1789996339.337273:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086faece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+25:11608:x1876946927582336:12345-192.168.204.37@tcp:101:lfs.0 00010000:00010000:1.0:1789996339.337311:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789996339.337335:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22600/0x4173739f0fc81666 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b97003095e3586c expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996339.337419:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22e00/0x4173739f0fc8166d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996339.337435:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22e00/0x4173739f0fc8166d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996339.337463:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22e00/0x4173739f0fc8166d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996339.337494:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22a00/0x4173739f0fc81674 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996339.337503:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22a00/0x4173739f0fc81674 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996339.337510:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22a00/0x4173739f0fc81674 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996339.337974:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23400/0x4173739f0fc8167b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996339.337987:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6000/0x4173739f0fc81586 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e3582d expref: 26 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996339.337996:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23400/0x4173739f0fc8167b lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996339.338034:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6000/0x4173739f0fc81586 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e3582d expref: 26 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996339.338050:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6000/0x4173739f0fc81586 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e3582d expref: 26 pid: 5847 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789996339.338064:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fc9b480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5848:1876946942242816:192.168.204.37@tcp:104: 00000100:00100000:1.0:1789996339.338163:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e08494c9e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789996339.342246:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fc9b480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5848:1876946942242816:192.168.204.37@tcp:104: 00010000:00010000:1.0:1789996339.342282:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23400/0x4173739f0fc8167b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789996339.342915:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1789996339.343160:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927582592 00000100:00100000:1.0:1789996339.343171:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927582592 00000100:00100000:1.0:1789996339.343239:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 63 00000100:00100000:1.0:1789996339.343249:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086faeca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+27:5599:x1876946927582592:12345-192.168.204.37@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1789996339.343523:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086faeca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+28:5599:x1876946927582592:12345-192.168.204.37@tcp:35:ldlm_bl.0 Request processed in 275us (609us total) trans 4294967516 rc 0/0 00000100:00100000:1.0:1789996339.343530:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 63 00000100:00100000:3.0:1789996339.347337:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996339.348929:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927582720 00000100:00100000:0.0:1789996339.348947:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927582720 00010000:00010000:0.0:1789996339.349000:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6000/0x4173739f0fc81586 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e3582d expref: 28 pid: 5847 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789996339.349058:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 87 00000100:00100000:0.0:1789996339.349070:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0870598050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+28:2362:x1876946927582720:12345-192.168.204.37@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789996339.349091:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789996339.349100:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6000/0x4173739f0fc81586 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e3582d expref: 28 pid: 5847 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996339.349115:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6000/0x4173739f0fc81586 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e3582d expref: 28 pid: 5847 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996339.349141:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6000/0x4173739f0fc81586 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e3582d expref: 28 pid: 5847 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996339.349162:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e0850c28100) 00010000:00010000:0.0:1789996339.349189:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23400/0x4173739f0fc8167b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996339.349200:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23400/0x4173739f0fc8167b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996339.349208:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23400/0x4173739f0fc8167b lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996339.349252:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789996339.349349:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0870598050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+27:2362:x1876946927582720:12345-192.168.204.37@tcp:103:ldlm_bl.0 Request processed in 281us (2024us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996339.349357:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 87 00010000:00010000:2.0:1789996339.349954:0:5848:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23400/0x4173739f0fc8167b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996339.349965:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23400/0x4173739f0fc8167b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789996339.350025:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1789996339.350030:0:5848:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789996339.350053:0:5848:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23400/0x4173739f0fc8167b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996339.350068:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23400/0x4173739f0fc8167b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996339.350078:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22e00/0x4173739f0fc8166d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996339.350085:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22e00/0x4173739f0fc8166d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996339.350093:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22e00/0x4173739f0fc8166d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996339.350114:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0876a22e00 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:2.0:1789996339.350118:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22e00/0x4173739f0fc8166d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996339.350127:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22e00/0x4173739f0fc8166d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996339.350139:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e084601b500) 00010000:00010000:2.0:1789996339.350143:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789996339.350148:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22e00/0x4173739f0fc8166d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996339.350154:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22e00/0x4173739f0fc8166d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996339.350166:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22a00/0x4173739f0fc81674 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996339.350173:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22a00/0x4173739f0fc81674 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996339.350178:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22a00/0x4173739f0fc81674 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996339.350183:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0876a22a00 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:2.0:1789996339.350186:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22a00/0x4173739f0fc81674 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996339.350192:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22a00/0x4173739f0fc81674 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996339.350210:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8e0861fcfa00) 00010000:00010000:2.0:1789996339.350226:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789996339.350229:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22a00/0x4173739f0fc81674 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996339.350235:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22a00/0x4173739f0fc81674 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996339.350928:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22600/0x4173739f0fc81666 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e3586c expref: 27 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996339.350951:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23400/0x4173739f0fc8167b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e3586c expref: 26 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996339.350959:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e0850c28100) 00010000:00010000:2.0:1789996339.350962:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789996339.350965:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e0876a23400, rc 0) 00000100:00100000:2.0:1789996339.351028:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086faece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+26:11608:x1876946927582336:12345-192.168.204.37@tcp:101:lfs.0 Request processed in 13757us (14127us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996339.351037:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 231 00010000:00010000:0.0:1789996339.565931:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789996339.688951:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0877abc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876946942242944:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789996339.689030:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789996339.689105:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942242944 00000100:00100000:3.0:1789996339.689115:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942242944 00000100:00100000:2.0:1789996339.689539:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789996339.689569:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0877abfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1876946942242944:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789996339.689592:0:6692:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3856662528 00000100:00100000:2.0:1789996339.690048:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0877abfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1876946942242944:12345-0@lo:13:osp-pre-1-0.0 Request processed in 480us (1016us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996339.690068:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789996339.690368:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0877abc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876946942242944:0@lo:13:osp-pre-1-0.0 00000040:00080000:2.0:1789996339.928929:0:12573:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789996339.928940:0:12573:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789996339.928992:0:12573:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1789996339.928998:0:12573:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:2.0:1789996340.328841:0:11698:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789996340.328853:0:11698:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789996340.328894:0:11698:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1789996340.328902:0:11698:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789996340.329055:0:11698:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0877abd500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11698:1876946942243072:192.168.204.37@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789996340.329203:0:11698:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0847550b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789996340.342892:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996340.343033:0:11698:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0877abd500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11698:1876946942243072:192.168.204.37@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789996340.347865:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927582848 00000100:00100000:1.0:1789996340.347895:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927582848 00000100:00100000:1.0:1789996340.347980:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 232 00000100:00100000:1.0:1789996340.347993:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e088119c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+26:11620:x1876946927582848:12345-192.168.204.37@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789996340.348032:0:5847:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789996340.348155:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e088119c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+26:11620:x1876946927582848:12345-192.168.204.37@tcp:53:lhsmtool_posix.0 Request processed in 164us (5287us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996340.348163:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 232 00000100:00100000:3.0:1789996340.353168:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996340.354816:0:9163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927583104 00000100:00100000:2.0:1789996340.354830:0:9163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927583104 00000100:00100000:2.0:1789996340.354972:0:9163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 233 00000100:00100000:2.0:1789996340.354985:0:9163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e088119f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+26:11620:x1876946927583104:12345-192.168.204.37@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789996340.355043:0:9163:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789996340.355066:0:9163:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e08429c6200/0x4173739f0fc81682 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b97003095e35873 expref: -99 pid: 9163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996340.355295:0:9163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e08429c7c00/0x4173739f0fc81689 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996340.355310:0:9163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e08429c7c00/0x4173739f0fc81689 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996340.355323:0:9163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e08429c7c00/0x4173739f0fc81689 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9163 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789996340.355348:0:9163:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1789996340.355648:0:9163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e08429c6200/0x4173739f0fc81682 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35873 expref: 29 pid: 9163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996340.355681:0:9163:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e08429c7c00/0x4173739f0fc81689 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35873 expref: 28 pid: 9163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996340.355689:0:9163:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e0850c28100) 00010000:00010000:2.0:1789996340.355692:0:9163:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789996340.355696:0:9163:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e08429c7c00, rc 0) 00000100:00100000:2.0:1789996340.355767:0:9163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e088119f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+28:11620:x1876946927583104:12345-192.168.204.37@tcp:101:lhsmtool_posix.0 Request processed in 784us (2608us total) trans 4294967517 rc 0/0 00000100:00100000:2.0:1789996340.355774:0:9163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 233 00000100:00100000:3.0:1789996340.360853:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1789996340.361107:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927583360 00000100:00100000:1.0:1789996340.361118:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927583360 00000100:00100000:1.0:1789996340.361177:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 234 00000100:00100000:1.0:1789996340.361188:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e088119c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+28:11620:x1876946927583360:12345-192.168.204.37@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1789996340.361262:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23e00/0x4173739f0fc81697 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996340.361281:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23e00/0x4173739f0fc81697 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996340.361308:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23e00/0x4173739f0fc81697 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996340.361515:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23e00/0x4173739f0fc81697 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996340.361523:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23e00/0x4173739f0fc81697 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996340.361529:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23e00/0x4173739f0fc81697 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996340.361535:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0876a23e00 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:1.0:1789996340.361683:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23e00/0x4173739f0fc81697 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996340.361694:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23e00/0x4173739f0fc81697 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996340.361706:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e0850c28100) 00010000:00010000:1.0:1789996340.361709:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789996340.361713:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23e00/0x4173739f0fc81697 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996340.361720:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23e00/0x4173739f0fc81697 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789996340.361946:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e088119c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+29:11620:x1876946927583360:12345-192.168.204.37@tcp:57:lhsmtool_posix.0 Request processed in 757us (1100us total) trans 4294967518 rc 0/0 00000100:00100000:1.0:1789996340.361954:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 234 00000040:00080000:2.0:1789996340.364805:0:11698:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789996340.364815:0:11698:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789996340.365920:0:11698:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1789996340.365933:0:11698:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789996340.366340:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1789996340.366383:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996340.366493:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927583488 00000100:00100000:0.0:1789996340.366503:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927583488 00000100:00100000:0.0:1789996340.366593:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 17 00000100:00100000:0.0:1789996340.366604:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e088119ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+29:2363:x1876946927583488:12345-192.168.204.37@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789996340.366618:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789996340.366643:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e08429c7c00/0x4173739f0fc81689 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35873 expref: 29 pid: 9163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996340.366661:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e0850c28100) 00010000:00010000:0.0:1789996340.366667:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789996340.366717:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e088119ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+28:2363:x1876946927583488:12345-192.168.204.37@tcp:103:ldlm_bl.0 Request processed in 114us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996340.366730:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 17 00000100:00100000:1.0:1789996340.368194:0:11495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927583744 00000100:00100000:1.0:1789996340.368205:0:11495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927583744 00000100:00100000:1.0:1789996340.368252:0:11495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 64 00000100:00100000:1.0:1789996340.368262:0:11495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0877b7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+28:11620:x1876946927583744:12345-192.168.204.37@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789996340.369218:0:11495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0877b7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+29:11620:x1876946927583744:12345-192.168.204.37@tcp:35:lhsmtool_posix.0 Request processed in 951us (2827us total) trans 4294967519 rc 0/0 00000100:00100000:1.0:1789996340.369229:0:11495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 64 00010000:00010000:2.0:1789996340.586225:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789996341.609489:0:12624:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789996341.609501:0:12624:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789996341.609581:0:12624:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1789996341.609587:0:12624:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1789996341.612223:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789996341.758790:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1789996341.760476:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927584000 00000100:00100000:1.0:1789996341.760489:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927584000 00000100:00080000:2.0:1789996341.760571:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789996341.760579:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 235 00000100:00100000:1.0:1789996341.760591:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086faeed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+29:11641:x1876946927584000:12345-192.168.204.37@tcp:101:lfs.0 00010000:00010000:1.0:1789996341.760614:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789996341.760660:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22000/0x4173739f0fc8169e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b97003095e3587a expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996341.760758:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23800/0x4173739f0fc816a5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996341.760774:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23800/0x4173739f0fc816a5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996341.760785:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23800/0x4173739f0fc816a5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789996341.760796:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1789996341.760900:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22000/0x4173739f0fc8169e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e3587a expref: 32 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996341.760915:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23800/0x4173739f0fc816a5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e3587a expref: 31 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996341.760930:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e0850c28100) 00010000:00010000:1.0:1789996341.760933:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1789996341.760937:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e0876a23800, rc 0) 00000100:00100000:1.0:1789996341.760998:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086faeed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+31:11641:x1876946927584000:12345-192.168.204.37@tcp:101:lfs.0 Request processed in 410us (2217us total) trans 4294967520 rc 0/0 00000100:00100000:1.0:1789996341.761005:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 235 00000100:00100000:2.0:1789996341.767634:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1789996341.767820:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927584128 00000100:00100000:3.0:1789996341.767831:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927584128 00000100:00100000:3.0:1789996341.767898:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 236 00000100:00100000:3.0:1789996341.767909:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0877abd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+31:11641:x1876946927584128:12345-192.168.204.37@tcp:54:lfs.0 00010000:00010000:3.0:1789996341.767987:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857800/0x4173739f0fc816b3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996341.768024:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857800/0x4173739f0fc816b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996341.768036:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857800/0x4173739f0fc816b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996341.768064:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857800/0x4173739f0fc816b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996341.768072:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857800/0x4173739f0fc816b3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996341.768079:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857800/0x4173739f0fc816b3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996341.768086:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e087f857800 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:3.0:1789996341.768090:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857800/0x4173739f0fc816b3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996341.768097:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857800/0x4173739f0fc816b3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996341.768109:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e0850c28100) 00010000:00010000:3.0:1789996341.768112:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789996341.768117:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857800/0x4173739f0fc816b3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996341.768124:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857800/0x4173739f0fc816b3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789996341.768227:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0877abd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+31:11641:x1876946927584128:12345-192.168.204.37@tcp:54:lfs.0 Request processed in 320us (602us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996341.768239:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 236 00000100:00100000:2.0:1789996341.841844:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1789996341.841898:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927584256 00000100:00100000:3.0:1789996341.841910:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927584256 00000100:00080000:2.0:1789996341.841970:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789996341.841979:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 71 00000100:00100000:3.0:1789996341.841990:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0877abc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+7:2363:x1876946927584256:12345-192.168.204.37@tcp:101:cat.0 00010000:00010000:3.0:1789996341.842007:0:6688:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789996341.842026:0:6688:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c5af67dd/0x4173739f0fc816ba lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1b97003095e35881 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789996341.842051:0:6688:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 13, mtime: 0x6ab12d32, atime: 0x6ab12d32, ctime: 0x6ab12d32, blocks: 0xb 00010000:00010000:3.0:1789996341.842069:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=383s v=(0 0) 00010000:00010000:3.0:1789996341.842074:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789996341.842083:0:6688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c5af67dd/0x4173739f0fc816ba lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35881 expref: 8 pid: 6688 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996341.842100:0:6688:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c5af67dd/0x4173739f0fc816ba lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35881 expref: 8 pid: 6688 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996341.842114:0:6688:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e087f857800, rc 0) 00000100:00100000:3.0:1789996341.842184:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0877abc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+8:2363:x1876946927584256:12345-192.168.204.37@tcp:101:cat.0 Request processed in 196us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996341.842191:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 71 00000100:00100000:0.0:1789996341.845306:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996341.845405:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927584384 00000100:00100000:2.0:1789996341.845415:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927584384 00002000:00100000:2.0:1789996341.845471:0:6693:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff8e086faec700 x1876946927584384/t0(0) o3->189efa8a-c7eb-4b69-9afa-1dd36d6775f1@192.168.204.37@tcp:72/0 lens 488/0 e 0 to 0 dl 1789996352 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789996341.845484:0:6693:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8e086faec700 with x1876946927584384 ext(0->4095) 00002000:00010000:2.0:1789996341.845503:0:6693:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8e086faec700 00000100:00100000:2.0:1789996341.845577:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 7 00000100:00100000:2.0:1789996341.845588:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086faec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+8:2362:x1876946927584384:12345-192.168.204.37@tcp:3:cat.0 00000100:00100000:2.0:1789996341.845812:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086faec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+8:2362:x1876946927584384:12345-192.168.204.37@tcp:3:cat.0 Request processed in 226us (513us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1789996341.845823:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 7 00002000:00100000:2.0:1789996341.845830:0:6693:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff8e086faec700 x1876946927584384/t0(0) o3->189efa8a-c7eb-4b69-9afa-1dd36d6775f1@192.168.204.37@tcp:72/0 lens 488/4536 e 0 to 0 dl 1789996352 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789996341.845838:0:6693:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8e086faec700 with x1876946927584384 ext(0->4095) 00002000:00010000:2.0:1789996341.845841:0:6693:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8e086faec700 00000001:00080000:1.0:1789996342.279903:0:6715:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000001:00080000:1.0:1789996342.279920:0:6715:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000001:00080000:1.0:1789996342.279930:0:6715:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00010000:00010000:2.0:1789996342.632775:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789996343.272960:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789996343.272987:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fc9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876946942243200:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789996343.273063:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996343.273143:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942243200 00000100:00100000:0.0:1789996343.273154:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942243200 00000100:00100000:0.0:1789996343.273228:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789996343.273240:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0877b7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1876946942243200:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789996343.273276:0:6692:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1789996343.273364:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789996343.273407:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0877b7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1876946942243200:12345-0@lo:13:osp-pre-0-0.0 Request processed in 169us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996343.273415:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789996343.273483:0:3316:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:3.0:1789996343.273488:0:3316:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:3.0:1789996343.273510:0:3316:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e0881221c00, transno 4294967310 00000100:00100000:3.0:1789996343.273935:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fc9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876946942243200:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789996343.660476:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789996344.108721:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996344.108762:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996344.108797:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996344.108834:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996344.108863:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996344.108895:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927584512 00000100:00100000:2.0:1789996344.108904:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927584512 00000100:00100000:2.0:1789996344.108967:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 292 00000100:00100000:2.0:1789996344.108977:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852ba1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f78f7903-47ba-48a7-bb82-1f616cb85fc0+13:2364:x1876946927584512:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:2.0:1789996344.109042:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852ba1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f78f7903-47ba-48a7-bb82-1f616cb85fc0+13:2364:x1876946927584512:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 67us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996344.109050:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 292 00000100:00100000:2.0:1789996344.109081:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927584896 00000100:00100000:2.0:1789996344.109084:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927584896 00000100:00100000:2.0:1789996344.109125:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927584768 00000100:00100000:2.0:1789996344.109128:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927584768 00000100:00100000:2.0:1789996344.109146:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 84 00000100:00100000:2.0:1789996344.109151:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fadad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+8:2364:x1876946927584896:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:2.0:1789996344.109179:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fadad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+8:2364:x1876946927584896:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 28us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996344.109186:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 84 00000100:00100000:2.0:1789996344.109196:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 85 00000100:00100000:2.0:1789996344.109201:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fad9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+5:2364:x1876946927584768:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:2.0:1789996344.109220:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fad9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+5:2364:x1876946927584768:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 20us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996344.109226:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 85 00000100:00100000:2.0:1789996344.109243:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927584640 00000100:00100000:2.0:1789996344.109246:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927584640 00000100:00100000:2.0:1789996344.109266:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927585024 00000100:00100000:2.0:1789996344.109269:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927585024 00000100:00100000:2.0:1789996344.109288:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 147 00000100:00100000:2.0:1789996344.109294:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fadb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+31:2364:x1876946927584640:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:2.0:1789996344.109334:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fadb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+31:2364:x1876946927584640:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 39us (623us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996344.109340:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 147 00000100:00100000:2.0:1789996344.109352:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 148 00000100:00100000:2.0:1789996344.109358:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0741837b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cfc759a1-09a6-40ba-80a8-7399de51b555+5:2364:x1876946927585024:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:2.0:1789996344.109393:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0741837b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cfc759a1-09a6-40ba-80a8-7399de51b555+5:2364:x1876946927585024:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 35us (529us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996344.109408:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 148 00000100:00080000:2.0:1789996344.109521:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789996344.109526:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789996344.109527:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789996344.299690:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086faee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e0c28cd8-555e-481f-bd03-c3b02aee51c5:3316:1876946942243328:0@lo:400:kworker.0 00000100:00100000:0.0:1789996344.299755:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996344.299801:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086faedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3316:1876946942243840:0@lo:400:kworker.0 00000100:00100000:0.0:1789996344.299826:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996344.299850:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789996344.299855:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086faee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876946942243712:0@lo:400:kworker.0 00000100:00100000:0.0:1789996344.299876:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996344.299903:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086faed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876946942243456:0@lo:400:kworker.0 00000100:00100000:0.0:1789996344.299923:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996344.299940:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086faef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876946942243968:0@lo:400:kworker.0 00000100:00100000:0.0:1789996344.299958:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996344.300012:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789996344.300018:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086faec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1876946942243584:0@lo:400:kworker.0 00000100:00100000:0.0:1789996344.301228:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996344.301693:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942243328 00000100:00100000:0.0:1789996344.301702:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942243328 00000100:00100000:0.0:1789996344.301744:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:0.0:1789996344.301760:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852ba2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0c28cd8-555e-481f-bd03-c3b02aee51c5+19:3316:x1876946942243328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789996344.301820:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852ba2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e0c28cd8-555e-481f-bd03-c3b02aee51c5+19:3316:x1876946942243328:12345-0@lo:400:kworker.0 Request processed in 61us (2064us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996344.301827:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:0.0:1789996344.301860:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942243840 00000100:00100000:0.0:1789996344.301863:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942243840 00000100:00100000:0.0:1789996344.301893:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942243456 00000100:00100000:0.0:1789996344.301897:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942243456 00000100:00100000:0.0:1789996344.301907:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1789996344.301913:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086faefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1876946942243840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789996344.301944:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086faefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1876946942243840:12345-0@lo:400:kworker.0 Request processed in 31us (2117us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996344.301950:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1789996344.301959:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942243584 00000100:00100000:0.0:1789996344.301962:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942243584 00000100:00100000:0.0:1789996344.301978:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1789996344.301983:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086faeea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876946942243456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789996344.302013:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086faeea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876946942243456:12345-0@lo:400:kworker.0 Request processed in 29us (2089us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996344.302019:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1789996344.302031:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00080000:2.0:1789996344.302184:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789996344.304667:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086faef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876946942243584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789996344.304734:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086faef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876946942243584:12345-0@lo:400:kworker.0 Request processed in 90us (3509us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996344.304741:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1789996344.304776:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942243712 00000100:00100000:0.0:1789996344.304783:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942243712 00000100:00100000:0.0:1789996344.304829:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942243968 00000100:00100000:0.0:1789996344.304833:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942243968 00000100:00100000:0.0:1789996344.304863:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1789996344.304870:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086faec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1876946942243712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789996344.304903:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086faec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1876946942243712:12345-0@lo:400:kworker.0 Request processed in 34us (5025us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996344.304908:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1789996344.304919:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1789996344.304924:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086faed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3313:x1876946942243968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789996344.304951:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086faed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3313:x1876946942243968:12345-0@lo:400:kworker.0 Request processed in 26us (4991us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996344.304956:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1789996344.305377:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086faee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876946942243712:0@lo:400:kworker.0 00000100:00100000:0.0:1789996344.305390:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086faee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e0c28cd8-555e-481f-bd03-c3b02aee51c5:3316:1876946942243328:0@lo:400:kworker.0 00000100:00100000:0.0:1789996344.305400:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086faedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3316:1876946942243840:0@lo:400:kworker.0 00000100:00100000:0.0:1789996344.305436:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086faec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1876946942243584:0@lo:400:kworker.0 00000100:00100000:0.0:1789996344.305447:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086faed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876946942243456:0@lo:400:kworker.0 00000100:00100000:0.0:1789996344.305457:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086faef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876946942243968:0@lo:400:kworker.0 00000100:00080000:2.0:1789996344.306742:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:0.0:1789996344.356989:0:7659:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00000001:00080000:0.0:1789996344.357005:0:7659:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967323 is committed 00000001:00080000:2.0:1789996344.361076:0:5868:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:2.0:1789996344.361099:0:5868:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:2.0:1789996344.361126:0:5868:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8e0847550cc0 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:2.0:1789996344.361131:0:5868:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8e087fbcdb00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8e0847550000 00000020:00080000:2.0:1789996344.361135:0:5868:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8e087fbcd500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8e0877ab3000 00000020:00080000:0.0:1789996344.361187:0:5879:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:0.0:1789996344.361398:0:5879:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00010000:00010000:2.0:1789996344.680915:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789996344.809838:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789996344.814131:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086faef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876946942244096:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789996344.814224:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789996344.815420:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942244096 00000100:00100000:3.0:1789996344.815432:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942244096 00000100:00100000:3.0:1789996344.815527:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789996344.815538:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fc99f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876946942244096:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789996344.815599:0:6691:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789996344.815657:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fc99f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876946942244096:12345-0@lo:13:osp-pre-1-0.0 Request processed in 121us (1433us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996344.815663:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789996344.816064:0:3313:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:1.0:1789996344.816072:0:3313:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:1.0:1789996344.816113:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086faef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876946942244096:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789996345.707853:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789996345.883368:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996345.883408:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927585152 00000100:00100000:0.0:1789996345.883429:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927585152 00000100:00100000:0.0:1789996345.883481:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 237 00000100:00100000:0.0:1789996345.883491:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086faed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+18:11286:x1876946927585152:12345-192.168.204.37@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1789996345.883618:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086faed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+18:11286:x1876946927585152:12345-192.168.204.37@tcp:60:lhsmtool_posix.0 Request processed in 127us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996345.883625:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 237 00000100:00100000:2.0:1789996345.886434:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996345.886471:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927585408 00000100:00100000:2.0:1789996345.886481:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927585408 00000100:00100000:2.0:1789996345.886572:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 65 00000100:00100000:2.0:1789996345.886583:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e087993a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+18:11286:x1876946927585408:12345-192.168.204.37@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789996345.886925:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e087993a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+19:11286:x1876946927585408:12345-192.168.204.37@tcp:35:lhsmtool_posix.0 Request processed in 343us (500us total) trans 4294967521 rc 0/0 00000100:00100000:2.0:1789996345.886932:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 65 00000040:00080000:3.0:1789996346.536820:0:11698:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789996346.536833:0:11698:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789996346.537154:0:11698:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:3.0:1789996346.537161:0:11698:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1789996346.730700:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789996347.692075:0:12826:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 09:12:27 (1789996347) 00010000:00010000:0.0:1789996347.760094:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789996348.395557:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789996348.401121:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fc9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876946942244224:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789996348.401201:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996348.401383:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942244224 00000100:00100000:2.0:1789996348.401403:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942244224 00000100:00100000:2.0:1789996348.413457:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789996348.413479:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0876a6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1876946942244224:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789996348.413518:0:6692:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1789996348.417630:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789996348.418354:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0876a6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1876946942244224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 4877us (17145us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996348.418367:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789996348.424614:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fc9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876946942244224:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789996348.778963:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789996349.228061:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996349.228123:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996349.228156:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996349.228180:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996349.228205:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996349.228243:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927586048 00000100:00100000:0.0:1789996349.228254:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927586048 00000100:00100000:3.0:1789996349.228400:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927585792 00000100:00100000:3.0:1789996349.228405:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927585792 00000100:00100000:1.0:1789996349.228461:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927585536 00000100:00100000:1.0:1789996349.228466:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927585536 00000100:00100000:1.0:1789996349.228510:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 294 00000100:00100000:1.0:1789996349.228520:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852b6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f78f7903-47ba-48a7-bb82-1f616cb85fc0+13:2364:x1876946927585536:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:1.0:1789996349.228608:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852b6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f78f7903-47ba-48a7-bb82-1f616cb85fc0+13:2364:x1876946927585536:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 89us (557us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996349.228615:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 294 00000100:00100000:0.0:1789996349.229039:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 152 00000100:00100000:0.0:1789996349.229048:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086faedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cfc759a1-09a6-40ba-80a8-7399de51b555+5:2364:x1876946927586048:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:0.0:1789996349.229089:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086faedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cfc759a1-09a6-40ba-80a8-7399de51b555+5:2364:x1876946927586048:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 43us (932us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996349.229095:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 152 00000100:00100000:0.0:1789996349.229107:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927585664 00000100:00100000:0.0:1789996349.229110:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927585664 00000100:00100000:1.0:1789996349.235244:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927585920 00000100:00100000:1.0:1789996349.235269:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927585920 00000100:00100000:2.0:1789996349.242137:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 88 00000100:00100000:2.0:1789996349.242155:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086faec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+5:2364:x1876946927585792:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:2.0:1789996349.242239:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086faec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+5:2364:x1876946927585792:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 89us (14125us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996349.242247:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 88 00000100:00080000:2.0:1789996349.242292:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789996349.242298:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789996349.242301:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789996349.243260:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 153 00000100:00100000:0.0:1789996349.243271:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086faee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+19:2364:x1876946927585664:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:0.0:1789996349.243324:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086faee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+19:2364:x1876946927585664:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 55us (15143us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996349.243349:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 153 00000100:00100000:0.0:1789996349.248399:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 89 00000100:00100000:0.0:1789996349.248418:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086faee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+7:2364:x1876946927585920:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:0.0:1789996349.248502:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086faee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+7:2364:x1876946927585920:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 91us (20295us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996349.248509:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 89 00000100:00100000:0.0:1789996349.418644:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086faed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e0c28cd8-555e-481f-bd03-c3b02aee51c5:3316:1876946942244352:0@lo:400:kworker.0 00000100:00100000:0.0:1789996349.418721:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996349.418766:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0741a28a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3316:1876946942244864:0@lo:400:kworker.0 00000100:00100000:0.0:1789996349.418794:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996349.418820:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789996349.418826:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0876a04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876946942244736:0@lo:400:kworker.0 00000100:00100000:0.0:1789996349.418851:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996349.418874:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086faef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876946942244480:0@lo:400:kworker.0 00000100:00100000:0.0:1789996349.418896:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996349.419080:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942244736 00000100:00100000:2.0:1789996349.419089:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942244736 00000100:00100000:2.0:1789996349.419134:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1789996349.419144:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0741a28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1876946942244736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789996349.419221:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0741a28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3316:x1876946942244736:12345-0@lo:400:kworker.0 Request processed in 58us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996349.419229:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1789996349.419859:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0876a04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876946942244736:0@lo:400:kworker.0 00000100:00100000:3.0:1789996349.429811:0:9163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942244864 00000100:00100000:3.0:1789996349.429822:0:9163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942244864 00000100:00100000:2.0:1789996349.430104:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942244480 00000100:00100000:2.0:1789996349.430110:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942244480 00000100:00100000:2.0:1789996349.430156:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1789996349.430166:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0741a2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876946942244480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789996349.430417:0:9163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1789996349.430424:0:9163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0741a29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1876946942244864:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1789996349.430479:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789996349.430606:0:9163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0741a29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1876946942244864:12345-0@lo:400:kworker.0 Request processed in 182us (11811us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996349.430614:0:9163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1789996349.430808:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0741a2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876946942244480:12345-0@lo:400:kworker.0 Request processed in 644us (11910us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996349.430815:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1789996349.430843:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942244352 00000100:00100000:2.0:1789996349.430847:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942244352 00000100:00100000:2.0:1789996349.430961:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:2.0:1789996349.430969:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852b6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+19:3316:x1876946942244352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789996349.431004:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852b6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+19:3316:x1876946942244352:12345-0@lo:400:kworker.0 Request processed in 37us (12284us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996349.431009:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:2.0:1789996349.431045:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e084755ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3314:1876946942244608:0@lo:400:kworker.0 00000100:00100000:2.0:1789996349.431075:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996349.431854:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942244608 00000100:00100000:2.0:1789996349.431861:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942244608 00000100:00100000:2.0:1789996349.431907:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1789996349.431916:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0876a04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876946942244608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789996349.431962:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0876a04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876946942244608:12345-0@lo:400:kworker.0 Request processed in 47us (887us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996349.431969:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1789996349.432073:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e084755ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3314:1876946942244608:0@lo:400:kworker.0 00000100:00100000:0.0:1789996349.433033:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086faef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876946942244480:0@lo:400:kworker.0 00000100:00100000:0.0:1789996349.433044:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0741a2a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876946942244992:0@lo:400:kworker.0 00000100:00100000:2.0:1789996349.433791:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086faed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e0c28cd8-555e-481f-bd03-c3b02aee51c5:3316:1876946942244352:0@lo:400:kworker.0 00000100:00100000:2.0:1789996349.433808:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0741a28a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3316:1876946942244864:0@lo:400:kworker.0 00000100:00100000:0.0:1789996349.434026:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996349.434065:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942244992 00000100:00100000:0.0:1789996349.434071:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942244992 00000100:00100000:0.0:1789996349.434349:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1789996349.434359:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0741a29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1876946942244992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789996349.434411:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0741a29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1876946942244992:12345-0@lo:400:kworker.0 Request processed in 54us (1322us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996349.434431:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1789996349.434464:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0741a2a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876946942244992:0@lo:400:kworker.0 00000100:00080000:1.0:1789996349.434930:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789996349.434935:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00080000:2.0:1789996349.483007:0:5868:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000001:00080000:2.0:1789996349.483030:0:5868:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967521 is committed 00000020:00080000:3.0:1789996349.483076:0:5879:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:3.0:1789996349.483086:0:5879:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:1.0:1789996349.807157:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789996349.929701:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0741a2a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876946942245120:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789996349.929780:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996349.930351:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942245120 00000100:00100000:0.0:1789996349.930360:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942245120 00000100:00100000:0.0:1789996349.930401:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789996349.930409:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086faef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876946942245120:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789996349.930446:0:6691:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789996349.930490:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086faef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876946942245120:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (710us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996349.930497:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789996349.935026:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0741a2a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876946942245120:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789996350.324961:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996350.325684:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927586176 00000100:00100000:2.0:1789996350.325711:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927586176 00000100:00100000:3.0:1789996350.326026:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 238 00000100:00100000:3.0:1789996350.326037:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0876a69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cfc759a1-09a6-40ba-80a8-7399de51b555+5:12305:x1876946927586176:12345-192.168.204.37@tcp:101:lsof.0 00010000:00010000:3.0:1789996350.326058:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789996350.326130:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857000/0x4173739f0fc816c1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b97003095e35888 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996350.326280:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857c00/0x4173739f0fc816c8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996350.326295:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857c00/0x4173739f0fc816c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996350.326309:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857c00/0x4173739f0fc816c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789996350.326344:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789996350.326348:0:5848:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789996350.326387:0:5848:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857c00/0x4173739f0fc816c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996350.326411:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857000/0x4173739f0fc816c1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35888 expref: 7 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996350.326442:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857c00/0x4173739f0fc816c8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35888 expref: 6 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996350.326450:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e0850c28d00) 00010000:00010000:3.0:1789996350.326453:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789996350.326457:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e087f857c00, rc 0) 00000100:00100000:3.0:1789996350.326617:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0876a69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cfc759a1-09a6-40ba-80a8-7399de51b555+6:12305:x1876946927586176:12345-192.168.204.37@tcp:101:lsof.0 Request processed in 581us (1781us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996350.326624:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 238 00010000:00010000:0.0:1789996350.824813:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789996351.572222:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996351.573449:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927586432 00000100:00100000:2.0:1789996351.573461:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927586432 00000100:00100000:2.0:1789996351.573555:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 66 00000100:00100000:2.0:1789996351.573568:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fc98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+18:12306:x1876946927586432:12345-192.168.204.37@tcp:35:umount.0 00000100:00100000:2.0:1789996351.574006:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fc98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+19:12306:x1876946927586432:12345-192.168.204.37@tcp:35:umount.0 Request processed in 440us (1792us total) trans 4294967522 rc 0/0 00000100:00100000:2.0:1789996351.574015:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 66 00000100:00080000:1.0:1789996351.574149:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789996351.584589:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996351.584753:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927586688 00000100:00100000:2.0:1789996351.584765:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927586688 00000100:00100000:2.0:1789996351.584833:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 67 00000100:00100000:2.0:1789996351.584844:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0741a2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+19:12306:x1876946927586688:12345-192.168.204.37@tcp:35:umount.0 00000100:00100000:2.0:1789996351.585186:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0741a2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+20:12306:x1876946927586688:12345-192.168.204.37@tcp:35:umount.0 Request processed in 343us (606us total) trans 4294967523 rc 0/0 00000100:00100000:2.0:1789996351.585195:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 67 00000100:00100000:0.0:1789996351.590127:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1789996351.590232:0:11495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927586944 00000100:00100000:3.0:1789996351.590243:0:11495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927586944 00000100:00100000:3.0:1789996351.590305:0:11495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 68 00000100:00100000:3.0:1789996351.590315:0:11495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e08457ddc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+20:12306:x1876946927586944:12345-192.168.204.37@tcp:35:umount.0 00000100:00100000:3.0:1789996351.590582:0:11495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e08457ddc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+21:12306:x1876946927586944:12345-192.168.204.37@tcp:35:umount.0 Request processed in 267us (464us total) trans 4294967524 rc 0/0 00000100:00100000:3.0:1789996351.590590:0:11495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 68 00000100:00100000:3.0:1789996351.600993:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1789996351.601094:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927587200 00000100:00100000:1.0:1789996351.601103:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927587200 00000100:00100000:1.0:1789996351.601165:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 69 00000100:00100000:1.0:1789996351.601188:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0876a69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+21:12306:x1876946927587200:12345-192.168.204.37@tcp:35:umount.0 00000100:00100000:1.0:1789996351.601614:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0876a69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+22:12306:x1876946927587200:12345-192.168.204.37@tcp:35:umount.0 Request processed in 427us (631us total) trans 4294967525 rc 0/0 00000100:00100000:1.0:1789996351.601623:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 69 00000100:00100000:0.0:1789996351.612105:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996351.612137:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996351.612227:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996351.628479:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996351.628639:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927587968 00000100:00100000:0.0:1789996351.628652:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927587968 00000100:00100000:0.0:1789996351.628709:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 72 00000100:00100000:0.0:1789996351.628719:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0741a29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+7:2361:x1876946927587968:12345-192.168.204.37@tcp:9:umount.0 00000020:00000080:0.0:1789996351.628749:0:6690:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4173739f0fc80c87 00000020:00010000:0.0:1789996351.628757:0:6690:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8e087f961000: total 0 00000100:00080000:0.0:1789996351.628762:0:6690:0:(import.c:65:import_set_state_nolock()) ffff8e087f960000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789996351.628799:0:6690:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:0.0:1789996351.630117:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0741a29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+5:2361:x1876946927587968:12345-192.168.204.37@tcp:9:umount.0 Request processed in 1393us (1640us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996351.630139:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 72 00000020:00010000:0.0:1789996351.630180:0:5834:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8e087f961000: total 0 00010000:00010000:0.0:1789996351.630223:0:5834:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8e087f961000, canceled 0 locks, left on hash table 2. 00010000:00010000:0.0:1789996351.630277:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c5af67dd/0x4173739f0fc816ba lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35881 expref: 4 pid: 6688 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996351.630310:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000754eb88/0x4173739f0fc8102a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e356ba expref: 3 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996351.630324:0:5834:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8e087f961000, canceled 2 locks, left on hash table 0. 00010000:00010000:0.0:1789996351.630335:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789996351.630337:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789996351.630339:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789996351.630419:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789996351.630739:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927587328 00000100:00100000:2.0:1789996351.630745:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927587328 00000100:00100000:2.0:1789996351.630818:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927587584 00000100:00100000:2.0:1789996351.630822:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927587584 00000100:00100000:0.0:1789996351.630990:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927587456 00000100:00100000:0.0:1789996351.630994:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927587456 00000100:00100000:0.0:1789996351.631015:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 18 00000100:00100000:0.0:1789996351.631022:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0741a2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f78f7903-47ba-48a7-bb82-1f616cb85fc0+15:2363:x1876946927587328:12345-192.168.204.37@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789996351.631032:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789996351.631043:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e0840031c00/0x4173739f0fc806ec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e3541a expref: 15 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996351.631054:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789996351.631081:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0741a2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f78f7903-47ba-48a7-bb82-1f616cb85fc0+14:2363:x1876946927587328:12345-192.168.204.37@tcp:103:ldlm_bl.0 Request processed in 60us (18986us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996351.631087:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 18 00000100:00100000:0.0:1789996351.631108:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 19 00000100:00100000:0.0:1789996351.631113:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0741a28380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f78f7903-47ba-48a7-bb82-1f616cb85fc0+13:2363:x1876946927587584:12345-192.168.204.37@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789996351.631120:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789996351.631128:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e0842de5200/0x4173739f0fc80938 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e354e5 expref: 13 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996351.631135:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789996351.631151:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0741a28380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f78f7903-47ba-48a7-bb82-1f616cb85fc0+12:2363:x1876946927587584:12345-192.168.204.37@tcp:103:ldlm_bl.0 Request processed in 38us (19013us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996351.631157:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 19 00000100:00100000:0.0:1789996351.631180:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 20 00000100:00100000:0.0:1789996351.631187:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0741a2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f78f7903-47ba-48a7-bb82-1f616cb85fc0+11:2363:x1876946927587456:12345-192.168.204.37@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789996351.631194:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1789996351.635657:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1789996351.635691:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927588096 00000100:00100000:3.0:1789996351.635701:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927588096 00000100:00100000:3.0:1789996351.635771:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 73 00000100:00100000:3.0:1789996351.635781:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0876a6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+5:2361:x1876946927588096:12345-192.168.204.37@tcp:9:umount.0 00000020:00000080:3.0:1789996351.635812:0:6688:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4173739f0fc80a26 00000100:00080000:3.0:1789996351.635821:0:6688:0:(import.c:65:import_set_state_nolock()) ffff8e0848961000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789996351.635859:0:6688:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:3.0:1789996351.636148:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0876a6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+2:2361:x1876946927588096:12345-192.168.204.37@tcp:9:umount.0 Request processed in 366us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996351.636155:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 73 00000100:00080000:3.0:1789996351.636185:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789996351.636196:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789996351.637084:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e08413f0600/0x4173739f0fc806b4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e353e2 expref: 11 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996351.637104:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789996351.637158:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0741a2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f78f7903-47ba-48a7-bb82-1f616cb85fc0+10:2363:x1876946927587456:12345-192.168.204.37@tcp:103:ldlm_bl.0 Request processed in 5970us (24935us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996351.637176:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 20 00000100:00100000:3.0:1789996351.643345:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996351.643483:0:9163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927589120 00000100:00100000:2.0:1789996351.643505:0:9163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927589120 00000100:00100000:2.0:1789996351.643591:0:9163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 239 00000100:00100000:2.0:1789996351.643602:0:9163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0877b7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+22:2361:x1876946927589120:12345-192.168.204.37@tcp:39:umount.0 00000020:00000080:2.0:1789996351.643638:0:9163:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4173739f0fc806c2 00000020:00010000:2.0:1789996351.643656:0:9163:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8e0876bb2800: total 0 00000100:00080000:2.0:1789996351.643661:0:9163:0:(import.c:65:import_set_state_nolock()) ffff8e0876bb1800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789996351.643685:0:9163:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000100:00100000:2.0:1789996351.644044:0:9163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0877b7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:189efa8a-c7eb-4b69-9afa-1dd36d6775f1+21:2361:x1876946927589120:12345-192.168.204.37@tcp:39:umount.0 Request processed in 442us (709us total) trans 4294967526 rc 0/0 00000100:00100000:2.0:1789996351.644064:0:9163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 239 00000020:00010000:0.0:1789996351.644164:0:5834:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8e0876bb2800: total 0 00010000:00010000:0.0:1789996351.644177:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789996351.644221:0:5834:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8e0876bb2800, canceled 0 locks, left on hash table 13. 00010000:00010000:0.0:1789996351.644263:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e084601b700) 00010000:00010000:0.0:1789996351.644267:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789996351.644275:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5800/0x4173739f0fc80ce9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e355e1 expref: 20 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996351.644305:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8e084601b800) 00010000:00010000:0.0:1789996351.644308:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789996351.644313:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5e00/0x4173739f0fc8098c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e354f3 expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996351.644333:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e0861fcfd00) 00010000:00010000:0.0:1789996351.644336:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1789996351.644340:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7a00/0x4173739f0fc81015 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e356b3 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996351.644352:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e0850c28100) 00010000:00010000:0.0:1789996351.644355:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789996351.644358:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23400/0x4173739f0fc8167b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e3586c expref: 17 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996351.644369:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e084601b700) 00010000:00010000:0.0:1789996351.644371:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789996351.644375:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4600/0x4173739f0fc809fc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e3550f expref: 16 pid: 9163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996351.644389:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e0850c28d00) 00010000:00010000:0.0:1789996351.644392:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789996351.644395:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6600/0x4173739f0fc8107e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e356cf expref: 15 pid: 9163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996351.644406:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e0850c28100) 00010000:00010000:0.0:1789996351.644408:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1789996351.644419:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23800/0x4173739f0fc816a5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e3587a expref: 14 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996351.644433:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e0861fcfd00) 00010000:00010000:0.0:1789996351.644436:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789996351.644440:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7c00/0x4173739f0fc80f0b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e3566d expref: 13 pid: 9163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996351.644452:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e084601b600) 00010000:00010000:0.0:1789996351.644454:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789996351.644457:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de4a00/0x4173739f0fc809a8 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e354fa expref: 12 pid: 9163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996351.644470:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e084601b500) 00010000:00010000:0.0:1789996351.644472:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789996351.644476:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23a00/0x4173739f0fc81379 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e357a8 expref: 11 pid: 9163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996351.644487:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e0861fcfd00) 00010000:00010000:0.0:1789996351.644489:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789996351.644492:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856400/0x4173739f0fc80feb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e356a5 expref: 10 pid: 9163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996351.644506:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e0850c28100) 00010000:00010000:0.0:1789996351.644508:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789996351.644511:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0841524e00/0x4173739f0fc8159b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35834 expref: 9 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996351.644525:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e084601b500) 00010000:00010000:0.0:1789996351.644533:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789996351.644539:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0842de5c00/0x4173739f0fc8109a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e356d6 expref: 8 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996351.644585:0:5834:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8e0876bb2800, canceled 13 locks, left on hash table 0. 00010000:00010000:0.0:1789996351.644601:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789996351.644603:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789996351.644604:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789996351.848707:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1789996352.588600:0:6715:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 189efa8a-c7eb-4b69-9afa-1dd36d6775f1 00000020:00000080:0.0:1789996352.588612:0:6715:0:(genops.c:885:class_export_put()) final put ffff8e0848966800/189efa8a-c7eb-4b69-9afa-1dd36d6775f1 00000020:00000080:2.0:1789996352.588723:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8e0848966800/189efa8a-c7eb-4b69-9afa-1dd36d6775f1 for lustre-OST0000 00000020:00000080:2.0:1789996352.588793:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e0848961000 for lustre-OST0000 00010000:00010000:0.0:1789996352.872774:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789996353.142454:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1789996353.142766:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1789996353.142821:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1789996353.142852:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927589248 00000100:00100000:1.0:1789996353.142863:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927589248 00000100:00100000:1.0:1789996353.142922:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927589504 00000100:00100000:1.0:1789996353.142925:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927589504 00000100:00100000:1.0:1789996353.142939:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927589376 00000100:00100000:1.0:1789996353.142942:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927589376 00000100:00100000:3.0:1789996353.142958:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 21 00000100:00100000:3.0:1789996353.142973:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e087993a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f78f7903-47ba-48a7-bb82-1f616cb85fc0+12:2362:x1876946927589248:12345-192.168.204.37@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789996353.143090:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789996353.143111:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e087f857400/0x4173739f0fc80794 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e3542f expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996353.143128:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789996353.143189:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e087993a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f78f7903-47ba-48a7-bb82-1f616cb85fc0+11:2362:x1876946927589248:12345-192.168.204.37@tcp:103:ldlm_bl.0 Request processed in 221us (745us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996353.145584:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 22 00000100:00100000:1.0:1789996353.145624:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086f88a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f78f7903-47ba-48a7-bb82-1f616cb85fc0+11:2362:x1876946927589504:12345-192.168.204.37@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789996353.145643:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789996353.145664:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e0842de4c00/0x4173739f0fc80931 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e354de expref: 11 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996353.145681:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789996353.145727:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086f88a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f78f7903-47ba-48a7-bb82-1f616cb85fc0+10:2362:x1876946927589504:12345-192.168.204.37@tcp:103:ldlm_bl.0 Request processed in 131us (2961us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996353.145749:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 22 00000100:00100000:1.0:1789996353.145782:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 23 00000100:00100000:1.0:1789996353.145790:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e087059bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f78f7903-47ba-48a7-bb82-1f616cb85fc0+9:2362:x1876946927589376:12345-192.168.204.37@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789996353.145799:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789996353.145809:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e0876a23000/0x4173739f0fc8079b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35459 expref: 9 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996353.145819:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789996353.145838:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e087059bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f78f7903-47ba-48a7-bb82-1f616cb85fc0+8:2362:x1876946927589376:12345-192.168.204.37@tcp:103:ldlm_bl.0 Request processed in 49us (3017us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996353.145844:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 23 00000100:00100000:3.0:1789996353.151235:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 21 00000100:00100000:1.0:1789996353.151394:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996353.151476:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927589760 00000100:00100000:2.0:1789996353.151484:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927589760 00000100:00100000:2.0:1789996353.151574:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 240 00000100:00100000:2.0:1789996353.151598:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fc9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cfc759a1-09a6-40ba-80a8-7399de51b555+6:2361:x1876946927589760:12345-192.168.204.37@tcp:39:umount.0 00000020:00000080:2.0:1789996353.151645:0:5847:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4173739f0fc807a9 00000020:00010000:2.0:1789996353.151655:0:5847:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8e086fde5800: total 0 00000100:00080000:2.0:1789996353.151660:0:5847:0:(import.c:65:import_set_state_nolock()) ffff8e086fde4800 : changing import state from FULL to CLOSED 00000100:00080000:3.0:1789996353.151747:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00000004:2.0:1789996353.152193:0:5847:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00100000:2.0:1789996353.152414:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fc9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cfc759a1-09a6-40ba-80a8-7399de51b555+5:2361:x1876946927589760:12345-192.168.204.37@tcp:39:umount.0 Request processed in 829us (1020us total) trans 4294967527 rc 0/0 00000100:00100000:2.0:1789996353.152423:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 240 00000020:00010000:0.0:1789996353.155013:0:5835:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8e086fde5800: total 0 00010000:00010000:0.0:1789996353.155079:0:5835:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8e086fde5800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1789996353.155114:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e0850c28d00) 00010000:00010000:0.0:1789996353.155119:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789996353.155133:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857c00/0x4173739f0fc816c8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35888 expref: 4 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996353.155169:0:5835:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8e086fde5800, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1789996353.155181:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789996353.155183:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789996353.155185:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789996353.170630:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996353.170734:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927590016 00000100:00100000:0.0:1789996353.170745:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927590016 00000100:00100000:0.0:1789996353.170812:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 296 00000100:00100000:0.0:1789996353.170822:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0852b6c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f78f7903-47ba-48a7-bb82-1f616cb85fc0+7:2361:x1876946927590016:12345-192.168.204.37@tcp:251:umount.0 00000020:00000080:0.0:1789996353.170863:0:5841:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4173739f0fc8069f 00000020:00010000:0.0:1789996353.170870:0:5841:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8e086fde2800: total 0 00000100:00080000:0.0:1789996353.170874:0:5841:0:(import.c:65:import_set_state_nolock()) ffff8e086fde6000 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1789996353.170968:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0852b6c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f78f7903-47ba-48a7-bb82-1f616cb85fc0+3:2361:x1876946927590016:12345-192.168.204.37@tcp:251:umount.0 Request processed in 147us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996353.170976:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 296 00000020:00010000:1.0:1789996353.171122:0:5834:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8e086fde2800: total 0 00010000:00010000:1.0:1789996353.171126:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789996353.171179:0:5834:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8e086fde2800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1789996353.171236:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e0842de5000/0x4173739f0fc806f3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35421 expref: 2 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996353.171249:0:5834:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8e086fde2800, canceled 1 locks, left on hash table 0. 00000020:00000080:1.0:1789996353.171259:0:5834:0:(genops.c:885:class_export_put()) final put ffff8e086fde2800/f78f7903-47ba-48a7-bb82-1f616cb85fc0 00010000:00010000:1.0:1789996353.171273:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789996353.171275:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789996353.171276:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789996353.171283:0:12638:0:(genops.c:844:class_export_destroy()) destroying export ffff8e086fde2800/f78f7903-47ba-48a7-bb82-1f616cb85fc0 for MGS 00000020:00000080:1.0:1789996353.171311:0:12638:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e086fde6000 for MGS 00000100:00100000:1.0:1789996353.521031:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789996353.521063:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fc9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876946942245248:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789996353.521155:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996353.521218:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942245248 00000100:00100000:1.0:1789996353.521226:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942245248 00000100:00100000:1.0:1789996353.521302:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789996353.521313:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0881159050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1876946942245248:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789996353.521348:0:6691:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789996353.521392:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0881159050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1876946942245248:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996353.521400:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789996353.521644:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fc9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876946942245248:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789996353.523612:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789996353.898253:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789996354.498790:0:13025:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:2.0:1789996354.519748:0:13025:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1789996354.519795:0:13025:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.137@tcp lock: ffff8e0841525200/0x4173739f0fc80732 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc80739 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996354.519810:0:13025:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.137@tcp lock: ffff8e0841525200/0x4173739f0fc80732 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x4173739f0fc80739 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996354.519817:0:13025:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.137@tcp lock: ffff8e0841525200/0x4173739f0fc80732 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x4173739f0fc80739 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996354.519825:0:13025:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.137@tcp lock: ffff8e0841525200/0x4173739f0fc80732 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x4173739f0fc80739 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996354.519867:0:13025:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789996354.519873:0:13025:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1789996354.519894:0:13025:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789996354.519899:0:13025:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1789996354.519904:0:13025:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1789996354.519927:0:13025:0:(import.c:65:import_set_state_nolock()) ffff8e08705ce800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1789996354.520235:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086faed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876946942245376:0@lo:39:umount.0 00000100:00100000:3.0:1789996354.520301:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789996354.520370:0:9163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942245376 00000100:00100000:3.0:1789996354.520378:0:9163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942245376 00000100:00100000:3.0:1789996354.520420:0:9163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1789996354.520428:0:9163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086f88a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876946942245376:12345-0@lo:39:umount.0 00000020:00000080:3.0:1789996354.520462:0:9163:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4173739f0fc804ae 00000100:00080000:3.0:1789996354.520469:0:9163:0:(import.c:65:import_set_state_nolock()) ffff8e08705ca800 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1789996354.520522:0:9163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086f88a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+1:3312:x1876946942245376:12345-0@lo:39:umount.0 Request processed in 94us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996354.520529:0:9163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000020:00000080:3.0:1789996354.520538:0:9163:0:(genops.c:885:class_export_put()) final put ffff8e08705c9000/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:3.0:1789996354.520594:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789996354.520600:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.137@tcp lock: ffff8e0841525200/0x4173739f0fc80732 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x4173739f0fc80739 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996354.520608:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0841525200 already unused, calling callback (ffffffffc1be0c20) 10000000:00010000:3.0:1789996354.520612:0:5835:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.137@tcp lock: ffff8e0841525200/0x4173739f0fc80732 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x4173739f0fc80739 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996354.520620:0:5835:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.137@tcp lock: ffff8e0841525200/0x4173739f0fc80732 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x4173739f0fc80739 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789996354.520626:0:5835:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.137@tcp lock: ffff8e0841525200/0x4173739f0fc80732 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x4173739f0fc80739 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789996354.520632:0:5835:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789996354.520634:0:5835:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1789996354.520637:0:5835:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1789996354.520661:0:5835:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.137@tcp lock: ffff8e0841525200/0x4173739f0fc80732 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x4173739f0fc80739 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996354.520667:0:5835:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789996354.520686:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.137@tcp lock: ffff8e0841525200/0x4173739f0fc80732 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x4173739f0fc80739 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996354.520693:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.137@tcp lock: ffff8e0841525200/0x4173739f0fc80732 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x4173739f0fc80739 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996354.520710:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789996354.520712:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789996354.520713:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789996354.520722:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8e08705c9000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1789996354.520766:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e08705ca800 for lustre-MDT0000 00000100:00100000:3.0:1789996354.520780:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086f888e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e0c28cd8-555e-481f-bd03-c3b02aee51c5:3316:1876946942245504:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789996354.520809:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789996354.520848:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942245504 00000100:00100000:3.0:1789996354.520852:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942245504 00000100:00100000:3.0:1789996354.520880:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789996354.520887:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086f88a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+19:3316:x1876946942245504:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789996354.520896:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789996354.520908:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e0841525000/0x4173739f0fc80739 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4173739f0fc80732 expref: 19 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996354.520918:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789996354.520943:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086f88a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e0c28cd8-555e-481f-bd03-c3b02aee51c5+18:3316:x1876946942245504:12345-0@lo:103:ldlm_bl.0 Request processed in 57us (132us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996354.520949:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789996354.520994:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086f888e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e0c28cd8-555e-481f-bd03-c3b02aee51c5:3316:1876946942245504:0@lo:103:ldlm_bl.0 00000100:00080000:3.0:1789996354.521020:0:3312:0:(import.c:65:import_set_state_nolock()) ffff8e08705ce800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1789996354.521027:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086faed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876946942245376:0@lo:39:umount.0 00000100:00080000:2.0:1789996354.521298:0:13025:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789996354.521301:0:13025:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1789996354.521304:0:13025:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1789996354.522085:0:13025:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.137@tcp lock: ffff8e087f857a00/0x4173739f0fc80740 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc80747 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996354.522096:0:13025:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.137@tcp lock: ffff8e087f857a00/0x4173739f0fc80740 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x4173739f0fc80747 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996354.522103:0:13025:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.137@tcp lock: ffff8e087f857a00/0x4173739f0fc80740 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x4173739f0fc80747 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996354.522109:0:13025:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.137@tcp lock: ffff8e087f857a00/0x4173739f0fc80740 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x4173739f0fc80747 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996354.522135:0:13025:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789996354.522141:0:13025:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.137@tcp lock: ffff8e08429c7600/0x4173739f0fc80659 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc80660 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996354.522148:0:13025:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.137@tcp lock: ffff8e08429c7600/0x4173739f0fc80659 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4173739f0fc80660 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996354.522167:0:13025:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.137@tcp lock: ffff8e08429c7600/0x4173739f0fc80659 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x4173739f0fc80660 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996354.522172:0:13025:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.137@tcp lock: ffff8e08429c7600/0x4173739f0fc80659 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x4173739f0fc80660 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996354.522179:0:13025:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789996354.522184:0:13025:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.137@tcp lock: ffff8e087f856800/0x4173739f0fc8095b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc80962 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996354.522190:0:13025:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.137@tcp lock: ffff8e087f856800/0x4173739f0fc8095b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4173739f0fc80962 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996354.522195:0:13025:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.137@tcp lock: ffff8e087f856800/0x4173739f0fc8095b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x4173739f0fc80962 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996354.522201:0:13025:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.137@tcp lock: ffff8e087f856800/0x4173739f0fc8095b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x4173739f0fc80962 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996354.522206:0:13025:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1789996354.522210:0:13025:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.137@tcp lock: ffff8e0840031600/0x4173739f0fc8040d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc80414 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996354.522215:0:13025:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.137@tcp lock: ffff8e0840031600/0x4173739f0fc8040d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4173739f0fc80414 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996354.522221:0:13025:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.137@tcp lock: ffff8e0840031600/0x4173739f0fc8040d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x4173739f0fc80414 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996354.522236:0:13025:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.137@tcp lock: ffff8e0840031600/0x4173739f0fc8040d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x4173739f0fc80414 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996354.522242:0:13025:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:2.0:1789996354.522245:0:13025:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:2.0:1789996354.522263:0:13025:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0000 00000020:01000000:2.0:1789996354.522267:0:13025:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:2.0:1789996354.522271:0:13025:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789996354.522276:0:13025:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/9 00000020:00080000:2.0:1789996354.522282:0:13025:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff8e0847d06800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789996354.522288:0:13025:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff8e0876338000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789996354.522294:0:13025:0:(genops.c:1818:print_export_data()) lustre-MDT0000: UNLINKED ffff8e086fde5800 cfc759a1-09a6-40ba-80a8-7399de51b555 192.168.204.37@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789996354.522299:0:13025:0:(genops.c:1818:print_export_data()) lustre-MDT0000: UNLINKED ffff8e0876bb2800 189efa8a-c7eb-4b69-9afa-1dd36d6775f1 192.168.204.37@tcp 6 (0 6 0) 1 0 0 0: 0000000000000000 4294967521 stale:0 00000020:00080000:2.0:1789996354.522304:0:13025:0:(genops.c:1552:class_disconnect_exports()) OBD device 5 (ffff8e0879953380) has exports, disconnecting them 00000020:00080000:2.0:1789996354.522308:0:13025:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8e0847d06800), last request at 1789996349 00000020:00000080:2.0:1789996354.522313:0:13025:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4173739f0fc80621 00000100:00080000:2.0:1789996354.522329:0:13025:0:(import.c:65:import_set_state_nolock()) ffff8e0847d00800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1789996354.522362:0:13025:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8e0847d06800): rc 0 00000020:00000080:2.0:1789996354.522365:0:13025:0:(genops.c:885:class_export_put()) final put ffff8e0847d06800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:2.0:1789996354.522373:0:13025:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8e0876338000), last request at 1789996349 00000020:00000080:2.0:1789996354.522376:0:13025:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4173739f0fc80556 00000100:00080000:2.0:1789996354.522381:0:13025:0:(import.c:65:import_set_state_nolock()) ffff8e0876338800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1789996354.522386:0:13025:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8e0876338000): rc 0 00000020:00000080:2.0:1789996354.522387:0:13025:0:(genops.c:885:class_export_put()) final put ffff8e0876338000/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:2.0:1789996354.522393:0:13025:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffa9e8c1c7bae0 00000100:00080000:2.0:1789996354.522409:0:13025:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1789996354.522416:0:13025:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:2.0:1789996354.522426:0:13025:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1789996354.522481:0:13025:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1789996354.522496:0:13025:0:(import.c:65:import_set_state_nolock()) ffff8e0847d07000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1789996354.522506:0:13025:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1789996354.522509:0:13025:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:2.0:1789996354.522523:0:13025:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1789996354.522595:0:13025:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1789996354.522603:0:13025:0:(import.c:65:import_set_state_nolock()) ffff8e08704c3000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:2.0:1789996354.522635:0:13025:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff8e0879953380) has no exports 00000020:00000080:3.0:1789996354.522881:0:12638:0:(genops.c:844:class_export_destroy()) destroying export ffff8e0847d06800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1789996354.522933:0:12638:0:(genops.c:844:class_export_destroy()) destroying export ffff8e0876338000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1789996354.522957:0:12638:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e0847d00800 for lustre-MDT0000 00000020:00000080:3.0:1789996354.522970:0:12638:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e0876338800 for lustre-MDT0000 00010000:00010000:3.0:1789996354.522981:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1789996354.522986:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.137@tcp lock: ffff8e087f857a00/0x4173739f0fc80740 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x4173739f0fc80747 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996354.522993:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e087f857a00 already unused, calling callback (ffffffffc1be0c20) 10000000:00010000:3.0:1789996354.522996:0:5835:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.137@tcp lock: ffff8e087f857a00/0x4173739f0fc80740 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x4173739f0fc80747 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996354.523004:0:5835:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.137@tcp lock: ffff8e087f857a00/0x4173739f0fc80740 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x4173739f0fc80747 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789996354.523012:0:5835:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.137@tcp lock: ffff8e087f857a00/0x4173739f0fc80740 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x4173739f0fc80747 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789996354.523018:0:5835:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789996354.523021:0:5835:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:3.0:1789996354.523023:0:5835:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:3.0:1789996354.523041:0:5835:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.137@tcp lock: ffff8e087f857a00/0x4173739f0fc80740 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x4173739f0fc80747 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996354.523048:0:5835:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789996354.523066:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.137@tcp lock: ffff8e087f857a00/0x4173739f0fc80740 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x4173739f0fc80747 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996354.523073:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.137@tcp lock: ffff8e087f857a00/0x4173739f0fc80740 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x4173739f0fc80747 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996354.523083:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789996354.523086:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.137@tcp lock: ffff8e08429c7600/0x4173739f0fc80659 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x4173739f0fc80660 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996354.523103:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e08429c7600 already unused, calling callback (ffffffffc1be0c20) 10000000:00010000:3.0:1789996354.523106:0:5835:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.137@tcp lock: ffff8e08429c7600/0x4173739f0fc80659 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x4173739f0fc80660 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996354.523122:0:5835:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.137@tcp lock: ffff8e08429c7600/0x4173739f0fc80659 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x4173739f0fc80660 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789996354.523128:0:5835:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.137@tcp lock: ffff8e08429c7600/0x4173739f0fc80659 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x4173739f0fc80660 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789996354.523134:0:5835:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1789996354.523136:0:5835:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1789996354.523138:0:5835:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1789996354.523152:0:5835:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.137@tcp lock: ffff8e08429c7600/0x4173739f0fc80659 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x4173739f0fc80660 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996354.523248:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789996354.523367:0:13026:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789996354.523374:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.137@tcp lock: ffff8e087f856800/0x4173739f0fc8095b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x4173739f0fc80962 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996354.523381:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e087f856800 already unused, calling callback (ffffffffc1be0c20) 10000000:00010000:1.0:1789996354.523383:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.137@tcp lock: ffff8e087f856800/0x4173739f0fc8095b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x4173739f0fc80962 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996354.523389:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.137@tcp lock: ffff8e087f856800/0x4173739f0fc8095b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x4173739f0fc80962 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789996354.523395:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.137@tcp lock: ffff8e087f856800/0x4173739f0fc8095b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x4173739f0fc80962 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789996354.523399:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1789996354.523402:0:5834:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1789996354.523404:0:5834:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1789996354.523423:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.137@tcp lock: ffff8e087f856800/0x4173739f0fc8095b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x4173739f0fc80962 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996354.523430:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789996354.523436:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.137@tcp lock: ffff8e087f856800/0x4173739f0fc8095b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x4173739f0fc80962 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996354.523442:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.137@tcp lock: ffff8e087f856800/0x4173739f0fc8095b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x4173739f0fc80962 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996354.523451:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789996354.523453:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789996354.523454:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789996354.524353:0:5835:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1789996354.524400:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086f889180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e0c28cd8-555e-481f-bd03-c3b02aee51c5:3315:1876946942246016:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789996354.524458:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996354.524556:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942246016 00000100:00100000:2.0:1789996354.524564:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942246016 00000100:00100000:2.0:1789996354.524610:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789996354.524618:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fc99f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e0c28cd8-555e-481f-bd03-c3b02aee51c5+18:3315:x1876946942246016:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789996354.524629:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789996354.524644:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e0842de4400/0x4173739f0fc80660 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4173739f0fc80659 expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996354.524660:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789996354.524718:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.137@tcp lock: ffff8e08429c7600/0x4173739f0fc80659 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x4173739f0fc80660 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996354.524727:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.137@tcp lock: ffff8e08429c7600/0x4173739f0fc80659 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x4173739f0fc80660 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996354.524741:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789996354.524742:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789996354.524744:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789996354.524755:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086f888e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e0c28cd8-555e-481f-bd03-c3b02aee51c5:3313:1876946942245888:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789996354.524781:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789996354.524806:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789996354.524821:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fc9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e0c28cd8-555e-481f-bd03-c3b02aee51c5:3313:1876946942246144:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789996354.524843:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789996354.524870:0:8520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942245888 00000100:00100000:3.0:1789996354.524874:0:8520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942245888 00000100:00100000:3.0:1789996354.524892:0:8520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942246144 00000100:00100000:3.0:1789996354.524895:0:8520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942246144 00000100:00100000:3.0:1789996354.524908:0:8520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789996354.524915:0:8520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086f88aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e0c28cd8-555e-481f-bd03-c3b02aee51c5+19:3313:x1876946942245888:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789996354.524923:0:8520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789996354.524931:0:8520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e0840030400/0x4173739f0fc80747 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4173739f0fc80740 expref: 19 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996354.524941:0:8520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789996354.524966:0:8520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086f88aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e0c28cd8-555e-481f-bd03-c3b02aee51c5+18:3313:x1876946942245888:12345-0@lo:103:ldlm_bl.0 Request processed in 51us (184us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996354.524973:0:8520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789996354.524989:0:8520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789996354.524995:0:8520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e088119ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e0c28cd8-555e-481f-bd03-c3b02aee51c5+17:3313:x1876946942246144:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789996354.525002:0:8520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789996354.525010:0:8520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e0842de4000/0x4173739f0fc80962 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4173739f0fc8095b expref: 17 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996354.525019:0:8520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789996354.525038:0:8520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e088119ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e0c28cd8-555e-481f-bd03-c3b02aee51c5+16:3313:x1876946942246144:12345-0@lo:103:ldlm_bl.0 Request processed in 44us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996354.525044:0:8520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789996354.525073:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fc9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e0c28cd8-555e-481f-bd03-c3b02aee51c5:3313:1876946942246144:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789996354.525082:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086f888e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e0c28cd8-555e-481f-bd03-c3b02aee51c5:3313:1876946942245888:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789996354.525132:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086faed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3312:1876946942245632:0@lo:9:umount.0 00000100:00100000:3.0:1789996354.525168:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789996354.525187:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086faef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3312:1876946942245760:0@lo:9:umount.0 00000100:00100000:3.0:1789996354.525206:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996354.525296:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942245632 00000100:00100000:0.0:1789996354.525301:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942245632 00000100:00100000:0.0:1789996354.525336:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942245760 00000100:00100000:0.0:1789996354.525339:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942245760 00000100:00100000:0.0:1789996354.525370:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789996354.525378:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086f888e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1876946942245632:12345-0@lo:9:umount.0 00000020:00000080:0.0:1789996354.525397:0:6690:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4173739f0fc805a3 00000100:00080000:0.0:1789996354.525406:0:6690:0:(import.c:65:import_set_state_nolock()) ffff8e087f9e1800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789996354.525434:0:6690:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:0.0:1789996354.525760:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086f888e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3312:x1876946942245632:12345-0@lo:9:umount.0 Request processed in 384us (600us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996354.525767:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789996354.525779:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789996354.525785:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e087993aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1876946942245760:12345-0@lo:9:umount.0 00000020:00000080:0.0:1789996354.525796:0:6690:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4173739f0fc8068a 00000100:00080000:0.0:1789996354.525802:0:6690:0:(import.c:65:import_set_state_nolock()) ffff8e0876bb5000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789996354.525820:0:6690:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:0.0:1789996354.525906:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e087993aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3312:x1876946942245760:12345-0@lo:9:umount.0 Request processed in 121us (698us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996354.525913:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:0.0:1789996354.525932:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789996354.525955:0:3312:0:(import.c:65:import_set_state_nolock()) ffff8e0847d07000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1789996354.525968:0:3312:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1789996354.525970:0:3312:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789996354.525980:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086faed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3312:1876946942245632:0@lo:9:umount.0 00000100:00080000:0.0:1789996354.525992:0:3312:0:(import.c:65:import_set_state_nolock()) ffff8e08704c3000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1789996354.525999:0:3312:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1789996354.526000:0:3312:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789996354.526003:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086faef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3312:1876946942245760:0@lo:9:umount.0 00010000:00010000:0.0:1789996354.526020:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789996354.526047:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789996354.526343:0:13027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789996354.526345:0:13027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789996354.526347:0:13027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789996354.526379:0:13026:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.137@tcp lock: ffff8e0840031600/0x4173739f0fc8040d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x4173739f0fc80414 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996354.526388:0:13026:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0840031600 already unused, calling callback (ffffffffc1be0c20) 10000000:00010000:0.0:1789996354.526392:0:13026:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.137@tcp lock: ffff8e0840031600/0x4173739f0fc8040d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x4173739f0fc80414 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996354.526399:0:13026:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.137@tcp lock: ffff8e0840031600/0x4173739f0fc8040d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x4173739f0fc80414 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789996354.526406:0:13026:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.137@tcp lock: ffff8e0840031600/0x4173739f0fc8040d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x4173739f0fc80414 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789996354.526412:0:13026:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1789996354.526415:0:13026:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1789996354.526418:0:13026:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:0.0:1789996354.526441:0:13026:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.137@tcp lock: ffff8e0840031600/0x4173739f0fc8040d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x4173739f0fc80414 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996354.526447:0:13026:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1789996354.526494:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0741a2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e0c28cd8-555e-481f-bd03-c3b02aee51c5:3316:1876946942246272:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789996354.526568:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789996354.526609:0:8520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942246272 00000100:00100000:3.0:1789996354.526614:0:8520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942246272 00000100:00100000:2.0:1789996354.526639:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fc99f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e0c28cd8-555e-481f-bd03-c3b02aee51c5+16:3315:x1876946942246016:12345-0@lo:103:ldlm_bl.0 Request processed in 2020us (2179us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996354.526648:0:8520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789996354.526655:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789996354.526664:0:8520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0879939880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e0c28cd8-555e-481f-bd03-c3b02aee51c5+16:3316:x1876946942246272:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789996354.526675:0:8520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789996354.526690:0:8520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e08413f1200/0x4173739f0fc80414 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4173739f0fc8040d expref: 15 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996354.526708:0:8520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789996354.526741:0:8520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0879939880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e0c28cd8-555e-481f-bd03-c3b02aee51c5+14:3316:x1876946942246272:12345-0@lo:103:ldlm_bl.0 Request processed in 85us (173us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996354.526748:0:8520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789996354.526796:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0741a2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e0c28cd8-555e-481f-bd03-c3b02aee51c5:3316:1876946942246272:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789996354.526814:0:13026:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.137@tcp lock: ffff8e0840031600/0x4173739f0fc8040d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x4173739f0fc80414 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996354.526824:0:13026:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.137@tcp lock: ffff8e0840031600/0x4173739f0fc8040d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x4173739f0fc80414 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996354.526843:0:13026:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789996354.526845:0:13026:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789996354.526846:0:13026:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789996354.527140:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086f889180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e0c28cd8-555e-481f-bd03-c3b02aee51c5:3315:1876946942246016:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789996354.536879:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fc9bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1876946942246400:0@lo:400:kworker.0 00000100:00100000:1.0:1789996354.536962:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996354.537003:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789996354.537009:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fc98a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3313:1876946942246528:0@lo:400:kworker.0 00000100:00100000:1.0:1789996354.537033:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996354.537103:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942246400 00000100:00100000:1.0:1789996354.537123:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942246400 00000100:00100000:1.0:1789996354.537164:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942246528 00000100:00100000:1.0:1789996354.537169:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942246528 00000100:00100000:0.0:1789996354.537404:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1789996354.537414:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fc9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3313:x1876946942246400:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1789996354.537423:0:5848:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1789996354.537903:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1789996354.537912:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fc9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3313:x1876946942246528:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1789996354.537919:0:5847:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1789996354.537964:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fc9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3313:x1876946942246528:12345-0@lo:400:kworker.0 Request processed in 52us (929us total) trans 0 rc -107/-107 00000100:00100000:3.0:1789996354.537979:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1789996354.538137:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fc9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3313:x1876946942246400:12345-0@lo:400:kworker.0 Request processed in 722us (1174us total) trans 0 rc -107/-107 00000100:00100000:0.0:1789996354.538147:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00080000:0.0:1789996354.538192:0:3313:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1789996354.538197:0:3313:0:(import.c:65:import_set_state_nolock()) ffff8e0850a85000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1789996354.538202:0:3313:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000020:00080000:2.0:1789996354.538250:0:13025:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff8e0879953380) has no exports 00000100:00080000:0.0:1789996354.547033:0:3313:0:(import.c:65:import_set_state_nolock()) ffff8e0850a85000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789996354.547047:0:3313:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 228 00000100:00080000:0.0:1789996354.547062:0:3313:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8e0850a85000 using connection 192.168.204.137@tcp/0@lo 00000100:00100000:0.0:1789996354.547103:0:3313:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e0741a29500 x1876946942246656/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789996354.547148:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fc98a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3313:1876946942246528:0@lo:400:kworker.0 00000100:00080000:0.0:1789996354.547178:0:3313:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1789996354.547182:0:3313:0:(import.c:65:import_set_state_nolock()) ffff8e087f9e2800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1789996354.547185:0:3313:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1789996354.547189:0:3313:0:(import.c:65:import_set_state_nolock()) ffff8e087f9e2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789996354.547192:0:3313:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 207 00000100:00080000:0.0:1789996354.547213:0:3313:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8e087f9e2800 using connection 192.168.204.137@tcp/0@lo 00000100:00100000:0.0:1789996354.547228:0:3313:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e0741a2ad80 x1876946942246784/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789996354.547239:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fc9bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1876946942246400:0@lo:400:kworker.0 00000100:00100000:3.0:1789996354.547595:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0741a29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3312:1876946942246656:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:3.0:1789996354.547675:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789996354.547707:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0741a2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3312:1876946942246784:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:3.0:1789996354.547727:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789996354.547776:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942246656 00000100:00100000:3.0:1789996354.547784:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942246656 00000100:00100000:3.0:1789996354.547825:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942246784 00000100:00100000:3.0:1789996354.547828:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942246784 00000100:00100000:3.0:1789996354.547842:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1789996354.547849:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e087993a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3312:x1876946942246656:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:3.0:1789996354.547867:0:5847:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1789996354.548292:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1789996354.548300:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fa90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3312:x1876946942246784:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:0.0:1789996354.548310:0:5848:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1789996354.548362:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fa90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3312:x1876946942246784:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 61us (633us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789996354.548369:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00080000:0.0:1789996354.548406:0:3312:0:(import.c:65:import_set_state_nolock()) ffff8e087f9e2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789996354.548411:0:3312:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789996354.548414:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0741a2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3312:1876946942246784:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:3.0:1789996354.556538:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e087993a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3312:x1876946942246656:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 8679us (8854us total) trans 0 rc -19/-19 00000100:00100000:3.0:1789996354.556580:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00080000:3.0:1789996354.556648:0:3312:0:(import.c:65:import_set_state_nolock()) ffff8e0850a85000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789996354.556654:0:3312:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789996354.556659:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0741a29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3312:1876946942246656:0@lo:38:ptlrpcd_00_00.0 00000001:00100000:1.0:1789996354.563784:0:7659:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789996354.563796:0:7659:0:(genops.c:885:class_export_put()) final put ffff8e0876bb2000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1789996354.563821:0:7659:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 189efa8a-c7eb-4b69-9afa-1dd36d6775f1 00000020:00000080:1.0:1789996354.563824:0:7659:0:(genops.c:885:class_export_put()) final put ffff8e087f961000/189efa8a-c7eb-4b69-9afa-1dd36d6775f1 00000020:00000080:1.0:1789996354.563856:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8e0876bb2000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1789996354.563912:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8e087f961000/189efa8a-c7eb-4b69-9afa-1dd36d6775f1 for lustre-OST0001 00000020:00000080:1.0:1789996354.563943:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e0876bb5000 for lustre-OST0001 00000020:00000080:1.0:1789996354.563951:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e087f960000 for lustre-OST0001 00000020:00000080:2.0:1789996354.576037:0:13025:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4173739f0fc80468 00000020:00000080:2.0:1789996354.576053:0:13025:0:(genops.c:885:class_export_put()) final put ffff8e0880adf000/lustre-QMT0000_UUID 00000020:01000000:2.0:1789996354.576125:0:13025:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1789996354.576133:0:13025:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789996354.576143:0:13025:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1789996354.576147:0:13025:0:(genops.c:1557:class_disconnect_exports()) OBD device 7 (ffff8e0849c7cd40) has no exports 00000020:00000080:1.0:1789996354.576288:0:12638:0:(genops.c:844:class_export_destroy()) destroying export ffff8e0880adf000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1789996354.576462:0:13025:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4173739f0fc80461 00000020:00000080:2.0:1789996354.576482:0:13025:0:(genops.c:885:class_export_put()) final put ffff8e0877a17800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1789996354.576533:0:13025:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789996354.576578:0:13025:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1789996354.576582:0:13025:0:(genops.c:885:class_export_put()) final put ffff8e0877a10000/lustre-QMT0000_UUID 00000020:00000080:2.0:1789996354.576584:0:13025:0:(genops.c:844:class_export_destroy()) destroying export ffff8e0877a10000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1789996354.576592:0:13025:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:1.0:1789996354.576840:0:12638:0:(genops.c:844:class_export_destroy()) destroying export ffff8e0877a17800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000001:00080000:2.0:1789996354.577295:0:5868:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000001:00100000:2.0:1789996354.577374:0:5868:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of cfc759a1-09a6-40ba-80a8-7399de51b555 00000001:00080000:2.0:1789996354.577381:0:5868:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967527 is committed 00000020:00000080:2.0:1789996354.577384:0:5868:0:(genops.c:885:class_export_put()) final put ffff8e086fde5800/cfc759a1-09a6-40ba-80a8-7399de51b555 00000001:00100000:2.0:1789996354.577395:0:5868:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 189efa8a-c7eb-4b69-9afa-1dd36d6775f1 00000001:00080000:2.0:1789996354.577399:0:5868:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:2.0:1789996354.577411:0:12638:0:(genops.c:844:class_export_destroy()) destroying export ffff8e086fde5800/cfc759a1-09a6-40ba-80a8-7399de51b555 for lustre-MDT0000 00000020:00000080:2.0:1789996354.577457:0:12638:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e086fde4800 for lustre-MDT0000 00000020:00000080:2.0:1789996354.577645:0:5868:0:(genops.c:885:class_export_put()) final put ffff8e0876bb2800/189efa8a-c7eb-4b69-9afa-1dd36d6775f1 00000020:00000080:1.0:1789996354.577732:0:12638:0:(genops.c:844:class_export_destroy()) destroying export ffff8e0876bb2800/189efa8a-c7eb-4b69-9afa-1dd36d6775f1 for lustre-MDT0000 00000020:00000080:1.0:1789996354.577783:0:12638:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e0876bb1800 for lustre-MDT0000 00010000:00010000:0.0:1789996354.920833:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789996355.944751:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1789996356.584703:0:13025:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8e0877b478a0 - data ffff8e086a768870/ffff8e0877ae2800 00000020:01000000:2.0:1789996356.584873:0:13025:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8e08545ca360 - data ffff8e0858941a20/ffff8e0852bea800 00000001:00000004:2.0:1789996356.590978:0:13025:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00000100:00080000:2.0:1789996356.652964:0:13025:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1789996356.652973:0:13025:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:2.0:1789996356.653037:0:13025:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789996356.653040:0:13025:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1789996356.653990:0:7017:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1789996356.653995:0:7017:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:1.0:1789996356.654006:0:7017:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:2.0:1789996356.655037:0:13025:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1789996356.655043:0:13025:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:2.0:1789996356.655058:0:13025:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789996356.655061:0:13025:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1789996356.655536:0:8106:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1789996356.655565:0:8106:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 1 00000040:00080000:1.0:1789996356.655574:0:8106:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:2.0:1789996356.717682:0:13025:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4173739f0fc80430 00000020:00000080:2.0:1789996356.717693:0:13025:0:(genops.c:885:class_export_put()) final put ffff8e087995b000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1789996356.718466:0:13025:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4173739f0fc80445 00000020:00000080:2.0:1789996356.718473:0:13025:0:(genops.c:885:class_export_put()) final put ffff8e087995b800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1789996356.718491:0:13025:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:2.0:1789996356.718497:0:13025:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789996356.718505:0:13025:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1789996356.718509:0:13025:0:(genops.c:1557:class_disconnect_exports()) OBD device 4 (ffff8e08799519c0) has no exports 00000004:01000000:2.0:1789996356.718707:0:13025:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1789996356.718714:0:13025:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4173739f0fc80683 00000020:00000080:2.0:1789996356.718719:0:13025:0:(genops.c:885:class_export_put()) final put ffff8e086f4e9000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1789996356.718722:0:13025:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:2.0:1789996356.718726:0:13025:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789996356.718731:0:13025:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1789996356.718734:0:13025:0:(genops.c:1557:class_disconnect_exports()) OBD device 17 (ffff8e087665b380) has no exports 00000020:00000080:2.0:1789996356.718739:0:13025:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4173739f0fc8067c 00000020:00000080:2.0:1789996356.718742:0:13025:0:(genops.c:885:class_export_put()) final put ffff8e08704c5000/lustre-MDT0000-osd_UUID 00010000:01000000:2.0:1789996356.719053:0:13025:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:2.0:1789996356.719057:0:13025:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1789996356.719062:0:13025:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:2.0:1789996356.719066:0:13025:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789996356.719079:0:13025:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789996356.719106:0:13025:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789996356.719112:0:13025:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789996356.719217:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8e087995b000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1789996356.719229:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8e087995b800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:0.0:1789996356.719233:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8e086f4e9000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1789996356.719237:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8e08704c5000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1789996356.719241:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e08704c3000 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1789996356.719246:0:37:0:(genops.c:885:class_export_put()) final put ffff8e08704c4800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789996356.719248:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8e08704c4800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1789996356.719252:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789996356.719335:0:13025:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4173739f0fc8059c 00000020:00000080:2.0:1789996356.719340:0:13025:0:(genops.c:885:class_export_put()) final put ffff8e07412ad800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1789996356.719375:0:13025:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:2.0:1789996356.719378:0:13025:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789996356.719383:0:13025:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1789996356.719385:0:13025:0:(genops.c:1557:class_disconnect_exports()) OBD device 13 (ffff8e0849c799c0) has no exports 00000020:00000080:2.0:1789996356.719389:0:13025:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4173739f0fc80595 00000020:00000080:2.0:1789996356.719392:0:13025:0:(genops.c:885:class_export_put()) final put ffff8e0847d04800/lustre-MDT0000-osd_UUID 00010000:01000000:2.0:1789996356.723102:0:13025:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:2.0:1789996356.723111:0:13025:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1789996356.723125:0:13025:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:2.0:1789996356.723134:0:13025:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789996356.723155:0:13025:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789996356.723198:0:13025:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789996356.723209:0:13025:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789996356.723241:0:13025:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789996356.723243:0:13025:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789996356.723250:0:13025:0:(genops.c:885:class_export_put()) final put ffff8e0879936800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789996356.723254:0:13025:0:(genops.c:844:class_export_destroy()) destroying export ffff8e0879936800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1789996356.723260:0:13025:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789996356.723407:0:13025:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4173739f0fc8044c 00000020:00000080:2.0:1789996356.723414:0:13025:0:(genops.c:885:class_export_put()) final put ffff8e087995f800/lustre-MDD0000_UUID 00000020:01000000:2.0:1789996356.723419:0:13025:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:2.0:1789996356.723424:0:13025:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789996356.723428:0:13025:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1789996356.723432:0:13025:0:(genops.c:1557:class_disconnect_exports()) OBD device 6 (ffff8e0879954d40) has no exports 00000020:00000080:2.0:1789996356.723453:0:13025:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789996356.723456:0:13025:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:2.0:1789996356.723459:0:13025:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4173739f0fc80453 00000020:00000080:2.0:1789996356.723463:0:13025:0:(genops.c:885:class_export_put()) final put ffff8e087995a000/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1789996356.723470:0:13025:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8e08709bf800 from lustre-MDT0000, refs=3 00000020:01000004:2.0:1789996356.723473:0:13025:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e08709bf800 3 00000020:01000004:2.0:1789996356.723477:0:13025:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8e08709bf800 from lustre-MDT0000 00000020:00000080:2.0:1789996356.723495:0:13025:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789996356.723499:0:13025:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:2.0:1789996356.723501:0:13025:0:(genops.c:885:class_export_put()) final put ffff8e087995c800/lustre-MDT0000_UUID 00000020:00000080:2.0:1789996356.723503:0:13025:0:(genops.c:844:class_export_destroy()) destroying export ffff8e087995c800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:2.0:1789996356.723514:0:13025:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:2.0:1789996356.723538:0:13025:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:2.0:1789996356.723562:0:13025:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:2.0:1789996356.723565:0:13025:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:2.0:1789996356.723568:0:13025:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789996356.723570:0:13025:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1789996356.723577:0:13025:0:(genops.c:1818:print_export_data()) MGS: ACTIVE ffff8e08709d3800 e0c28cd8-555e-481f-bd03-c3b02aee51c5 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789996356.723581:0:13025:0:(genops.c:1552:class_disconnect_exports()) OBD device 1 (ffff8e08545d0000) has exports, disconnecting them 00000020:00080000:2.0:1789996356.723592:0:13025:0:(genops.c:1527:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff8e08709d3800), last request at 1789996147 00000020:00000080:2.0:1789996356.723609:0:13025:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4173739f0fc803f1 00000020:00010000:2.0:1789996356.723612:0:13025:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8e08709d3800: total 4 00000100:00080000:2.0:1789996356.723616:0:13025:0:(import.c:65:import_set_state_nolock()) ffff8e08709d3000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1789996356.723638:0:13025:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8e08709d3800): rc 0 00000020:00080000:2.0:1789996356.723643:0:13025:0:(genops.c:1557:class_disconnect_exports()) OBD device 1 (ffff8e08545d0000) has no exports 00000100:00100000:2.0:1789996356.723737:0:5839:0:(service.c:3188:ptlrpc_main()) ll_mgs_0000: service thread [ffff8e084748c800:5839] 0 exiting: rc = 1 00000020:00000080:0.0:1789996356.723929:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8e07412ad800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000100:00100000:0.0:1789996356.723958:0:5841:0:(service.c:3188:ptlrpc_main()) ll_mgs_0002: service thread [ffff8e0849c08800:5841] 2 exiting: rc = 0 00000020:00000080:0.0:1789996356.724011:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8e0847d04800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1789996356.724018:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e0847d07000 for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1789996356.724023:0:37:0:(genops.c:885:class_export_put()) final put ffff8e0847d05000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789996356.724025:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8e0847d05000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1789996356.724029:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789996356.724151:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8e087995f800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:0.0:1789996356.724155:0:37:0:(genops.c:885:class_export_put()) final put ffff8e0879958800/lustre-MDD0000_UUID 00000020:00000080:0.0:1789996356.724158:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8e0879958800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:0.0:1789996356.724161:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:0.0:1789996356.724293:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8e087995a000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00010000:3.0:1789996356.724495:0:13027:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8e08709d3800: total 0 00010000:00010000:3.0:1789996356.724528:0:13027:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8e08709d3800, canceled 0 locks, left on hash table 8. 00000100:00100000:2.0:1789996356.724602:0:5840:0:(service.c:3188:ptlrpc_main()) ll_mgs_0001: service thread [ffff8e0849c09c00:5840] 1 exiting: rc = 0 00000100:00100000:0.0:1789996356.724733:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.724741:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.724748:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.724754:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.724760:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.724767:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.724772:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.724779:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.724786:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.724792:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.724799:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.724805:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.724810:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.724817:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.724823:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.724829:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.724839:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.724845:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.724850:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.724858:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.724864:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.724870:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.724882:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.724887:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.724893:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.724898:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.724904:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.724909:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.724915:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.724921:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.724926:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.724932:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.724937:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.724942:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.724947:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.724953:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.724958:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.724964:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.724969:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.724975:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.724980:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.724985:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.724991:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.724996:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.725001:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.725006:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.725012:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.725017:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.725022:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.725028:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.725033:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.725038:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.725043:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.725048:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.725054:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.725059:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.725064:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.725087:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.725092:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.725098:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.725103:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.725109:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.725114:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:3.0:1789996356.725224:0:13027:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e0840031800/0x4173739f0fc80701 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4173739f0fc806fa expref: 9 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996356.725242:0:13027:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e0841524a00/0x4173739f0fc8070f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4173739f0fc80708 expref: 8 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996356.725253:0:13027:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e0841524c00/0x4173739f0fc8071d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4173739f0fc80716 expref: 7 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996356.725273:0:13027:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e0876a23200/0x4173739f0fc8072b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4173739f0fc80724 expref: 6 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996356.725282:0:13027:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e08429c6c00/0x4173739f0fc80509 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4173739f0fc80502 expref: 5 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996356.725299:0:13027:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e087f856000/0x4173739f0fc80946 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4173739f0fc8093f expref: 4 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996356.725309:0:13027:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e0840030600/0x4173739f0fc80755 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4173739f0fc8074e expref: 3 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996356.725321:0:13027:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e0842de5400/0x4173739f0fc80954 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4173739f0fc8094d expref: 2 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996356.725331:0:13027:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8e08709d3800, canceled 8 locks, left on hash table 0. 00000020:00000080:3.0:1789996356.725347:0:13027:0:(genops.c:885:class_export_put()) final put ffff8e08709d3800/e0c28cd8-555e-481f-bd03-c3b02aee51c5 00000100:00100000:0.0:1789996356.725456:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:0.0:1789996356.725867:0:13025:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1789996356.725871:0:13025:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00010000:00010000:3.0:1789996356.726335:0:13027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789996356.726338:0:13027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789996356.726341:0:13027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789996356.727023:0:12638:0:(genops.c:844:class_export_destroy()) destroying export ffff8e08709d3800/e0c28cd8-555e-481f-bd03-c3b02aee51c5 for MGS 00000020:00000080:2.0:1789996356.727083:0:12638:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e08709d3000 for MGS 00000020:01000000:1.0:1789996356.727153:0:13025:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8e087f9473c0 - data ffff8e086a4635e8/ffff8e0877ad9400 00000020:01000000:1.0:1789996356.727246:0:13025:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8e084750f660 - data ffff8e085884ed80/ffff8e0849c33800 00000020:00000080:1.0:1789996356.727695:0:13025:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4173739f0fc803d5 00000020:00000080:1.0:1789996356.727703:0:13025:0:(genops.c:885:class_export_put()) final put ffff8e0842d99000/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1789996356.727715:0:13025:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8e08709bf800 from MGS, refs=2 00000020:01000004:1.0:1789996356.727718:0:13025:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e08709bf800 2 00000020:01000004:1.0:1789996356.727722:0:13025:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8e08709bf800 from MGS 00000020:00000080:1.0:1789996356.727743:0:13025:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789996356.727749:0:13025:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1789996356.727752:0:13025:0:(genops.c:885:class_export_put()) final put ffff8e0842d99800/MGS 00000020:00000080:1.0:1789996356.727754:0:13025:0:(genops.c:844:class_export_destroy()) destroying export ffff8e0842d99800/MGS for MGS 00000020:01000000:1.0:1789996356.727758:0:13025:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1789996356.727809:0:13025:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1789996356.727813:0:13025:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789996356.727818:0:13025:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1789996356.727823:0:13025:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff8e08705c8800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789996356.727841:0:13025:0:(genops.c:1552:class_disconnect_exports()) OBD device 8 (ffff8e087665cd40) has exports, disconnecting them 00000020:00080000:1.0:1789996356.727845:0:13025:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff8e08705c8800), last request at 1789996147 00000020:00000080:1.0:1789996356.727849:0:13025:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4173739f0fc804a0 00000020:00080000:1.0:1789996356.727855:0:13025:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8e08705c8800): rc 0 00000020:00000080:1.0:1789996356.727859:0:13025:0:(genops.c:885:class_export_put()) final put ffff8e08705c8800/lustre-MDT0000-lwp-MDT0000 00010000:01000000:1.0:1789996356.728381:0:13025:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:1.0:1789996356.728386:0:13025:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789996356.728390:0:13025:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1789996356.728395:0:13025:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789996356.728508:0:13025:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789996356.728513:0:13025:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:1.0:1789996356.728517:0:13025:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e08709bf800 1 00000020:00000080:1.0:1789996356.728521:0:13025:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4173739f0fc803c7 00000020:00000080:1.0:1789996356.728525:0:13025:0:(genops.c:885:class_export_put()) final put ffff8e0842d98000/lustre-MDT0000-osd_UUID 00000020:01000000:1.0:1789996356.728529:0:13025:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:1.0:1789996356.728532:0:13025:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789996356.728535:0:13025:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1789996356.728537:0:13025:0:(genops.c:1557:class_disconnect_exports()) OBD device 0 (ffff8e08545d4d40) has no exports 00000020:00000080:2.0:1789996356.728691:0:12638:0:(genops.c:844:class_export_destroy()) destroying export ffff8e0842d99000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1789996356.728699:0:12638:0:(genops.c:844:class_export_destroy()) destroying export ffff8e08705c8800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1789996356.728705:0:12638:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e08705ce800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1789996356.728710:0:12638:0:(genops.c:885:class_export_put()) final put ffff8e0880aa5000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1789996356.728712:0:12638:0:(genops.c:844:class_export_destroy()) destroying export ffff8e0880aa5000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:2.0:1789996356.728715:0:12638:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:2.0:1789996356.728757:0:12638:0:(genops.c:844:class_export_destroy()) destroying export ffff8e0842d98000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1789996356.739256:0:13025:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789996356.739272:0:13025:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:0.0:1789996356.739278:0:13025:0:(genops.c:885:class_export_put()) final put ffff8e0842d9e000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1789996356.739282:0:13025:0:(genops.c:844:class_export_destroy()) destroying export ffff8e0842d9e000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1789996356.739288:0:13025:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:0.0:1789996356.739429:0:13025:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8e0842d9d000 00000020:01000000:0.0:1789996356.739450:0:13025:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:0.0:1789996356.739454:0:13025:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789996356.739457:0:13025:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1789996356.739461:0:13025:0:(genops.c:1557:class_disconnect_exports()) OBD device 3 (ffff8e0849c7b380) has no exports 00000100:00100000:0.0:1789996356.739530:0:5848:0:(service.c:3188:ptlrpc_main()) mdt00_002: service thread [ffff8e0849c8ec00:5848] 2 exiting: rc = 0 00000100:00100000:0.0:1789996356.739642:0:5846:0:(service.c:3188:ptlrpc_main()) mdt00_000: service thread [ffff8e0849c8d200:5846] 0 exiting: rc = 1 00000100:00100000:0.0:1789996356.742165:0:9163:0:(service.c:3188:ptlrpc_main()) mdt00_003: service thread [ffff8e087fa07200:9163] 3 exiting: rc = 0 00000100:00100000:3.0:1789996356.742716:0:5847:0:(service.c:3188:ptlrpc_main()) mdt00_001: service thread [ffff8e0849c8f000:5847] 1 exiting: rc = 0 00000100:00100000:2.0:1789996356.743017:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.743025:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.743030:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.743036:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.743042:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.743048:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.743053:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.743078:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.743086:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.743092:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.743098:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.743103:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.743108:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.743137:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.743144:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.743149:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.743154:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.743160:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.743165:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.743171:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.743177:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.743182:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.743187:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.743193:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.743197:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.743202:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.743207:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.743212:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.743217:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.743223:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.743227:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.743232:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.743237:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.743242:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.743247:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.743252:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.743257:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.743262:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.743267:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.743272:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.743277:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.743282:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.743299:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.743304:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.743309:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.743313:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.743319:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.743325:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.743337:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.743342:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.743348:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.743354:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.743360:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.743366:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.743371:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.743377:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.743383:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.743388:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.743394:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.743400:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.743406:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.743411:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.743417:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.743432:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.752044:0:5849:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff8e0849c8ee00:5849] 0 exiting: rc = 1 00000100:00100000:3.0:1789996356.752478:0:11495:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_002: service thread [ffff8e07411c8800:11495] 2 exiting: rc = 0 00000100:00100000:1.0:1789996356.752980:0:5850:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff8e0849c8fc00:5850] 1 exiting: rc = 0 00000100:00100000:2.0:1789996356.753295:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.753305:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.753312:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.753318:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.753325:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.753331:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.753337:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.753342:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.753347:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.753352:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.753358:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.753364:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.753372:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.753377:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.753382:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.753387:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.753392:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.753397:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.753413:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.753418:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.753422:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.753427:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.753431:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.753436:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.753441:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.753445:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.753450:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.753455:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.753460:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.753465:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.753470:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.753475:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.753481:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.753486:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.753491:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.753496:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.753501:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.753506:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.753511:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.753516:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.753522:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.753528:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.753533:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.753538:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.753572:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.753578:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.753583:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.753588:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.753592:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.753598:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.753603:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.753608:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.753613:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.753627:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.753632:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.753636:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.753641:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.753646:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.753651:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.753657:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.753662:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.753667:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.753672:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.753682:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.754330:0:5852:0:(service.c:3188:ptlrpc_main()) mdt_out00_001: service thread [ffff8e0849c8f200:5852] 1 exiting: rc = 0 00000100:00100000:1.0:1789996356.755235:0:5851:0:(service.c:3188:ptlrpc_main()) mdt_out00_000: service thread [ffff8e0849c8e200:5851] 0 exiting: rc = 1 00000100:00100000:2.0:1789996356.755393:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.755402:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.755408:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.755414:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.755421:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.755428:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.755433:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.755438:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.755444:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.755451:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.755468:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.755475:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.755481:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.755487:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.755493:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.755500:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.755507:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.755512:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.755518:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.755524:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.755529:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.755535:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.755571:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.755579:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.755594:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.755600:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.755609:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.755615:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.755620:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.755626:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.755632:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.755638:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.755643:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.755649:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.755669:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.755678:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.755684:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.755690:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.755696:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.755702:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.755707:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.755713:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.755719:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.755728:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.755733:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.755739:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.755755:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.755761:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.755767:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.755772:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.755779:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.755784:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.755790:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.755795:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.755801:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.755805:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.755810:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.755814:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.755831:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.755842:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.755848:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.755853:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.755859:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.755870:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.764672:0:5854:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0001: service thread [ffff8e0849103400:5854] 1 exiting: rc = 0 00000100:00100000:3.0:1789996356.764936:0:5853:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0000: service thread [ffff8e0849c0fe00:5853] 0 exiting: rc = 1 00000100:00100000:2.0:1789996356.765222:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.765229:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.765234:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.765239:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.765244:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.765248:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.765253:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.765258:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.765263:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.765268:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.765274:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.765279:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.765294:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.765300:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.765304:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.765310:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.765314:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.765319:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.765324:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.765331:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.765336:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.765340:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.765345:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.765351:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.765356:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.765360:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.765366:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.765372:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.765377:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.765396:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.765400:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.765405:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.765410:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.765415:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.765421:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.765427:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.765432:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.765436:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.765442:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.765448:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.765452:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.765457:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.765462:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.765468:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.765474:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.765479:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.765485:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.765489:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.765494:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.765499:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.765504:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.765509:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.765514:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.765518:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.765523:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.765528:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.765533:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.765539:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.765572:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.765577:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.765581:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.765586:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.765591:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.765596:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.765907:0:5855:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0000: service thread [ffff8e0849102400:5855] 0 exiting: rc = 1 00000100:00100000:1.0:1789996356.766578:0:5856:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0001: service thread [ffff8e0849103a00:5856] 1 exiting: rc = 0 00000100:00100000:0.0:1789996356.768294:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.768304:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.768310:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.768314:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.768319:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.768324:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.768329:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.768334:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.768339:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.768345:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.768360:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.768366:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.768371:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.768376:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.768381:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.768385:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.768391:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.768396:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.768400:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.768405:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.768411:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.768416:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.768421:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.768426:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.768431:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.768437:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.768443:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.768448:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.768453:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.768458:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.768463:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.768468:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.768473:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.768478:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.768483:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.768488:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.768493:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.768498:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.768503:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.768508:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.768513:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.768518:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.768524:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.768528:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.768533:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.768702:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.768708:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.768713:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.768718:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.768723:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.768728:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.768733:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.768737:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.768741:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.768745:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.768750:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.768755:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.768760:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.768765:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.768770:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.768775:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.768779:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.768783:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.768789:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.769300:0:5857:0:(service.c:3188:ptlrpc_main()) mdt_fld_0000: service thread [ffff8e086d4c2200:5857] 0 exiting: rc = 1 00000100:00100000:0.0:1789996356.769575:0:5858:0:(service.c:3188:ptlrpc_main()) mdt_fld_0001: service thread [ffff8e0849c86600:5858] 1 exiting: rc = 0 00000100:00100000:0.0:1789996356.769623:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.769629:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.769634:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.769640:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.769645:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.769650:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.769654:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.769658:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.769663:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.769668:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.769673:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.769678:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.769683:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.769688:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.769693:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.769706:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.769711:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.769716:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.769721:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.769725:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.769730:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.769736:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.769741:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.769745:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.769750:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.769755:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.769761:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.769766:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.769771:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.769775:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.769780:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.769785:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.769789:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.769794:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.769799:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.769804:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.769810:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.769815:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.769821:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.769826:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.769830:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.769836:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.769841:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.769846:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.769851:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.769856:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.769861:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.769866:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.769872:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.769877:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.769888:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.769894:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.769899:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.769903:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.769908:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.769913:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.769918:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.769923:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.769928:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.769933:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.769938:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.769943:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.769948:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.769952:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996356.770938:0:5859:0:(service.c:3188:ptlrpc_main()) mdt_io00_000: service thread [ffff8e0849c87400:5859] 0 exiting: rc = 1 00000100:00100000:0.0:1789996356.771358:0:5861:0:(service.c:3188:ptlrpc_main()) mdt_io00_002: service thread [ffff8e0849c86400:5861] 2 exiting: rc = 0 00000100:00100000:2.0:1789996356.771459:0:5860:0:(service.c:3188:ptlrpc_main()) mdt_io00_001: service thread [ffff8e0849c87e00:5860] 1 exiting: rc = 0 00000100:00100000:0.0:1789996356.771570:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.771578:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.771585:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.771590:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.771595:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.771601:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.771608:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.771613:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.771619:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.771624:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.771630:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.771637:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.771643:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.771650:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.771656:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.771663:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.771668:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.771674:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.771680:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.771685:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.771701:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.771707:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.771727:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.771734:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.771740:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.771747:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.771753:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.771759:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.771765:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.771770:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.771776:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.771781:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.771787:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.771792:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.771798:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.771804:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.771809:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.771815:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.771821:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.771826:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.771833:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.771838:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.771844:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.771850:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.771857:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.771863:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.771884:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.771891:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.771897:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.771903:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.771909:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.771915:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.771921:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.771927:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.771933:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.771942:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.771948:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.771953:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.771965:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.771971:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.771978:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.771983:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.771990:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996356.771996:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1789996356.775833:0:13025:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789996356.775846:0:13025:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:0.0:1789996356.775852:0:13025:0:(genops.c:885:class_export_put()) final put ffff8e0849c2a800/MDS_uuid 00000020:00000080:0.0:1789996356.775856:0:13025:0:(genops.c:844:class_export_destroy()) destroying export ffff8e0849c2a800/MDS_uuid for MDS 00000020:01000000:0.0:1789996356.775862:0:13025:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:0.0:1789996356.775977:0:13025:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:0.0:1789996356.968811:0:13026:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789996357.690469:0:6715:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789996357.690479:0:6715:0:(genops.c:885:class_export_put()) final put ffff8e087f9e5800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789996357.690588:0:12638:0:(genops.c:844:class_export_destroy()) destroying export ffff8e087f9e5800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1789996357.690633:0:12638:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e087f9e1800 for lustre-OST0000 00010000:00010000:0.0:1789996357.994849:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789996359.018422:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1789996359.178432:0:13181:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:3.0:1789996359.188764:0:13181:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0000 00010000:00010000:3.0:1789996359.188821:0:13181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.137@tcp lock: ffff8e0840031a00/0x4173739f0fc80716 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc8071d expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996359.188854:0:13181:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.137@tcp lock: ffff8e0840031a00/0x4173739f0fc80716 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x4173739f0fc8071d expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996359.188862:0:13181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.137@tcp lock: ffff8e0840031a00/0x4173739f0fc80716 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x4173739f0fc8071d expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996359.188869:0:13181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.137@tcp lock: ffff8e0840031a00/0x4173739f0fc80716 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x4173739f0fc8071d expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996359.188894:0:13181:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1789996359.188899:0:13181:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1789996359.188921:0:13181:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00010000:00010000:2.0:1789996359.188922:0:13027:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:3.0:1789996359.188926:0:13181:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00010000:00010000:2.0:1789996359.188931:0:13027:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.137@tcp lock: ffff8e0840031a00/0x4173739f0fc80716 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x4173739f0fc8071d expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1789996359.188933:0:13181:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1789996359.188941:0:13181:0:(import.c:65:import_set_state_nolock()) ffff8e087f9e2800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00010000:00010000:2.0:1789996359.188944:0:13027:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0840031a00 already unused, calling callback (ffffffffc1be0c20) 00000100:00080000:3.0:1789996359.188948:0:13181:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789996359.188951:0:13181:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1789996359.188954:0:13181:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:00010000:2.0:1789996359.188955:0:13027:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.137@tcp lock: ffff8e0840031a00/0x4173739f0fc80716 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x4173739f0fc8071d expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996359.188967:0:13027:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.137@tcp lock: ffff8e0840031a00/0x4173739f0fc80716 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x4173739f0fc8071d expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789996359.188976:0:13027:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.137@tcp lock: ffff8e0840031a00/0x4173739f0fc80716 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x4173739f0fc8071d expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789996359.188991:0:13027:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789996359.188994:0:13027:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1789996359.188997:0:13027:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1789996359.189049:0:13027:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.137@tcp lock: ffff8e0840031a00/0x4173739f0fc80716 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x4173739f0fc8071d expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996359.189057:0:13027:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789996359.189101:0:13027:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.137@tcp lock: ffff8e0840031a00/0x4173739f0fc80716 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x4173739f0fc8071d expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996359.189109:0:13027:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.137@tcp lock: ffff8e0840031a00/0x4173739f0fc80716 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x4173739f0fc8071d expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996359.189131:0:13027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789996359.189133:0:13027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789996359.189135:0:13027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789996359.189152:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086faedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e0c28cd8-555e-481f-bd03-c3b02aee51c5:3315:1876946942246912:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789996359.189219:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996359.189301:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942246912 00000100:00100000:2.0:1789996359.189309:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942246912 00000100:00100000:2.0:1789996359.189405:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789996359.189413:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086faece00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3315:x1876946942246912:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1789996359.189419:0:5833:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789996359 with bad export cookie 4716240361788802033 00010000:00010000:3.0:1789996359.189819:0:13181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.137@tcp lock: ffff8e0841524000/0x4173739f0fc80724 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc8072b expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996359.189830:0:13181:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.137@tcp lock: ffff8e0841524000/0x4173739f0fc80724 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x4173739f0fc8072b expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996359.189837:0:13181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.137@tcp lock: ffff8e0841524000/0x4173739f0fc80724 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x4173739f0fc8072b expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996359.189844:0:13181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.137@tcp lock: ffff8e0841524000/0x4173739f0fc80724 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x4173739f0fc8072b expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996359.189873:0:13181:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789996359.189880:0:13181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.137@tcp lock: ffff8e0876a23c00/0x4173739f0fc8094d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc80954 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996359.189887:0:13181:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.137@tcp lock: ffff8e0876a23c00/0x4173739f0fc8094d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4173739f0fc80954 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996359.189893:0:13181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.137@tcp lock: ffff8e0876a23c00/0x4173739f0fc8094d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x4173739f0fc80954 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996359.189899:0:13181:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.137@tcp lock: ffff8e0876a23c00/0x4173739f0fc8094d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x4173739f0fc80954 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996359.189911:0:13181:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1789996359.189915:0:13181:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:3.0:1789996359.189930:0:13181:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0000 00000020:01000000:3.0:1789996359.189933:0:13181:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:3.0:1789996359.189938:0:13181:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789996359.189943:0:13181:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1789996359.189947:0:13181:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff8e0879950000) has no exports 00000020:00080000:3.0:1789996359.189969:0:13181:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff8e0879950000) has no exports 00010000:00010000:1.0:1789996359.190483:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789996359.190491:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.137@tcp lock: ffff8e0841524000/0x4173739f0fc80724 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x4173739f0fc8072b expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996359.190500:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0841524000 already unused, calling callback (ffffffffc1be0c20) 10000000:00010000:1.0:1789996359.190504:0:5835:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.137@tcp lock: ffff8e0841524000/0x4173739f0fc80724 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x4173739f0fc8072b expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996359.190519:0:5835:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.137@tcp lock: ffff8e0841524000/0x4173739f0fc80724 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x4173739f0fc8072b expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789996359.190527:0:5835:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.137@tcp lock: ffff8e0841524000/0x4173739f0fc80724 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x4173739f0fc8072b expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789996359.190533:0:5835:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789996359.190535:0:5835:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:1.0:1789996359.190537:0:5835:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:1.0:1789996359.190585:0:5835:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.137@tcp lock: ffff8e0841524000/0x4173739f0fc80724 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x4173739f0fc8072b expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996359.190591:0:5835:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789996359.190610:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.137@tcp lock: ffff8e0841524000/0x4173739f0fc80724 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x4173739f0fc8072b expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996359.190617:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.137@tcp lock: ffff8e0841524000/0x4173739f0fc80724 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x4173739f0fc8072b expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996359.190627:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789996359.190631:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.137@tcp lock: ffff8e0876a23c00/0x4173739f0fc8094d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x4173739f0fc80954 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996359.190637:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0876a23c00 already unused, calling callback (ffffffffc1be0c20) 10000000:00010000:1.0:1789996359.190640:0:5835:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.137@tcp lock: ffff8e0876a23c00/0x4173739f0fc8094d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x4173739f0fc80954 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996359.190647:0:5835:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.137@tcp lock: ffff8e0876a23c00/0x4173739f0fc8094d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x4173739f0fc80954 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789996359.190663:0:5835:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.137@tcp lock: ffff8e0876a23c00/0x4173739f0fc8094d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x4173739f0fc80954 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789996359.190668:0:5835:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1789996359.190670:0:5835:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1789996359.190672:0:5835:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1789996359.190685:0:5835:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.137@tcp lock: ffff8e0876a23c00/0x4173739f0fc8094d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x4173739f0fc80954 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996359.190690:0:5835:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789996359.190704:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.137@tcp lock: ffff8e0876a23c00/0x4173739f0fc8094d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x4173739f0fc80954 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996359.190710:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.137@tcp lock: ffff8e0876a23c00/0x4173739f0fc8094d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x4173739f0fc80954 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996359.190719:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789996359.190721:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789996359.190723:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789996359.190731:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789996359.190743:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fc9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e0c28cd8-555e-481f-bd03-c3b02aee51c5:3314:1876946942247168:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789996359.190790:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996359.190835:0:8520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942247168 00000100:00100000:1.0:1789996359.190842:0:8520:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942247168 00000100:00100000:1.0:1789996359.190872:0:8520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789996359.190877:0:8520:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0870599050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3314:x1876946942247168:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1789996359.190882:0:8520:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789996359 with bad export cookie 4716240361788802033 00000100:00100000:1.0:1789996359.190920:0:8520:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0870599050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3314:x1876946942247168:12345-0@lo:103:ldlm_bl.0 Request processed in 42us (130us total) trans 0 rc -107/-107 00000100:00100000:1.0:1789996359.190935:0:8520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:1.0:1789996359.190974:0:3314:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.204.137@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1789996359.190979:0:3314:0:(import.c:65:import_set_state_nolock()) ffff8e0842d9a800 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1789996359.190982:0:3314:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.204.137@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00010000:00010000:0.0:1789996359.191110:0:13026:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1789996359.194391:0:13181:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8e0877b47240 - data ffff8e085884ee58/ffff8e08811d4c00 00000020:01000000:3.0:1789996359.194572:0:13181:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8e0846778ea0 - data ffff8e086a40daf8/ffff8e07413e3400 00000100:00080000:1.0:1789996359.207536:0:3314:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.204.137@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1789996359.207616:0:3314:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1789996359.207628:0:3314:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8e086faedf80 x1876946942246912/t0(0) o103->MGC192.168.204.137@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789996375 ref 1 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789996359.207651:0:3314:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8e086fc9b480 x1876946942247168/t0(0) o103->MGC192.168.204.137@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789996375 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789996359.207680:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fc98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e0c28cd8-555e-481f-bd03-c3b02aee51c5:0:1876946942247040:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789996359.207931:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086faedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e0c28cd8-555e-481f-bd03-c3b02aee51c5:3315:1876946942246912:0@lo:103:ldlm_bl.0 10000000:01000000:1.0:1789996359.207957:0:3314:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1789996359.207961:0:3314:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1789996359.207963:0:3314:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1789996359.207967:0:3314:0:(import.c:65:import_set_state_nolock()) ffff8e0842d9a800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789996359.207973:0:3314:0:(import.c:545:import_select_connection()) MGC192.168.204.137@tcp: connect to NID 0@lo last attempt 188 00000100:00080000:1.0:1789996359.207986:0:3314:0:(import.c:666:import_select_connection()) MGC192.168.204.137@tcp: import ffff8e0842d9a800 using connection 192.168.204.137@tcp/0@lo 00000100:00100000:1.0:1789996359.208013:0:3314:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e086fc98380 x1876946942247296/t0(0) o250->MGC192.168.204.137@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789996359.208059:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fc9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e0c28cd8-555e-481f-bd03-c3b02aee51c5:3314:1876946942247168:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789996359.208180:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fc98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e0c28cd8-555e-481f-bd03-c3b02aee51c5:3312:1876946942247296:0@lo:250:ptlrpcd_00_01.0 00000400:00000100:3.0:1789996359.208222:0:3312:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876946942247296 offset 0 length 520: 4 00000400:00000100:2.0:1789996359.215293:0:5833:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 18 match 1876946942246912 offset 224 length 224: 4 00000100:00100000:2.0:1789996359.215325:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086faece00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3315:x1876946942246912:12345-0@lo:103:ldlm_bl.0 Request processed in 25910us (26105us total) trans 0 rc -107/-107 00000100:00100000:2.0:1789996359.215337:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00100000:10000000:3.0:1789996359.226428:0:13181:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1789996359.255866:0:13181:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4173739f0fc80525 00000020:00000080:3.0:1789996359.255878:0:13181:0:(genops.c:885:class_export_put()) final put ffff8e087f9e6800/lustre-OST0000-osd_UUID 00000020:01000004:3.0:1789996359.255899:0:13181:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8e0849c2f000 from lustre-OST0000, refs=2 00000020:01000004:3.0:1789996359.255904:0:13181:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e0849c2f000 2 00000020:01000004:3.0:1789996359.255907:0:13181:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8e0849c2f000 from lustre-OST0000 00000020:00000080:3.0:1789996359.255933:0:13181:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789996359.255942:0:13181:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:3.0:1789996359.255945:0:13181:0:(genops.c:885:class_export_put()) final put ffff8e087f9e7000/lustre-OST0000_UUID 00000020:00000080:3.0:1789996359.255947:0:13181:0:(genops.c:844:class_export_destroy()) destroying export ffff8e087f9e7000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:3.0:1789996359.255954:0:13181:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:3.0:1789996359.255997:0:13181:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:3.0:1789996359.256002:0:13181:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1789996359.256006:0:13181:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789996359.256011:0:13181:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1789996359.256017:0:13181:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff8e087f9e2000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789996359.256032:0:13181:0:(genops.c:1552:class_disconnect_exports()) OBD device 12 (ffff8e08545d3380) has exports, disconnecting them 00000020:00080000:3.0:1789996359.256038:0:13181:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff8e087f9e2000), last request at 1789996165 00000020:00000080:3.0:1789996359.256042:0:13181:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4173739f0fc8054f 00000020:00080000:3.0:1789996359.256052:0:13181:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8e087f9e2000): rc 0 00000020:00000080:3.0:1789996359.256056:0:13181:0:(genops.c:885:class_export_put()) final put ffff8e087f9e2000/lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1789996359.256246:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8e087f9e6800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1789996359.256257:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8e087f9e2000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:2.0:1789996359.257612:0:13181:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:2.0:1789996359.257617:0:13181:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789996359.257622:0:13181:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1789996359.257627:0:13181:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789996359.257773:0:13181:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789996359.257780:0:13181:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:2.0:1789996359.257785:0:13181:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e0849c2f000 1 00000020:00000080:2.0:1789996359.257791:0:13181:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4173739f0fc804df 00000020:00000080:2.0:1789996359.257797:0:13181:0:(genops.c:885:class_export_put()) final put ffff8e08705cb000/lustre-OST0000-osd_UUID 00000020:01000000:2.0:1789996359.257802:0:13181:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:2.0:1789996359.257806:0:13181:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789996359.257810:0:13181:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1789996359.257814:0:13181:0:(genops.c:1557:class_disconnect_exports()) OBD device 9 (ffff8e0849c78000) has no exports 00000020:00000080:1.0:1789996359.258497:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e087f9e2800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1789996359.258506:0:37:0:(genops.c:885:class_export_put()) final put ffff8e087f9e0000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:1.0:1789996359.258508:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8e087f9e0000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:1.0:1789996359.258514:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:1.0:1789996359.258593:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8e08705cb000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1789996359.280519:0:13181:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789996359.280535:0:13181:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:1.0:1789996359.280561:0:13181:0:(genops.c:885:class_export_put()) final put ffff8e0880ad9000/lustre-OST0000-osd_UUID 00000020:00000080:1.0:1789996359.280567:0:13181:0:(genops.c:844:class_export_destroy()) destroying export ffff8e0880ad9000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:1.0:1789996359.280576:0:13181:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:1.0:1789996359.280703:0:13181:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8e0846f5c000 00000020:02000400:1.0:1789996359.280749:0:13181:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0000 complete 00000100:00080000:2.0:1789996359.656810:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) e0c28cd8-555e-481f-bd03-c3b02aee51c5->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789996359.656820:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) e0c28cd8-555e-481f-bd03-c3b02aee51c5->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789996359.656823:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789996359.656826:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1789996359.656829:0:37:0:(import.c:65:import_set_state_nolock()) ffff8e0850a85000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789996359.656837:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 396 00000100:00080000:2.0:1789996359.656843:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1789996359.656854:0:37:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8e0850a85000 using connection 192.168.204.137@tcp/0@lo 00000100:00100000:2.0:1789996359.656894:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e086faece00 x1876946942247424/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789996359.657139:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086faece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3312:1876946942247424:0@lo:38:kworker.0 00000400:00000100:3.0:1789996359.657183:0:3312:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876946942247424 offset 0 length 520: 4 00010000:00010000:0.0:1789996360.048343:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789996361.064834:0:13027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789996362.093533:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1789996362.798784:0:13330:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:1.0:1789996362.816120:0:13330:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0001 00010000:00010000:1.0:1789996362.816199:0:13330:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.137@tcp lock: ffff8e0841525e00/0x4173739f0fc806fa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc80701 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996362.816215:0:13330:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.137@tcp lock: ffff8e0841525e00/0x4173739f0fc806fa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4173739f0fc80701 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996362.816222:0:13330:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.137@tcp lock: ffff8e0841525e00/0x4173739f0fc806fa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x4173739f0fc80701 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996362.816229:0:13330:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.137@tcp lock: ffff8e0841525e00/0x4173739f0fc806fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x4173739f0fc80701 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996362.816254:0:13330:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1789996362.816260:0:13330:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1789996362.816282:0:13330:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789996362.816294:0:13330:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8e086faece00 x1876946942247424/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789996374 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1789996362.816376:0:13026:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789996362.816383:0:13026:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.137@tcp lock: ffff8e0841525e00/0x4173739f0fc806fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x4173739f0fc80701 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996362.816391:0:13026:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0841525e00 already unused, calling callback (ffffffffc1be0c20) 10000000:00010000:0.0:1789996362.816394:0:13026:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.137@tcp lock: ffff8e0841525e00/0x4173739f0fc806fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x4173739f0fc80701 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996362.816403:0:13026:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.137@tcp lock: ffff8e0841525e00/0x4173739f0fc806fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x4173739f0fc80701 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789996362.816430:0:13026:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.137@tcp lock: ffff8e0841525e00/0x4173739f0fc806fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x4173739f0fc80701 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789996362.816436:0:13026:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789996362.816438:0:13026:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1789996362.816440:0:13026:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1789996362.816453:0:13026:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8e0842d9a800 00010000:00010000:0.0:1789996362.816457:0:13026:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.137@tcp lock: ffff8e0841525e00/0x4173739f0fc806fa lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x4173739f0fc80701 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996362.816464:0:13026:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.137@tcp lock: ffff8e0841525e00/0x4173739f0fc806fa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x4173739f0fc80701 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996362.816475:0:13026:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789996362.816477:0:13026:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789996362.816479:0:13026:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789996362.816800:0:13330:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1789996362.816877:0:13330:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1789996362.816884:0:13330:0:(import.c:65:import_set_state_nolock()) ffff8e0850a85000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1789996362.816890:0:13330:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789996362.816894:0:13330:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8e086faece00 x1876946942247424/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789996374 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789996362.819397:0:13330:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1789996362.820474:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086faece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3312:1876946942247424:0@lo:38:kworker.0 00000100:00100000:0.0:1789996362.821238:0:13330:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1789996362.822488:0:13330:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.137@tcp lock: ffff8e0842de5600/0x4173739f0fc80708 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc8070f expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996362.822505:0:13330:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.137@tcp lock: ffff8e0842de5600/0x4173739f0fc80708 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4173739f0fc8070f expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996362.822531:0:13330:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.137@tcp lock: ffff8e0842de5600/0x4173739f0fc80708 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x4173739f0fc8070f expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996362.822538:0:13330:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.137@tcp lock: ffff8e0842de5600/0x4173739f0fc80708 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x4173739f0fc8070f expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996362.822844:0:13330:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789996362.822854:0:13330:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.137@tcp lock: ffff8e0876a22400/0x4173739f0fc8093f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc80946 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996362.822861:0:13330:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.137@tcp lock: ffff8e0876a22400/0x4173739f0fc8093f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4173739f0fc80946 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996362.822867:0:13330:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.137@tcp lock: ffff8e0876a22400/0x4173739f0fc8093f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x4173739f0fc80946 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996362.822874:0:13330:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.137@tcp lock: ffff8e0876a22400/0x4173739f0fc8093f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x4173739f0fc80946 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996362.822904:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789996362.822969:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.137@tcp lock: ffff8e0842de5600/0x4173739f0fc80708 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x4173739f0fc8070f expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996362.822989:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0842de5600 already unused, calling callback (ffffffffc1be0c20) 10000000:00010000:1.0:1789996362.822993:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.137@tcp lock: ffff8e0842de5600/0x4173739f0fc80708 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x4173739f0fc8070f expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996362.823001:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.137@tcp lock: ffff8e0842de5600/0x4173739f0fc80708 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x4173739f0fc8070f expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789996362.823008:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.137@tcp lock: ffff8e0842de5600/0x4173739f0fc80708 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x4173739f0fc8070f expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789996362.823014:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789996362.823016:0:5834:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:1.0:1789996362.823026:0:5834:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8e0842d9a800 00010000:00010000:1.0:1789996362.823030:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.137@tcp lock: ffff8e0842de5600/0x4173739f0fc80708 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x4173739f0fc8070f expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996362.823037:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.137@tcp lock: ffff8e0842de5600/0x4173739f0fc80708 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x4173739f0fc8070f expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996362.823050:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789996362.823053:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.137@tcp lock: ffff8e0876a22400/0x4173739f0fc8093f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x4173739f0fc80946 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996362.823059:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0876a22400 already unused, calling callback (ffffffffc1be0c20) 10000000:00010000:1.0:1789996362.823062:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.137@tcp lock: ffff8e0876a22400/0x4173739f0fc8093f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x4173739f0fc80946 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996362.823069:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.137@tcp lock: ffff8e0876a22400/0x4173739f0fc8093f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x4173739f0fc80946 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789996362.823080:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.137@tcp lock: ffff8e0876a22400/0x4173739f0fc8093f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x4173739f0fc80946 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789996362.823086:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1789996362.823088:0:5834:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:1.0:1789996362.823093:0:5834:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8e0842d9a800 00010000:00010000:1.0:1789996362.823096:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.137@tcp lock: ffff8e0876a22400/0x4173739f0fc8093f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x4173739f0fc80946 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996362.823103:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789996362.823104:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789996362.823107:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789996362.823200:0:13330:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1789996362.823205:0:13330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.137@tcp lock: ffff8e0876a22400/0x4173739f0fc8093f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x4173739f0fc80946 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789996362.823219:0:13330:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:0.0:1789996362.823223:0:13330:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:0.0:1789996362.823228:0:13330:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:0.0:1789996362.823247:0:13330:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0001 00000020:01000000:0.0:1789996362.823251:0:13330:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:0.0:1789996362.823256:0:13330:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789996362.823268:0:13330:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1789996362.823271:0:13330:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff8e087f8c4d40) has no exports 00000020:00080000:0.0:1789996362.823296:0:13330:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff8e087f8c4d40) has no exports 00000020:01000000:0.0:1789996362.826828:0:13330:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8e087f82c0c0 - data ffff8e087fda2a20/ffff8e0877ad7400 00000020:01000000:0.0:1789996362.829776:0:13330:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8e0846ef1e40 - data ffff8e086a71a438/ffff8e0876a0c800 00010000:00010000:2.0:1789996362.830798:0:13027:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:0.0:1789996362.853380:0:13330:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1789996362.881942:0:13330:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4173739f0fc805f0 00000020:00000080:3.0:1789996362.881963:0:13330:0:(genops.c:885:class_export_put()) final put ffff8e0876bb7800/lustre-OST0001-osd_UUID 00000020:01000004:3.0:1789996362.881984:0:13330:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8e0847d01800 from lustre-OST0001, refs=2 00000020:01000004:3.0:1789996362.881988:0:13330:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e0847d01800 2 00000020:01000004:3.0:1789996362.881991:0:13330:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8e0847d01800 from lustre-OST0001 00000020:00000080:3.0:1789996362.882028:0:13330:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789996362.882048:0:13330:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:3.0:1789996362.882051:0:13330:0:(genops.c:885:class_export_put()) final put ffff8e0876bb1000/lustre-OST0001_UUID 00000020:00000080:3.0:1789996362.882054:0:13330:0:(genops.c:844:class_export_destroy()) destroying export ffff8e0876bb1000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:3.0:1789996362.882060:0:13330:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:3.0:1789996362.882367:0:13330:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import e0c28cd8-555e-481f-bd03-c3b02aee51c5->MGS 00010000:00010000:3.0:1789996362.882381:0:13330:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.137@tcp lock: ffff8e0841524800/0x4173739f0fc80502 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x4173739f0fc80509 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789996362.882393:0:13330:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.137@tcp lock: ffff8e0841524800/0x4173739f0fc80502 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x4173739f0fc80509 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789996362.882399:0:13330:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:3.0:1789996362.882402:0:13330:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:3.0:1789996362.882404:0:13330:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:3.0:1789996362.882416:0:13330:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8e0842d9a800 00010000:00010000:3.0:1789996362.882419:0:13330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.137@tcp lock: ffff8e0841524800/0x4173739f0fc80502 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x4173739f0fc80509 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996362.882431:0:13330:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.137@tcp lock: ffff8e0876a23600/0x4173739f0fc8074e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x4173739f0fc80755 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789996362.882438:0:13330:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.137@tcp lock: ffff8e0876a23600/0x4173739f0fc8074e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x4173739f0fc80755 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789996362.882442:0:13330:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789996362.882444:0:13330:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:3.0:1789996362.882445:0:13330:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:3.0:1789996362.882452:0:13330:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8e0842d9a800 00010000:00010000:3.0:1789996362.882455:0:13330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.137@tcp lock: ffff8e0876a23600/0x4173739f0fc8074e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x4173739f0fc80755 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1789996362.882467:0:13330:0:(import.c:65:import_set_state_nolock()) ffff8e0842d9a800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:3.0:1789996362.882476:0:13330:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1789996362.882478:0:13330:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1789996362.882479:0:13330:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1789996362.882483:0:13330:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1789996362.882493:0:13330:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8e086fc98380 x1876946942247296/t0(0) o250->MGC192.168.204.137@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1789996369 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1789996362.882507:0:13330:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1789996362.882510:0:13330:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 9s for inflight to error out 00000100:00100000:3.0:1789996362.882538:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fc98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e0c28cd8-555e-481f-bd03-c3b02aee51c5:3312:1876946942247296:0@lo:250:ptlrpcd_00_01.0 10000000:01000000:3.0:1789996362.882581:0:13330:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1789996362.882586:0:13330:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4173739f0fc803e3 00000020:00000080:3.0:1789996362.882590:0:13330:0:(genops.c:885:class_export_put()) final put ffff8e0849c2e000/e0c28cd8-555e-481f-bd03-c3b02aee51c5 00000020:01000000:3.0:1789996362.882594:0:13330:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.204.137@tcp (flags='') 00000020:00000080:3.0:1789996362.882598:0:13330:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789996362.882602:0:13330:0:(obd_config.c:956:class_cleanup()) MGC192.168.204.137@tcp: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1789996362.882605:0:13330:0:(genops.c:1557:class_disconnect_exports()) OBD device 2 (ffff8e08545d19c0) has no exports 10000000:01000000:3.0:1789996362.882617:0:5843:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:3.0:1789996362.882653:0:13330:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.204.137@tcp: client import never connected 00000100:00080000:3.0:1789996362.882655:0:13330:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:3.0:1789996362.882657:0:13330:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1789996362.882659:0:13330:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:3.0:1789996362.882661:0:13330:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1789996362.882688:0:13330:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789996362.882692:0:13330:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.204.137@tcp (uuid e0c28cd8-555e-481f-bd03-c3b02aee51c5) 00000020:01000000:3.0:1789996362.882696:0:13330:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:3.0:1789996362.882698:0:13330:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789996362.882701:0:13330:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1789996362.882706:0:13330:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff8e07412af800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789996362.882710:0:13330:0:(genops.c:1552:class_disconnect_exports()) OBD device 16 (ffff8e08766599c0) has exports, disconnecting them 00000020:00080000:3.0:1789996362.882714:0:13330:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff8e07412af800), last request at 1789996186 00000020:00000080:3.0:1789996362.882718:0:13330:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4173739f0fc8061a 00000020:00080000:3.0:1789996362.882732:0:13330:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8e07412af800): rc 0 00000020:00000080:3.0:1789996362.882735:0:13330:0:(genops.c:885:class_export_put()) final put ffff8e07412af800/lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1789996362.883959:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8e0876bb7800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:0.0:1789996362.883975:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8e0849c2e000/e0c28cd8-555e-481f-bd03-c3b02aee51c5 for MGC192.168.204.137@tcp 00000020:00000080:0.0:1789996362.883982:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e0842d9a800 for MGC192.168.204.137@tcp 00000020:00000080:0.0:1789996362.883989:0:37:0:(genops.c:885:class_export_put()) final put ffff8e0842c34800/e0c28cd8-555e-481f-bd03-c3b02aee51c5 00000020:00000080:0.0:1789996362.883991:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8e0842c34800/e0c28cd8-555e-481f-bd03-c3b02aee51c5 for MGC192.168.204.137@tcp 00000020:01000000:0.0:1789996362.883995:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.204.137@tcp (e0c28cd8-555e-481f-bd03-c3b02aee51c5) 00000020:00000080:0.0:1789996362.884267:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8e07412af800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:0.0:1789996362.889979:0:13330:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1789996362.889989:0:13330:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789996362.889993:0:13330:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789996362.890014:0:13330:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789996362.890047:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e0850a85000 for lustre-MDT0000-lwp-OST0001 00010000:00010000:0.0:1789996362.891584:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:0.0:1789996362.891687:0:13026:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:0.0:1789996362.895975:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00010000:00010000:2.0:1789996362.896466:0:13027:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-4 blwis in pool) 00000100:00100000:1.0:1789996362.897080:0:5829:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_000: service thread [ffff8e086d552600:5829] 0 exiting: rc = 1 00000100:00100000:1.0:1789996362.897149:0:5830:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_001: service thread [ffff8e08602bfe00:5830] 1 exiting: rc = 0 00000100:00100000:0.0:1789996362.897384:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789996362.897771:0:8520:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_003: service thread [ffff8e0880f69400:8520] 3 exiting: rc = 0 00000100:00100000:1.0:1789996362.897924:0:5831:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_000: service thread [ffff8e086d553200:5831] 0 exiting: rc = 1 00000100:00100000:2.0:1789996362.898312:0:5833:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_002: service thread [ffff8e086d553400:5833] 2 exiting: rc = 0 00000100:00100000:3.0:1789996362.923734:0:5832:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_001: service thread [ffff8e086d553c00:5832] 1 exiting: rc = 0 00000100:00100000:1.0:1789996362.924022:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789996362.924039:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789996362.924046:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789996362.924054:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789996362.924060:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789996362.924076:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789996362.924083:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789996362.924089:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789996362.924095:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789996362.924101:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789996362.924112:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789996362.924132:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789996362.924138:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789996362.924143:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789996362.924162:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789996362.924167:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789996362.924173:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789996362.924179:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789996362.924184:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789996362.924189:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789996362.924199:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789996362.924210:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789996362.924217:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789996362.924225:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789996362.924230:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789996362.924235:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789996362.924241:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789996362.924249:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789996362.924255:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789996362.924260:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789996362.924266:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789996362.924271:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789996362.924276:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789996362.924281:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789996362.924287:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789996362.924293:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789996362.924298:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789996362.924303:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789996362.924308:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789996362.924313:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789996362.924318:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789996362.924323:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789996362.924329:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789996362.924335:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789996362.924341:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789996362.924345:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789996362.924351:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789996362.924356:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789996362.924361:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789996362.924374:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789996362.924379:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789996362.924385:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789996362.924390:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789996362.924396:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789996362.924401:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789996362.924406:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789996362.924411:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789996362.924416:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789996362.924422:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789996362.924427:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789996362.924432:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789996362.924438:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789996362.924443:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789996362.924448:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1789996362.925759:0:13330:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789996362.925770:0:13330:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:1.0:1789996362.925775:0:13330:0:(genops.c:885:class_export_put()) final put ffff8e0876339800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:1.0:1789996362.925780:0:13330:0:(genops.c:844:class_export_destroy()) destroying export ffff8e0876339800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:1.0:1789996362.925786:0:13330:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:1.0:1789996362.925831:0:13330:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e0847d01800 1 00000020:00000080:1.0:1789996362.926513:0:13330:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x4173739f0fc805bf 00000020:00000080:1.0:1789996362.926532:0:13330:0:(genops.c:885:class_export_put()) final put ffff8e07412ae000/lustre-OST0001-osd_UUID 00000020:01000000:1.0:1789996362.926561:0:13330:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:1.0:1789996362.926566:0:13330:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789996362.926571:0:13330:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1789996362.926575:0:13330:0:(genops.c:1557:class_disconnect_exports()) OBD device 14 (ffff8e087f8c3380) has no exports 00000020:00000080:0.0:1789996362.926757:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8e07412ae000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:3.0:1789996362.991288:0:13330:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789996362.991302:0:13330:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:3.0:1789996362.991308:0:13330:0:(genops.c:885:class_export_put()) final put ffff8e08811bf000/lustre-OST0001-osd_UUID 00000020:00000080:3.0:1789996362.991312:0:13330:0:(genops.c:844:class_export_destroy()) destroying export ffff8e08811bf000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:3.0:1789996362.991326:0:13330:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:3.0:1789996362.991494:0:13330:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8e08811bd800 00000020:01000000:3.0:1789996362.991536:0:13330:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:3.0:1789996362.991559:0:13330:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789996362.991564:0:13330:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1789996362.991568:0:13330:0:(genops.c:1557:class_disconnect_exports()) OBD device 10 (ffff8e0876658000) has no exports 00000020:00000080:3.0:1789996362.991589:0:13330:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789996362.991595:0:13330:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:3.0:1789996362.991598:0:13330:0:(genops.c:885:class_export_put()) final put ffff8e08705ce000/OSS_uuid 00000020:00000080:3.0:1789996362.991601:0:13330:0:(genops.c:844:class_export_destroy()) destroying export ffff8e08705ce000/OSS_uuid for OSS 00000020:01000000:3.0:1789996362.991604:0:13330:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:3.0:1789996362.991662:0:6688:0:(service.c:3188:ptlrpc_main()) ll_ost00_000: service thread [ffff8e0880f6ec00:6688] 0 exiting: rc = 1 00000100:00080000:0.0:1789996362.998155:0:5842:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:0.0:1789996362.998307:0:8222:0:(service.c:3188:ptlrpc_main()) ll_ost00_003: service thread [ffff8e0741e88600:8222] 3 exiting: rc = 0 00000100:00100000:0.0:1789996362.998370:0:6689:0:(service.c:3188:ptlrpc_main()) ll_ost00_001: service thread [ffff8e0880f6ea00:6689] 1 exiting: rc = 0 00000100:00100000:0.0:1789996362.998414:0:6690:0:(service.c:3188:ptlrpc_main()) ll_ost00_002: service thread [ffff8e086f420e00:6690] 2 exiting: rc = 0 00000100:00100000:3.0:1789996362.998613:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996362.998627:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996362.998637:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996362.998643:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996362.998648:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996362.998654:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996362.998659:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996362.998664:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996362.998669:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996362.998674:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996362.998679:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996362.998683:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996362.998688:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996362.998693:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996362.998709:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996362.998714:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996362.998719:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996362.998724:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996362.998728:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996362.998733:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996362.998738:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996362.998743:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996362.998748:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996362.998753:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996362.998758:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996362.998763:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996362.998768:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996362.998773:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996362.998777:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996362.998782:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996362.998787:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996362.998792:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996362.998797:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996362.998802:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996362.998807:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996362.998812:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996362.998817:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996362.998822:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996362.998830:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996362.998905:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996362.998916:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996362.998921:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996362.998928:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996362.998933:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996362.998938:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996362.998944:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996362.998959:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996362.998965:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996362.998970:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996362.998984:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996362.998989:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996362.998994:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996362.998999:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996362.999004:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996362.999009:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996362.999017:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996362.999022:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996362.999029:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996362.999035:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996362.999040:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996362.999045:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996362.999050:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996362.999056:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996362.999061:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996363.000701:0:6691:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_000: service thread [ffff8e086f420800:6691] 0 exiting: rc = 1 00000100:00100000:0.0:1789996363.002616:0:6692:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_001: service thread [ffff8e08547f2c00:6692] 1 exiting: rc = 0 00000100:00100000:3.0:1789996363.002751:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.002759:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.002764:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.002769:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.002775:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.002780:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.002784:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.002789:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.002794:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.002799:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.002804:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.002810:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.002814:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.002820:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.002825:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.002830:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.002911:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.002918:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.002922:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.002928:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.002944:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.002961:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.002967:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.002972:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.002978:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.002984:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.002989:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.003008:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.003015:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.003020:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.003026:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.003031:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.003037:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.003042:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.003047:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.003052:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.003058:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.003071:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.003076:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.003082:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.003087:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.003092:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.003097:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.003103:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.003108:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.003113:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.003125:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.003132:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.003137:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.003141:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.003146:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.003153:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.003158:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.003163:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.003168:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.003181:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.003186:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.003191:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.003197:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.003202:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.003208:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.003213:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.003218:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.003223:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.004601:0:6695:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_002: service thread [ffff8e086f420400:6695] 2 exiting: rc = 0 00000100:00100000:0.0:1789996363.004988:0:6693:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_000: service thread [ffff8e086f420200:6693] 0 exiting: rc = 1 00000100:00100000:0.0:1789996363.005363:0:6694:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_001: service thread [ffff8e08547f2e00:6694] 1 exiting: rc = 0 00000100:00100000:3.0:1789996363.006505:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.006513:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.006695:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.006703:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.006711:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.006717:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.006724:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.006729:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.006734:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.006740:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.006746:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.006751:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.006757:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.006762:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.006768:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.006773:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.006779:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.006784:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.006789:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.006795:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.006800:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.006806:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.006811:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.006817:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.006822:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.008744:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.008769:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.008777:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.008782:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.008788:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.008794:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.008800:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.008806:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.008811:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.008817:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.008822:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.008827:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.008833:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.010349:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.010356:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.010361:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.010367:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.010373:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.010378:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.010383:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.010389:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.010394:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.010399:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.010404:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.010410:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.010437:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.010443:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.010448:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.010454:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.010459:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.010464:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.010470:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.010475:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.010481:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.010485:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.010503:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.010508:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.010515:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.010535:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789996363.021207:0:6696:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff8e08463e0600:6696] 0 exiting: rc = 1 00000100:00100000:0.0:1789996363.021319:0:6697:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff8e08463e1600:6697] 1 exiting: rc = 0 00000100:00100000:3.0:1789996363.021432:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.021440:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.021445:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.021450:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.021457:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.021461:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.021467:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.021472:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.021478:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.021483:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.021488:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.021493:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.021498:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.021503:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.021509:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.021513:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.021519:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.021527:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.021533:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.021538:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.021676:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.021682:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.021687:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.021692:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.021697:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.021702:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.021707:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.021712:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.021717:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.021722:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.021727:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.021743:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.021748:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.021753:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.021758:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.021762:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.021769:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.021774:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.021779:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.021784:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.021789:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.021793:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.021798:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.021803:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.021807:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.021812:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.021817:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.021821:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.021826:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.021831:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.021849:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.021855:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.021860:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.021865:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.021870:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.021875:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.021879:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.021884:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.021889:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.021894:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.021899:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.021903:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.021908:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.021919:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789996363.023175:0:6698:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_000: service thread [ffff8e08463e1e00:6698] 0 exiting: rc = 1 00000100:00100000:2.0:1789996363.023256:0:6699:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_001: service thread [ffff8e08463e0400:6699] 1 exiting: rc = 0 00000100:00100000:3.0:1789996363.023354:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.023362:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.023377:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.023383:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.023388:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.023394:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.023399:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.023405:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.023410:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.023416:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.023430:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.023437:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.023442:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.023448:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.023454:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.023459:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.023466:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.023472:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.023478:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.023483:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.023489:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.023495:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.023515:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.023522:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.023527:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.023533:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.023539:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.023746:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.023752:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.023759:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.023765:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.023771:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.023777:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.023783:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.023805:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.023813:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.023819:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.023832:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.023915:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.023921:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.023927:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.023933:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.023940:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.023958:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.023964:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.023970:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.023991:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.024013:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.024020:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.024027:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.024034:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.024040:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.024047:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.024054:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.024060:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.024078:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.024083:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.024088:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.024108:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.024116:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.024122:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.024130:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.024135:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789996363.024148:0:13330:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:3.0:1789996363.035932:0:13330:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:3.0:1789996384.199039:0:13947:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg437-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1789996393.372916:0:14423:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789996393.372922:0:14423:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:2.0:1789996393.373028:0:14423:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8e087fbc4800 00000020:01000004:2.0:1789996393.373042:0:14423:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1789996393.373049:0:14423:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1789996393.373063:0:14423:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff8e087665cd40) 00000020:00000080:2.0:1789996393.373076:0:14423:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1789996393.419905:0:14423:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:1.0:1789996393.425807:0:14423:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:1.0:1789996393.426694:0:14423:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 457: rc = 0 00100000:10000000:1.0:1789996393.426794:0:14423:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 457: rc = 0 00100000:10000000:1.0:1789996393.426888:0:14423:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 457: rc = 0 00100000:10000000:1.0:1789996393.427004:0:14423:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 457: rc = 0 00100000:10000000:1.0:1789996393.427211:0:14423:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:1.0:1789996393.427276:0:14423:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 457: rc = 0 00100000:10000000:1.0:1789996393.428689:0:14423:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 457: rc = 0 00100000:10000000:1.0:1789996393.433005:0:14423:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 459: rc = 0 00100000:10000000:1.0:1789996393.436319:0:14423:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 268: rc = 0 00100000:10000000:1.0:1789996393.436511:0:14423:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 268: rc = 0 00100000:10000000:1.0:1789996393.437491:0:14423:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 648: rc = 0 00100000:10000000:1.0:1789996393.437901:0:14423:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 648: rc = 0 00100000:10000000:1.0:1789996393.440707:0:14423:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 648: rc = 0 00100000:10000000:1.0:1789996393.441197:0:14423:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 648: rc = 0 00100000:10000000:1.0:1789996393.442314:0:14423:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 648: rc = 0 00100000:10000000:0.0:1789996393.443144:0:14423:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 648: rc = 0 00100000:10000000:0.0:1789996393.443662:0:14423:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 648: rc = 0 00100000:10000000:0.0:1789996393.444160:0:14423:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 648: rc = 0 00100000:10000000:0.0:1789996393.444944:0:14423:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 648: rc = 0 00100000:10000000:0.0:1789996393.445390:0:14423:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 648: rc = 0 00100000:10000000:0.0:1789996393.446274:0:14423:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 648: rc = 0 00100000:10000000:0.0:1789996393.446750:0:14423:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 648: rc = 0 00100000:10000000:0.0:1789996393.447743:0:14423:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 285: rc = 0 00100000:10000000:0.0:1789996393.448284:0:14423:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 285: rc = 0 00100000:10000000:0.0:1789996393.448763:0:14423:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 285: rc = 0 00100000:10000000:2.0:1789996393.454735:0:14423:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 285: rc = 0 00100000:10000000:2.0:1789996393.455371:0:14423:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 285: rc = 0 00100000:10000000:2.0:1789996393.457232:0:14423:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 285: rc = 0 00100000:10000000:2.0:1789996393.457775:0:14423:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 285: rc = 0 00100000:10000000:2.0:1789996393.458050:0:14423:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 285: rc = 0 00100000:10000000:2.0:1789996393.458602:0:14423:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 285: rc = 0 00100000:10000000:2.0:1789996393.459245:0:14423:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 285: rc = 0 00100000:10000000:2.0:1789996393.459749:0:14423:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 285: rc = 0 00100000:10000000:2.0:1789996393.460459:0:14423:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 285: rc = 0 00100000:10000000:2.0:1789996393.460748:0:14423:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 285: rc = 0 00100000:10000000:2.0:1789996393.461260:0:14423:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 285: rc = 0 00100000:10000000:2.0:1789996393.464530:0:14423:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 285: rc = 0 00100000:10000000:2.0:1789996393.465211:0:14423:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 285: rc = 0 00100000:10000000:2.0:1789996393.466660:0:14423:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 285: rc = 0 00100000:10000000:2.0:1789996393.467263:0:14423:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 285: rc = 0 00100000:10000000:2.0:1789996393.467965:0:14423:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 285: rc = 0 00100000:10000000:2.0:1789996393.468589:0:14423:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 285: rc = 0 00100000:10000000:2.0:1789996393.468865:0:14423:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 285: rc = 0 00100000:10000000:2.0:1789996393.469387:0:14423:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 285: rc = 0 00100000:10000000:2.0:1789996393.469684:0:14423:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 285: rc = 0 00100000:10000000:3.0:1789996393.470444:0:14423:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 285: rc = 0 00100000:10000000:3.0:1789996393.470719:0:14423:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 285: rc = 0 00100000:10000000:3.0:1789996393.471212:0:14423:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 285: rc = 0 00100000:10000000:3.0:1789996393.474383:0:14423:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 285: rc = 0 00100000:10000000:3.0:1789996393.476489:0:14423:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 285: rc = 0 00100000:10000000:3.0:1789996393.476790:0:14423:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 285: rc = 0 00100000:10000000:3.0:1789996393.477513:0:14423:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 285: rc = 0 00100000:10000000:3.0:1789996393.477929:0:14423:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 285: rc = 0 00100000:10000000:3.0:1789996393.478989:0:14423:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 285: rc = 0 00100000:10000000:3.0:1789996393.479502:0:14423:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 274: rc = 0 00100000:10000000:3.0:1789996393.480110:0:14423:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:3.0:1789996393.480269:0:14423:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 646: rc = 0 00100000:10000000:3.0:1789996393.480476:0:14423:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:3.0:1789996393.480573:0:14423:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 646: rc = 0 00100000:10000000:3.0:1789996393.480766:0:14423:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:3.0:1789996393.480837:0:14423:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 646: rc = 0 00100000:10000000:3.0:1789996393.481155:0:14423:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:3.0:1789996393.481221:0:14423:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 269: rc = 0 00100000:10000000:3.0:1789996393.481462:0:14423:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:3.0:1789996393.481529:0:14423:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 269: rc = 0 00100000:10000000:3.0:1789996393.483188:0:14423:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:3.0:1789996393.483272:0:14423:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 269: rc = 0 00000020:00000080:3.0:1789996393.483902:0:14423:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1789996393.483911:0:14423:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789996393.483922:0:14423:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4173739f0fc816d6 00000020:01000004:3.0:1789996393.483929:0:14423:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1789996393.483934:0:14423:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1789996393.483940:0:14423:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8e087fbc4800 from MGS 00000020:01000004:3.0:1789996393.483944:0:14423:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1789996393.483955:0:14423:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff8e08545d19c0) 00000020:00000080:3.0:1789996393.483964:0:14423:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1789996393.484201:0:14423:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e087fbc4800 from MGS, refs=2 00080000:01000000:3.0:1789996393.484207:0:14423:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789996393.484212:0:14423:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4173739f0fc816e4 00000100:00100000:3.0:1789996393.484316:0:14423:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1789996393.484593:0:14423:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1789996393.484599:0:14423:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1789996393.485304:0:14423:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1789996393.485310:0:14423:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1789996393.487865:0:14423:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789996393.488191:0:14423:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:1.0:1789996393.488199:0:14423:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1789996393.497760:0:14423:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1789996393.497781:0:14423:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1789996393.500245:0:14423:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1789996393.500256:0:14423:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1789996393.503571:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789996393.503577:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789996393.503579:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789996393.505501:0:14430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789996393.505507:0:14430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789996393.505509:0:14430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789996393.507869:0:14423:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1789996393.525383:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1789996393.542082:0:14423:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:1.0:1789996393.542099:0:14423:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1789996393.542101:0:14423:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:3.0:1789996393.544834:0:14432:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1789996393.544997:0:14423:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1789996393.545123:0:14423:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1789996393.545982:0:14423:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1789996393.546320:0:14423:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789996393.546511:0:14423:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1789996393.546523:0:14423:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1789996393.553873:0:14423:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1789996393.553890:0:14423:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1789996393.557189:0:14423:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1789996393.557214:0:14423:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000100:00080000:1.0:1789996393.571313:0:14437:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:00000080:2.0:1789996393.578761:0:14423:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1789996393.578798:0:14423:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.204.137@tcp' 00000020:01000004:2.0:1789996393.578800:0:14423:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1789996393.578831:0:14423:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.204.137@tcp (typ=mgc) 00000020:00000080:2.0:1789996393.578846:0:14423:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.137@tcp (ffff8e0876658000) 00000020:00000080:2.0:1789996393.578862:0:14423:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1789996393.578937:0:14423:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e0876775800@MGC192.168.204.137@tcp: add connection 192.168.204.137@tcp at head 00010000:00010000:2.0:1789996393.579113:0:14423:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.137@tcp-0 is initialized 00000040:01000000:2.0:1789996393.579119:0:14423:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.137@tcp ctxt 1 is initialized 10000000:01000000:2.0:1789996393.581166:0:14438:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1789996393.583608:0:14423:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.137@tcp (uuid d64f88b3-32d6-473c-b613-b936200ef7a3) 00000020:00000080:3.0:1789996393.583639:0:14423:0:(genops.c:1384:class_connect()) connect: client d64f88b3-32d6-473c-b613-b936200ef7a3, cookie 0x4173739f0fc816f2 00000100:00080000:3.0:1789996393.583657:0:14423:0:(import.c:545:import_select_connection()) MGC192.168.204.137@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789996393.583670:0:14423:0:(import.c:666:import_select_connection()) MGC192.168.204.137@tcp: import ffff8e0876775800 using connection 192.168.204.137@tcp/0@lo 00000100:00100000:3.0:1789996393.583704:0:14423:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e086fa91f80 x1876946942247552/t0(0) o250->MGC192.168.204.137@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789996393.583758:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fa91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:d64f88b3-32d6-473c-b613-b936200ef7a3:3312:1876946942247552:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1789996393.583821:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996393.583857:0:14433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942247552 00000100:00100000:2.0:1789996393.583865:0:14433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942247552 00000100:00080000:3.0:1789996393.583878:0:14423:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import d64f88b3-32d6-473c-b613-b936200ef7a3->MGS 00000020:01000004:3.0:1789996393.583894:0:14423:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000100:00100000:2.0:1789996393.583899:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000020:01000004:3.0:1789996393.583912:0:14423:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000100:00100000:2.0:1789996393.583912:0:14433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0876b7a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3312:x1876946942247552:12345-0@lo:250:mount.lustre.0 00000020:00000080:3.0:1789996393.583924:0:14423:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff8e08545d3380) 00010000:00080000:2.0:1789996393.583932:0:14433:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from d64f88b3-32d6-473c-b613-b936200ef7a3@0@lo t0 exp 0000000000000000 cur 435 last 0 00000020:00000080:3.0:1789996393.583934:0:14423:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000020:00000080:2.0:1789996393.583953:0:14433:0:(genops.c:1384:class_connect()) connect: client d64f88b3-32d6-473c-b613-b936200ef7a3, cookie 0x4173739f0fc81700 00000100:00080000:2.0:1789996393.584097:0:14433:0:(import.c:65:import_set_state_nolock()) ffff8e0848936000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789996393.584153:0:14433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0876b7a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d64f88b3-32d6-473c-b613-b936200ef7a3+5:3312:x1876946942247552:12345-0@lo:250:mount.lustre.0 Request processed in 239us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996393.584172:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789996393.584210:0:3312:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.204.137@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1789996393.584218:0:3312:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.204.137@tcp: connect to target with instance 0 00000100:00080000:2.0:1789996393.584225:0:3312:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.204.137@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1789996393.584228:0:3312:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1789996393.584231:0:3312:0:(import.c:65:import_set_state_nolock()) ffff8e0876775800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1789996393.584233:0:3312:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1789996393.584240:0:3312:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1789996393.584244:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fa91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:d64f88b3-32d6-473c-b613-b936200ef7a3:3312:1876946942247552:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1789996393.599717:0:14423:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789996393.599928:0:14423:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1789996393.599935:0:14423:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1789996393.603392:0:14423:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1789996393.603404:0:14423:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1789996393.611807:0:14423:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1789996393.611821:0:14423:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1789996393.615104:0:14423:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789996393.616461:0:14423:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1789996393.616471:0:14423:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1789996393.619681:0:14423:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1789996393.619694:0:14423:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1789996393.673234:0:14423:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789996393.673814:0:14423:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1789996393.673820:0:14423:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1789996393.675019:0:14423:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1789996393.675028:0:14423:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1789996393.675790:0:14423:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789996393.675953:0:14423:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1789996393.675972:0:14423:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1789996393.676517:0:14423:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1789996393.676523:0:14423:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1789996393.677302:0:14423:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789996393.677475:0:14423:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1789996393.677480:0:14423:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1789996393.678195:0:14423:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1789996393.678203:0:14423:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1789996393.679060:0:14423:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789996393.679203:0:14423:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1789996393.679208:0:14423:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1789996393.679930:0:14423:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1789996393.679937:0:14423:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1789996393.697381:0:14423:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789996393.698069:0:14423:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1789996393.698077:0:14423:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1789996393.699404:0:14423:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1789996393.699414:0:14423:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1789996393.700389:0:14423:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1789996393.700398:0:14423:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1789996393.701410:0:14423:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1789996393.701434:0:14423:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:3.0:1789996393.701440:0:14423:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.137@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1789996393.702716:0:14423:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.137@tcp ctxt 0 is initialized 00000020:01000004:3.0:1789996393.702756:0:14423:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.137@tcp, index=0000, flags=0x20005 00000020:01000004:3.0:1789996393.702760:0:14423:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1789996393.702762:0:14423:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789996393.702763:0:14423:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789996393.702764:0:14423:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789996393.702766:0:14423:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789996393.702768:0:14423:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789996393.702769:0:14423:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789996393.702770:0:14423:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789996393.702772:0:14423:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789996393.702774:0:14423:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789996393.702777:0:14423:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:3.0:1789996393.702779:0:14423:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789996393.702780:0:14423:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789996393.702781:0:14423:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789996393.702783:0:14423:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789996393.702784:0:14423:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789996393.702785:0:14423:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789996393.702786:0:14423:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789996393.702787:0:14423:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789996393.702788:0:14423:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789996393.702789:0:14423:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789996393.702816:0:14423:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1789996393.702835:0:14423:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fa92300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d64f88b3-32d6-473c-b613-b936200ef7a3:14423:1876946942247680:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789996393.702909:0:14423:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996393.703103:0:14436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942247680 00000100:00100000:1.0:1789996393.703113:0:14436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942247680 00000100:00100000:1.0:1789996393.703164:0:14436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789996393.703173:0:14436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0876b79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d64f88b3-32d6-473c-b613-b936200ef7a3+5:14423:x1876946942247680:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789996393.703224:0:14436:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1789996393.703227:0:14436:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1789996393.703230:0:14436:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 00000100:00100000:3.0:1789996393.703338:0:14423:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0847550c00 going to sleep for 11 seconds 10000000:01000000:2.0:1789996393.703887:0:14457:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1789996393.704413:0:14436:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:2.0:1789996393.705750:0:14458:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:2.0:1789996393.705757:0:14458:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:2.0:1789996393.705760:0:14458:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:2.0:1789996393.705795:0:14458:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:1.0:1789996393.707066:0:14436:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1789996393.707078:0:14436:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1789996393.715110:0:14436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0876b79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d64f88b3-32d6-473c-b613-b936200ef7a3+5:14423:x1876946942247680:12345-0@lo:253:mount.lustre.0 Request processed in 11929us (12192us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996393.715126:0:14436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789996393.715210:0:14423:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fa92300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d64f88b3-32d6-473c-b613-b936200ef7a3:14423:1876946942247680:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1789996393.715224:0:14423:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1789996393.715228:0:14423:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789996393.715229:0:14423:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789996393.715231:0:14423:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789996393.715245:0:14423:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789996393.715247:0:14423:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789996393.715315:0:14423:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789996393.715316:0:14423:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789996393.715317:0:14423:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789996393.715319:0:14423:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789996393.715321:0:14423:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1789996393.715339:0:14423:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8e087fbc4800 from lustre-MDT0000 10000000:01000000:3.0:1789996393.715376:0:14423:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1789996393.715379:0:14423:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1789996393.715383:0:14423:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8e0876658000 10000000:01000000:3.0:1789996393.715387:0:14423:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789996393.715394:0:14423:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8e0876658000 from 1 10000000:01000000:3.0:1789996393.715397:0:14423:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1789996393.715498:0:14423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.137@tcp lock: ffff8e087f857a00/0x4173739f0fc81707 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996393.715510:0:14423:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.137@tcp lock: ffff8e087f857a00/0x4173739f0fc81707 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996393.715520:0:14423:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.137@tcp lock: ffff8e087f857a00/0x4173739f0fc81707 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789996393.715538:0:14423:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fa92300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d64f88b3-32d6-473c-b613-b936200ef7a3:14423:1876946942247808:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789996393.715739:0:14423:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789996393.715817:0:14423:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0847550f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789996393.715861:0:14435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942247808 00000100:00100000:1.0:1789996393.715869:0:14435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942247808 00000100:00100000:1.0:1789996393.715937:0:14435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789996393.715947:0:14435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0876b7a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d64f88b3-32d6-473c-b613-b936200ef7a3+5:14423:x1876946942247808:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789996393.715971:0:14435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789996393.715987:0:14435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e0876a23c00/0x4173739f0fc8170e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4173739f0fc81707 expref: -99 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996393.716009:0:14435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e0876a23c00/0x4173739f0fc8170e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4173739f0fc81707 expref: 6 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996393.716020:0:14435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e0876a23c00/0x4173739f0fc8170e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4173739f0fc81707 expref: 6 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996393.716029:0:14435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e0876a23c00, rc 0) 00000100:00100000:1.0:1789996393.716113:0:14435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0876b7a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d64f88b3-32d6-473c-b613-b936200ef7a3+6:14423:x1876946942247808:12345-0@lo:101:mount.lustre.0 Request processed in 167us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996393.716131:0:14435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789996393.716276:0:14423:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fa92300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d64f88b3-32d6-473c-b613-b936200ef7a3:14423:1876946942247808:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789996393.716289:0:14423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.137@tcp lock: ffff8e087f857a00/0x4173739f0fc81707 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc8170e expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996393.716298:0:14423:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.137@tcp lock: ffff8e087f857a00/0x4173739f0fc81707 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4173739f0fc8170e expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789996393.716372:0:14423:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fa92300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d64f88b3-32d6-473c-b613-b936200ef7a3:14423:1876946942247936:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789996393.716408:0:14423:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789996393.716457:0:14423:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0847550f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789996393.716687:0:14435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942247936 00000100:00100000:1.0:1789996393.716692:0:14435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942247936 00000100:00100000:1.0:1789996393.716727:0:14435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789996393.716734:0:14435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0876b78c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d64f88b3-32d6-473c-b613-b936200ef7a3+6:14423:x1876946942247936:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789996393.716948:0:14435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0876b78c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d64f88b3-32d6-473c-b613-b936200ef7a3+6:14423:x1876946942247936:12345-0@lo:501:mount.lustre.0 Request processed in 214us (549us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789996393.717068:0:14423:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fa92300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d64f88b3-32d6-473c-b613-b936200ef7a3:14423:1876946942247936:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1789996393.717095:0:14423:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.137@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1789996393.717109:0:14423:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.137@tcp lock: ffff8e087f857a00/0x4173739f0fc81707 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc8170e expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996393.717117:0:14423:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.137@tcp lock: ffff8e087f857a00/0x4173739f0fc81707 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc8170e expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789996393.717125:0:14423:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8e087fbc4800 10000000:01000000:0.0:1789996393.717137:0:14423:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1789996393.717142:0:14423:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8e087fbc4800 10000000:01000000:0.0:1789996393.717145:0:14423:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1789996393.717148:0:14423:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8e087fbc4800 from 1 10000000:01000000:0.0:1789996393.717151:0:14423:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1789996393.717175:0:14423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.137@tcp lock: ffff8e086fcb7a00/0x4173739f0fc81715 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996393.717183:0:14423:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.137@tcp lock: ffff8e086fcb7a00/0x4173739f0fc81715 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996393.717191:0:14423:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.137@tcp lock: ffff8e086fcb7a00/0x4173739f0fc81715 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789996393.717203:0:14423:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0741a2ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d64f88b3-32d6-473c-b613-b936200ef7a3:14423:1876946942248064:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789996393.717233:0:14423:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996393.717263:0:14423:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0879824c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789996393.717360:0:14435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789996393.717383:0:14435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942248064 00000100:00100000:1.0:1789996393.717386:0:14435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942248064 00000100:00100000:1.0:1789996393.717412:0:14435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789996393.717419:0:14435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0876b79450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d64f88b3-32d6-473c-b613-b936200ef7a3+6:14423:x1876946942248064:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789996393.717426:0:14435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789996393.717437:0:14435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e0876a23400/0x4173739f0fc8171c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4173739f0fc81715 expref: -99 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996393.717454:0:14435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e0876a23400/0x4173739f0fc8171c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4173739f0fc81715 expref: 7 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996393.717463:0:14435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e0876a23400/0x4173739f0fc8171c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4173739f0fc81715 expref: 7 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996393.717471:0:14435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e0876a23400, rc 0) 00000100:00100000:1.0:1789996393.717508:0:14435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0876b79450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d64f88b3-32d6-473c-b613-b936200ef7a3+7:14423:x1876946942248064:12345-0@lo:101:mount.lustre.0 Request processed in 89us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996393.717514:0:14435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789996393.717723:0:14423:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0741a2ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d64f88b3-32d6-473c-b613-b936200ef7a3:14423:1876946942248064:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789996393.717734:0:14423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.137@tcp lock: ffff8e086fcb7a00/0x4173739f0fc81715 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc8171c expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996393.717742:0:14423:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.137@tcp lock: ffff8e086fcb7a00/0x4173739f0fc81715 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4173739f0fc8171c expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789996393.717753:0:14423:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.137@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1789996393.717758:0:14423:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.137@tcp lock: ffff8e086fcb7a00/0x4173739f0fc81715 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc8171c expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996393.717765:0:14423:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.137@tcp lock: ffff8e086fcb7a00/0x4173739f0fc81715 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc8171c expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789996393.717778:0:14423:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1789996393.717781:0:14423:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789996393.717785:0:14423:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8e087fbc4800 10000000:01000000:0.0:1789996393.717788:0:14423:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1789996393.717790:0:14423:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1789996393.717792:0:14423:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1789996393.717807:0:14423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.137@tcp lock: ffff8e086fcb6600/0x4173739f0fc81723 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996393.717814:0:14423:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.137@tcp lock: ffff8e086fcb6600/0x4173739f0fc81723 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996393.717822:0:14423:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.137@tcp lock: ffff8e086fcb6600/0x4173739f0fc81723 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789996393.717834:0:14423:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0741a2ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d64f88b3-32d6-473c-b613-b936200ef7a3:14423:1876946942248192:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789996393.717858:0:14423:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996393.717886:0:14423:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0879824c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789996393.717945:0:14433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942248192 00000100:00100000:3.0:1789996393.717950:0:14433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942248192 00000100:00100000:3.0:1789996393.718043:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789996393.718052:0:14433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0876b7b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d64f88b3-32d6-473c-b613-b936200ef7a3+7:14423:x1876946942248192:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789996393.718059:0:14433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789996393.718069:0:14433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e087f856000/0x4173739f0fc8172a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4173739f0fc81723 expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996393.718083:0:14433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e087f856000/0x4173739f0fc8172a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4173739f0fc81723 expref: 8 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996393.718090:0:14433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e087f856000/0x4173739f0fc8172a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4173739f0fc81723 expref: 8 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996393.718097:0:14433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e087f856000, rc 0) 00000100:00100000:3.0:1789996393.718132:0:14433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0876b7b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d64f88b3-32d6-473c-b613-b936200ef7a3+8:14423:x1876946942248192:12345-0@lo:101:mount.lustre.0 Request processed in 82us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996393.718138:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789996393.718203:0:14423:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0741a2ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d64f88b3-32d6-473c-b613-b936200ef7a3:14423:1876946942248192:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789996393.718213:0:14423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.137@tcp lock: ffff8e086fcb6600/0x4173739f0fc81723 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc8172a expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996393.718220:0:14423:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.137@tcp lock: ffff8e086fcb6600/0x4173739f0fc81723 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4173739f0fc8172a expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789996393.718336:0:14423:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0741a2ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d64f88b3-32d6-473c-b613-b936200ef7a3:14423:1876946942248320:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789996393.718370:0:14423:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996393.718395:0:14423:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0879824c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789996393.718450:0:14433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942248320 00000100:00100000:3.0:1789996393.718454:0:14433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942248320 00000100:00100000:3.0:1789996393.718471:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789996393.718477:0:14433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0876b78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d64f88b3-32d6-473c-b613-b936200ef7a3+8:14423:x1876946942248320:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789996393.718881:0:14433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0876b78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d64f88b3-32d6-473c-b613-b936200ef7a3+9:14423:x1876946942248320:12345-0@lo:501:mount.lustre.0 Request processed in 404us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996393.718893:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789996393.719169:0:14423:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0741a2ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d64f88b3-32d6-473c-b613-b936200ef7a3:14423:1876946942248320:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789996393.719200:0:14423:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0741a2ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d64f88b3-32d6-473c-b613-b936200ef7a3:14423:1876946942248448:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789996393.719235:0:14423:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996393.719330:0:14423:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0879824c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789996393.719471:0:14433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942248448 00000100:00100000:3.0:1789996393.719476:0:14433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942248448 00000100:00100000:3.0:1789996393.719555:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789996393.719562:0:14433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0876b78850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d64f88b3-32d6-473c-b613-b936200ef7a3+9:14423:x1876946942248448:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789996393.719866:0:14433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0876b78850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d64f88b3-32d6-473c-b613-b936200ef7a3+9:14423:x1876946942248448:12345-0@lo:503:mount.lustre.0 Request processed in 303us (629us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996393.719872:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789996393.719941:0:14423:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0741a2ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d64f88b3-32d6-473c-b613-b936200ef7a3:14423:1876946942248448:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789996393.720716:0:14459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fa93800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d64f88b3-32d6-473c-b613-b936200ef7a3:14459:1876946942248576:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789996393.720761:0:14459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789996393.720783:0:14459:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0847550600 going to sleep for 11 seconds 00000100:00100000:1.0:1789996393.720845:0:14435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942248576 00000100:00100000:1.0:1789996393.720858:0:14435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942248576 00000100:00100000:1.0:1789996393.720896:0:14435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789996393.720904:0:14435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0876b78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d64f88b3-32d6-473c-b613-b936200ef7a3+9:14459:x1876946942248576:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789996393.721503:0:14435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0876b78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d64f88b3-32d6-473c-b613-b936200ef7a3+9:14459:x1876946942248576:12345-0@lo:502:llog_process_th.0 Request processed in 597us (738us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996393.721511:0:14435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789996393.721795:0:14459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fa93800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d64f88b3-32d6-473c-b613-b936200ef7a3:14459:1876946942248576:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789996393.721824:0:14459:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789996393.721835:0:14459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789996393.721838:0:14459:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1789996393.721843:0:14459:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1789996393.721847:0:14459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789996393.721862:0:14459:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff8e087f8c0000) 00000020:00000080:0.0:1789996393.721879:0:14459:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1789996393.721884:0:14459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1789996393.721953:0:14459:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:0.0:1789996393.722038:0:14459:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4173739f0fc81738 00000020:00000080:0.0:1789996393.722245:0:14459:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1789996393.722327:0:14459:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789996393.722331:0:14459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789996393.722333:0:14459:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1789996393.722336:0:14459:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789996393.722340:0:14459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789996393.722341:0:14459:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1789996393.722345:0:14459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789996393.722361:0:14459:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff8e087f8c19c0) 00000020:00000080:0.0:1789996393.722371:0:14459:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1789996393.722375:0:14459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1789996393.722377:0:14459:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1789996393.722389:0:14459:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1789996393.722406:0:14459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1789996393.722457:0:14459:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e087fbc4800 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1789996393.722472:0:14459:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff8e087f8c3380) 00000020:00000080:0.0:1789996393.722483:0:14459:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1789996393.722523:0:14459:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1789996393.722530:0:14459:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4173739f0fc8174d 00000020:00000080:0.0:1789996393.722782:0:14459:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1789996393.722788:0:14459:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1789996393.722794:0:14459:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x4173739f0fc81754 00080000:01000000:0.0:1789996393.722800:0:14459:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:0.0:1789996393.722804:0:14459:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4173739f0fc8175b 00010000:00010000:1.0:1789996393.796803:0:14459:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:1.0:1789996393.797505:0:14459:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967527 00000001:00080000:1.0:1789996393.797735:0:14459:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1789996393.798266:0:14459:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff8e0849c78000) 00000020:00000080:1.0:1789996393.801565:0:14459:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:1.0:1789996393.801688:0:14459:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:1.0:1789996393.801699:0:14459:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4173739f0fc81769 00000020:00000080:0.0:1789996393.806501:0:14459:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1789996393.822277:0:14459:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x4173739f0fc81770 00000020:00000080:1.0:1789996393.826513:0:14459:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1789996393.826527:0:14459:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789996393.826534:0:14459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789996393.826536:0:14459:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1789996393.826566:0:14459:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789996393.826573:0:14459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789996393.826575:0:14459:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1789996393.826580:0:14459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1789996393.826618:0:14459:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1789996393.826632:0:14459:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789996393.826635:0:14459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789996393.826636:0:14459:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1789996393.826639:0:14459:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1789996393.826641:0:14459:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #10 00000020:01000000:1.0:1789996393.826643:0:14459:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789996393.826644:0:14459:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789996393.826654:0:14459:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1789996393.826657:0:14459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789996393.826658:0:14459:0:(obd_config.c:1563:class_process_config()) marker 10 (0x6) lustre sys.timeout 00000020:01000000:1.0:1789996393.826661:0:14459:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789996393.826665:0:14459:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1789996393.826668:0:14459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789996393.826669:0:14459:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1789996393.826672:0:14459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789996393.826677:0:14459:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.137@tcp to nid 0x20000c0a8cc89 (192.168.204.137@tcp) 00000020:01000000:1.0:1789996393.826701:0:14459:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1789996393.826703:0:14459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789996393.826718:0:14459:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8e0849c7b380) 00000020:00000080:1.0:1789996393.826734:0:14459:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:1.0:1789996393.826740:0:14459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789996393.826793:0:14459:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1789996393.826799:0:14459:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:1.0:1789996393.826806:0:14459:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4173739f0fc8177e 00010000:00080000:1.0:1789996393.826850:0:14459:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e0876bb2800@lustre-OST0000-osc-MDT0000: add connection 192.168.204.137@tcp at head 00010000:00010000:1.0:1789996393.827079:0:14459:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:1.0:1789996393.828733:0:14459:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1789996393.828780:0:14459:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1789996393.835086:0:14459:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789996393.835185:0:14459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:1.0:1789996393.835261:0:14459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:0.0:1789996393.838522:0:14463:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1789996393.838530:0:14463:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1789996393.840209:0:14459:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789996393.840234:0:14459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1789996393.840269:0:14459:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1789996393.840402:0:14459:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4173739f0fc81785 00000100:00080000:2.0:1789996393.840414:0:14459:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789996393.840426:0:14459:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8e0876bb2800 using connection 192.168.204.137@tcp/0@lo 00000100:00100000:2.0:1789996393.840466:0:14459:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e086faeed80 x1876946942248704/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789996393.840538:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086faeed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3312:1876946942248704:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1789996393.840634:0:3312:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876946942248704 offset 0 length 520: 4 00000100:00080000:2.0:1789996393.840716:0:14459:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1789996393.840774:0:14459:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789996393.840778:0:14459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789996393.840780:0:14459:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1789996393.840783:0:14459:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1789996393.840786:0:14459:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #16 00000020:01000000:2.0:1789996393.840788:0:14459:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789996393.840789:0:14459:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789996393.840790:0:14459:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1789996393.840793:0:14459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789996393.840794:0:14459:0:(obd_config.c:1563:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:2.0:1789996393.840796:0:14459:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789996393.840801:0:14459:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1789996393.840804:0:14459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789996393.840805:0:14459:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1789996393.840808:0:14459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1789996393.840812:0:14459:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.137@tcp to nid 0x20000c0a8cc89 (192.168.204.137@tcp) 00000020:01000000:2.0:1789996393.840834:0:14459:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1789996393.840838:0:14459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789996393.840849:0:14459:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8e08766599c0) 00000020:00000080:2.0:1789996393.840861:0:14459:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:2.0:1789996393.840865:0:14459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1789996393.840931:0:14459:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1789996393.840937:0:14459:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:2.0:1789996393.840942:0:14459:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4173739f0fc81793 00010000:00080000:2.0:1789996393.840968:0:14459:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e0848960000@lustre-OST0001-osc-MDT0000: add connection 192.168.204.137@tcp at head 00010000:00010000:2.0:1789996393.841162:0:14459:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:2.0:1789996393.841758:0:14459:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1789996393.841786:0:14459:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1789996393.842622:0:14459:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789996393.842696:0:14459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:2.0:1789996393.843833:0:14459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:3.0:1789996393.846694:0:14465:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1789996393.846701:0:14465:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1789996393.846866:0:14459:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789996393.846878:0:14459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1789996393.846915:0:14459:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1789996393.846934:0:14459:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4173739f0fc8179a 00000100:00080000:2.0:1789996393.846945:0:14459:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789996393.846956:0:14459:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8e0848960000 using connection 192.168.204.137@tcp/0@lo 00000100:00100000:2.0:1789996393.846993:0:14459:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e086faefb80 x1876946942248832/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789996393.847023:0:14459:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1789996393.847115:0:14459:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789996393.847119:0:14459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789996393.847121:0:14459:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1789996393.847124:0:14459:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789996393.847128:0:14459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789996393.847130:0:14459:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789996393.847133:0:14459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789996393.847135:0:14459:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1789996393.847137:0:14459:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789996393.847140:0:14459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789996393.847141:0:14459:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:2.0:1789996393.847143:0:14459:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789996393.847146:0:14459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789996393.847147:0:14459:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1789996393.847150:0:14459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1789996393.847182:0:14459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086faeea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d64f88b3-32d6-473c-b613-b936200ef7a3:14459:1876946942248960:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789996393.847260:0:14459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996393.847305:0:14459:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e085458e180 going to sleep for 11 seconds 00000100:00100000:0.0:1789996393.848653:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086faefb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3312:1876946942248832:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1789996393.848731:0:3312:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876946942248832 offset 0 length 520: 4 00000100:00100000:3.0:1789996393.849031:0:14433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942248960 00000100:00100000:3.0:1789996393.849040:0:14433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942248960 00000100:00100000:3.0:1789996393.849084:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789996393.849093:0:14433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0876b7bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d64f88b3-32d6-473c-b613-b936200ef7a3+9:14459:x1876946942248960:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789996393.849368:0:14433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0876b7bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d64f88b3-32d6-473c-b613-b936200ef7a3+9:14459:x1876946942248960:12345-0@lo:502:llog_process_th.0 Request processed in 275us (2108us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996393.849376:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789996393.849582:0:14459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086faeea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d64f88b3-32d6-473c-b613-b936200ef7a3:14459:1876946942248960:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789996393.849615:0:14459:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789996393.849621:0:14459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789996393.849623:0:14459:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1789996393.849629:0:14459:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:0.0:1789996393.849846:0:14423:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:0.0:1789996393.849867:0:14423:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.137@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1789996393.849884:0:14423:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.137@tcp lock: ffff8e086fcb6600/0x4173739f0fc81723 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc8172a expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996393.849896:0:14423:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.137@tcp lock: ffff8e086fcb6600/0x4173739f0fc81723 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc8172a expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789996393.849905:0:14423:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8e087fbc4800 from 1 10000000:01000000:0.0:1789996393.849908:0:14423:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789996393.849950:0:14423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.137@tcp lock: ffff8e086fcb7600/0x4173739f0fc817a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996393.849958:0:14423:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.137@tcp lock: ffff8e086fcb7600/0x4173739f0fc817a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996393.849968:0:14423:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.137@tcp lock: ffff8e086fcb7600/0x4173739f0fc817a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789996393.849985:0:14423:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0741a2ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d64f88b3-32d6-473c-b613-b936200ef7a3:14423:1876946942249088:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789996393.850020:0:14423:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996393.850048:0:14423:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0879824a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789996393.852453:0:14435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942249088 00000100:00100000:2.0:1789996393.852481:0:14435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942249088 00000100:00100000:2.0:1789996393.852537:0:14435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789996393.852576:0:14435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0876b79c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d64f88b3-32d6-473c-b613-b936200ef7a3+9:14423:x1876946942249088:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789996393.852593:0:14435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789996393.852614:0:14435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e08429c6600/0x4173739f0fc817a8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4173739f0fc817a1 expref: -99 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996393.852639:0:14435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e08429c6600/0x4173739f0fc817a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4173739f0fc817a1 expref: 10 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996393.852650:0:14435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e08429c6600/0x4173739f0fc817a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4173739f0fc817a1 expref: 10 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996393.852658:0:14435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e08429c6600, rc 0) 00000100:00100000:2.0:1789996393.852748:0:14435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0876b79c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d64f88b3-32d6-473c-b613-b936200ef7a3+10:14423:x1876946942249088:12345-0@lo:101:mount.lustre.0 Request processed in 173us (2726us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996393.852755:0:14435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789996393.853175:0:14423:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0741a2ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d64f88b3-32d6-473c-b613-b936200ef7a3:14423:1876946942249088:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789996393.853196:0:14423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.137@tcp lock: ffff8e086fcb7600/0x4173739f0fc817a1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc817a8 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996393.853206:0:14423:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.137@tcp lock: ffff8e086fcb7600/0x4173739f0fc817a1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4173739f0fc817a8 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789996393.853867:0:14423:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0741a2ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d64f88b3-32d6-473c-b613-b936200ef7a3:14423:1876946942249216:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1789996393.853924:0:14423:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996393.853960:0:14423:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0879824a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789996393.854309:0:14436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942249216 00000100:00100000:2.0:1789996393.854317:0:14436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942249216 00000100:00100000:2.0:1789996393.854369:0:14436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789996393.854377:0:14436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0876b79050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d64f88b3-32d6-473c-b613-b936200ef7a3+10:14423:x1876946942249216:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1789996393.854394:0:14436:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1789996393.854399:0:14436:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1789996393.854469:0:14436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0876b79050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d64f88b3-32d6-473c-b613-b936200ef7a3+10:14423:x1876946942249216:12345-0@lo:256:mount.lustre.0 Request processed in 92us (544us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996393.854476:0:14436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789996393.854958:0:14423:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0741a2ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d64f88b3-32d6-473c-b613-b936200ef7a3:14423:1876946942249216:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1789996393.855877:0:14423:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.137@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789996393.855946:0:14423:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.137@tcp lock: ffff8e086fcb7600/0x4173739f0fc817a1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc817a8 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996393.855959:0:14423:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.137@tcp lock: ffff8e086fcb7600/0x4173739f0fc817a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc817a8 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789996393.856028:0:14423:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e087fbc4800 from 1 10000000:01000000:0.0:1789996393.856030:0:14423:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789996393.856067:0:14423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.137@tcp lock: ffff8e086fcb6400/0x4173739f0fc817af lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996393.856075:0:14423:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.137@tcp lock: ffff8e086fcb6400/0x4173739f0fc817af lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996393.856084:0:14423:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.137@tcp lock: ffff8e086fcb6400/0x4173739f0fc817af lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789996393.856105:0:14423:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0741a2ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d64f88b3-32d6-473c-b613-b936200ef7a3:14423:1876946942249344:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789996393.856156:0:14423:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996393.856196:0:14423:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0879824a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789996393.856261:0:14433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942249344 00000100:00100000:3.0:1789996393.856269:0:14433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942249344 00000100:00100000:3.0:1789996393.856325:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789996393.856334:0:14433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0876b7ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d64f88b3-32d6-473c-b613-b936200ef7a3+10:14423:x1876946942249344:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789996393.856344:0:14433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789996393.856371:0:14433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e087f857400/0x4173739f0fc817b6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4173739f0fc817af expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996393.856392:0:14433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e087f857400/0x4173739f0fc817b6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4173739f0fc817af expref: 11 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996393.856404:0:14433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e087f857400/0x4173739f0fc817b6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4173739f0fc817af expref: 11 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996393.856413:0:14433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e087f857400, rc 0) 00000100:00100000:3.0:1789996393.856459:0:14433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0876b7ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d64f88b3-32d6-473c-b613-b936200ef7a3+11:14423:x1876946942249344:12345-0@lo:101:mount.lustre.0 Request processed in 127us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996393.856466:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789996393.857009:0:14423:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0741a2ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d64f88b3-32d6-473c-b613-b936200ef7a3:14423:1876946942249344:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789996393.857025:0:14423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.137@tcp lock: ffff8e086fcb6400/0x4173739f0fc817af lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc817b6 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996393.857035:0:14423:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.137@tcp lock: ffff8e086fcb6400/0x4173739f0fc817af lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4173739f0fc817b6 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789996393.857096:0:14423:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0741a2ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d64f88b3-32d6-473c-b613-b936200ef7a3:14423:1876946942249472:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789996393.857129:0:14423:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996393.857164:0:14423:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0879824a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789996393.857212:0:14436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942249472 00000100:00100000:3.0:1789996393.857217:0:14436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942249472 00000100:00100000:3.0:1789996393.857251:0:14436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789996393.857258:0:14436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fdee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d64f88b3-32d6-473c-b613-b936200ef7a3+11:14423:x1876946942249472:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789996393.857686:0:14436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fdee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d64f88b3-32d6-473c-b613-b936200ef7a3+11:14423:x1876946942249472:12345-0@lo:501:mount.lustre.0 Request processed in 427us (555us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996393.857694:0:14436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789996393.859013:0:14423:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0741a2ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d64f88b3-32d6-473c-b613-b936200ef7a3:14423:1876946942249472:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789996393.859065:0:14423:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0741a2ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d64f88b3-32d6-473c-b613-b936200ef7a3:14423:1876946942249600:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789996393.859133:0:14423:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996393.859172:0:14423:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0879824a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789996393.859653:0:14435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942249600 00000100:00100000:1.0:1789996393.859661:0:14435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942249600 00000100:00100000:1.0:1789996393.859709:0:14435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789996393.859718:0:14435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fdef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d64f88b3-32d6-473c-b613-b936200ef7a3+11:14423:x1876946942249600:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789996393.859895:0:14435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fdef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d64f88b3-32d6-473c-b613-b936200ef7a3+11:14423:x1876946942249600:12345-0@lo:503:mount.lustre.0 Request processed in 178us (762us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996393.859903:0:14435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789996393.860143:0:14423:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0741a2ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d64f88b3-32d6-473c-b613-b936200ef7a3:14423:1876946942249600:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789996393.862000:0:14467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0741a2ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d64f88b3-32d6-473c-b613-b936200ef7a3:14467:1876946942249728:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789996393.862077:0:14467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996393.862121:0:14467:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0879824b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789996393.862173:0:14433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942249728 00000100:00100000:3.0:1789996393.862180:0:14433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942249728 00000100:00100000:3.0:1789996393.862236:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789996393.862245:0:14433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fdee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d64f88b3-32d6-473c-b613-b936200ef7a3+11:14467:x1876946942249728:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789996393.862523:0:14433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fdee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d64f88b3-32d6-473c-b613-b936200ef7a3+11:14467:x1876946942249728:12345-0@lo:502:llog_process_th.0 Request processed in 279us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996393.862531:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789996393.862763:0:14467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0741a2ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d64f88b3-32d6-473c-b613-b936200ef7a3:14467:1876946942249728:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789996393.862792:0:14467:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789996393.862802:0:14467:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789996393.862805:0:14467:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1789996393.862813:0:14467:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e087fbc4800 00000020:00000080:0.0:1789996393.862816:0:14467:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789996393.862824:0:14467:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789996393.862826:0:14467:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789996393.862828:0:14467:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1789996393.862831:0:14467:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789996393.862833:0:14467:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789996393.862835:0:14467:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1789996393.862838:0:14467:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e087fbc4800 00000020:00000080:0.0:1789996393.862840:0:14467:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789996393.862910:0:14467:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789996393.862914:0:14467:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789996393.862915:0:14467:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1789996393.862918:0:14467:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789996393.862921:0:14467:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789996393.862922:0:14467:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789996393.862926:0:14467:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8e087fbc4800 00000020:00000080:0.0:1789996393.862928:0:14467:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789996393.862965:0:14467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0741a2ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d64f88b3-32d6-473c-b613-b936200ef7a3:14467:1876946942249856:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789996393.863009:0:14467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996393.863039:0:14467:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0879824b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789996393.865047:0:14436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942249856 00000100:00100000:3.0:1789996393.865072:0:14436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942249856 00000100:00100000:3.0:1789996393.865137:0:14436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789996393.865147:0:14436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fdee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d64f88b3-32d6-473c-b613-b936200ef7a3+11:14467:x1876946942249856:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789996393.868325:0:14436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fdee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d64f88b3-32d6-473c-b613-b936200ef7a3+11:14467:x1876946942249856:12345-0@lo:502:llog_process_th.0 Request processed in 3170us (5305us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996393.868342:0:14436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789996393.868514:0:14467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0741a2ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d64f88b3-32d6-473c-b613-b936200ef7a3:14467:1876946942249856:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789996393.868572:0:14467:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789996393.868580:0:14467:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789996393.868582:0:14467:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1789996393.868588:0:14467:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1789996393.869019:0:14423:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1789996393.869039:0:14423:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.137@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789996393.869062:0:14423:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.137@tcp lock: ffff8e086fcb6400/0x4173739f0fc817af lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc817b6 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996393.869074:0:14423:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.137@tcp lock: ffff8e086fcb6400/0x4173739f0fc817af lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc817b6 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789996393.869114:0:14423:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1789996393.869117:0:14423:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8e087fbc4800 10000000:01000000:3.0:1789996393.869120:0:14423:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8e087fbc4800 10000000:01000000:3.0:1789996393.869125:0:14423:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789996393.869130:0:14423:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8e087fbc4800 from 1 10000000:01000000:3.0:1789996393.869133:0:14423:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789996393.869166:0:14423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.137@tcp lock: ffff8e087f857e00/0x4173739f0fc817bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996393.869174:0:14423:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.137@tcp lock: ffff8e087f857e00/0x4173739f0fc817bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996393.869183:0:14423:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.137@tcp lock: ffff8e087f857e00/0x4173739f0fc817bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789996393.869205:0:14423:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fa92a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d64f88b3-32d6-473c-b613-b936200ef7a3:14423:1876946942249984:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789996393.869263:0:14423:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789996393.869307:0:14423:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0847550f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789996393.869325:0:14433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942249984 00000100:00100000:3.0:1789996393.869330:0:14433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942249984 00000100:00100000:3.0:1789996393.869380:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789996393.869388:0:14433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fdec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d64f88b3-32d6-473c-b613-b936200ef7a3+11:14423:x1876946942249984:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789996393.869402:0:14433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789996393.869413:0:14433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e087f857000/0x4173739f0fc817c4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4173739f0fc817bd expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996393.869436:0:14433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e087f857000/0x4173739f0fc817c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4173739f0fc817bd expref: 12 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996393.869447:0:14433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e087f857000/0x4173739f0fc817c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4173739f0fc817bd expref: 12 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996393.869456:0:14433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e087f857000, rc 0) 00000100:00100000:3.0:1789996393.869825:0:14433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fdec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d64f88b3-32d6-473c-b613-b936200ef7a3+12:14423:x1876946942249984:12345-0@lo:101:mount.lustre.0 Request processed in 436us (560us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996393.869832:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789996393.869878:0:14423:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fa92a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d64f88b3-32d6-473c-b613-b936200ef7a3:14423:1876946942249984:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789996393.869892:0:14423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.137@tcp lock: ffff8e087f857e00/0x4173739f0fc817bd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc817c4 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996393.869901:0:14423:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.137@tcp lock: ffff8e087f857e00/0x4173739f0fc817bd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4173739f0fc817c4 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789996393.869948:0:14423:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fa92a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d64f88b3-32d6-473c-b613-b936200ef7a3:14423:1876946942250112:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789996393.869983:0:14423:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789996393.869997:0:14423:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0847550f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789996393.870011:0:14436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942250112 00000100:00100000:3.0:1789996393.870014:0:14436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942250112 00000100:00100000:3.0:1789996393.870042:0:14436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789996393.870049:0:14436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fdec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d64f88b3-32d6-473c-b613-b936200ef7a3+12:14423:x1876946942250112:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789996393.870437:0:14436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fdec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d64f88b3-32d6-473c-b613-b936200ef7a3+12:14423:x1876946942250112:12345-0@lo:501:mount.lustre.0 Request processed in 387us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996393.870446:0:14436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789996393.870615:0:14423:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fa92a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d64f88b3-32d6-473c-b613-b936200ef7a3:14423:1876946942250112:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789996393.870646:0:14423:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0741a2ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d64f88b3-32d6-473c-b613-b936200ef7a3:14423:1876946942250240:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789996393.870686:0:14423:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996393.870710:0:14423:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0879824b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789996393.870804:0:14433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942250240 00000100:00100000:3.0:1789996393.870809:0:14433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942250240 00000100:00100000:3.0:1789996393.870842:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789996393.870850:0:14433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fdeec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d64f88b3-32d6-473c-b613-b936200ef7a3+12:14423:x1876946942250240:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789996393.870998:0:14433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fdeec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d64f88b3-32d6-473c-b613-b936200ef7a3+12:14423:x1876946942250240:12345-0@lo:503:mount.lustre.0 Request processed in 148us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996393.871005:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789996393.871521:0:14423:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0741a2ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d64f88b3-32d6-473c-b613-b936200ef7a3:14423:1876946942250240:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789996393.872243:0:14469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fa90000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d64f88b3-32d6-473c-b613-b936200ef7a3:14469:1876946942250368:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789996393.872390:0:14469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789996393.872468:0:14469:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e084c043000 going to sleep for 11 seconds 00000100:00100000:0.0:1789996393.876369:0:14433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942250368 00000100:00100000:0.0:1789996393.876385:0:14433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942250368 00000100:00100000:0.0:1789996393.876453:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789996393.876464:0:14433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fdedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d64f88b3-32d6-473c-b613-b936200ef7a3+12:14469:x1876946942250368:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789996393.877242:0:14433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fdedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d64f88b3-32d6-473c-b613-b936200ef7a3+12:14469:x1876946942250368:12345-0@lo:502:llog_process_th.0 Request processed in 778us (4849us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996393.877252:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789996393.880394:0:14469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fa90000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d64f88b3-32d6-473c-b613-b936200ef7a3:14469:1876946942250368:0@lo:502:llog_process_th.0 00000020:01000004:2.0:1789996393.880479:0:14469:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1789996393.880499:0:14469:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff8e087665b380) 00000020:00000080:2.0:1789996393.880519:0:14469:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:2.0:1789996393.880657:0:14469:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e087fbc4800 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1789996393.880662:0:14469:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8e087fbc4800 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1789996393.880665:0:14469:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e087fbc4800 4 00010000:00080000:2.0:1789996393.880692:0:14469:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e0870a5d800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.137@tcp at head 00010000:00010000:2.0:1789996393.882306:0:14469:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:2.0:1789996393.882518:0:14469:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1789996393.882584:0:14469:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789996393.882598:0:14469:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x4173739f0fc817d2 00000100:00080000:2.0:1789996393.882609:0:14469:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789996393.882619:0:14469:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8e0870a5d800 using connection 192.168.204.137@tcp/0@lo 00000100:00100000:2.0:1789996393.882656:0:14469:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e086faeea00 x1876946942250496/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789996393.882680:0:14469:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1789996393.882798:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086faeea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876946942250496:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789996393.882877:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996393.883057:0:14441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942250496 00000100:00100000:2.0:1789996393.883065:0:14441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942250496 00000100:00100000:2.0:1789996393.883104:0:14441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789996393.883112:0:14441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086faef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3312:x1876946942250496:12345-0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789996393.887937:0:14441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086faef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3312:x1876946942250496:12345-0@lo:38:llog_process_th.0 Request processed in 4815us (5051us total) trans 0 rc -11/-11 00000100:00100000:2.0:1789996393.887952:0:14441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789996393.888033:0:3312:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789996393.888041:0:3312:0:(import.c:65:import_set_state_nolock()) ffff8e0870a5d800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789996393.888046:0:3312:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1789996393.888050:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086faeea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876946942250496:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789996393.888184:0:14469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086faeea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d64f88b3-32d6-473c-b613-b936200ef7a3:14469:1876946942250624:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789996393.888243:0:14469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996393.888272:0:14469:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e08454d1840 going to sleep for 11 seconds 00000100:00100000:2.0:1789996393.890404:0:14435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942250624 00000100:00100000:2.0:1789996393.890418:0:14435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942250624 00000100:00100000:2.0:1789996393.890470:0:14435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789996393.890479:0:14435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fded050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d64f88b3-32d6-473c-b613-b936200ef7a3+12:14469:x1876946942250624:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789996393.896917:0:14435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fded050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d64f88b3-32d6-473c-b613-b936200ef7a3+12:14469:x1876946942250624:12345-0@lo:502:llog_process_th.0 Request processed in 6427us (8662us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996393.896933:0:14435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789996393.897149:0:14469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086faeea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d64f88b3-32d6-473c-b613-b936200ef7a3:14469:1876946942250624:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1789996393.897189:0:14469:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1789996393.897967:0:14423:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1789996393.897990:0:14423:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.137@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789996393.898014:0:14423:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.137@tcp lock: ffff8e087f857e00/0x4173739f0fc817bd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc817c4 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996393.898027:0:14423:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.137@tcp lock: ffff8e087f857e00/0x4173739f0fc817bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc817c4 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789996393.898073:0:14423:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1789996393.898075:0:14423:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789996393.898076:0:14423:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789996393.898078:0:14423:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789996393.898079:0:14423:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789996393.898080:0:14423:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789996393.898082:0:14423:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789996393.898083:0:14423:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789996393.898085:0:14423:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789996393.898090:0:14423:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789996393.898094:0:14423:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1789996393.898096:0:14423:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789996393.898097:0:14423:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789996393.898098:0:14423:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789996393.898099:0:14423:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789996393.898100:0:14423:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789996393.898101:0:14423:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789996393.898102:0:14423:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789996393.898103:0:14423:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789996393.898104:0:14423:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789996393.898105:0:14423:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789996393.898126:0:14423:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1789996393.898143:0:14423:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086faeea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d64f88b3-32d6-473c-b613-b936200ef7a3:14423:1876946942250752:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789996393.898196:0:14423:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996393.898230:0:14423:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e08499d6600 going to sleep for 11 seconds 00000100:00100000:0.0:1789996393.898878:0:14433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942250752 00000100:00100000:0.0:1789996393.898886:0:14433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942250752 00000100:00100000:0.0:1789996393.898942:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789996393.898961:0:14433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fded850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d64f88b3-32d6-473c-b613-b936200ef7a3+12:14423:x1876946942250752:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789996393.899001:0:14433:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1789996393.899016:0:14433:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1789996394.015091:0:14433:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1789996394.015112:0:14433:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1789996394.015308:0:14457:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1789996394.015314:0:14457:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1789996394.015337:0:14457:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e087f856600/0x4173739f0fc817d9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996394.015366:0:14457:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e08429c6600/0x4173739f0fc817a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4173739f0fc817a1 expref: 12 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996394.015375:0:14457:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8e087f856600/0x4173739f0fc817d9 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996394.015657:0:14457:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e08429c6600/0x4173739f0fc817a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4173739f0fc817a1 expref: 12 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996394.015673:0:14457:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e08429c6600/0x4173739f0fc817a8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4173739f0fc817a1 expref: 12 pid: 14435 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789996394.015687:0:14457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fa90000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14457:1876946942250880:0@lo:104: 00000100:00100000:3.0:1789996394.015747:0:14457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789996394.015804:0:14457:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0852b61cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789996394.015900:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942250880 00000100:00100000:2.0:1789996394.015910:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942250880 00000100:00100000:2.0:1789996394.015975:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789996394.015986:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fa92a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d64f88b3-32d6-473c-b613-b936200ef7a3+3:14457:x1876946942250880:12345-0@lo:104: 00010000:00010000:2.0:1789996394.016001:0:14424:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.137@tcp lock: ffff8e086fcb7600/0x4173739f0fc817a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4173739f0fc817a8 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996394.016241:0:14424:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789996394.016247:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fa92a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d64f88b3-32d6-473c-b613-b936200ef7a3+3:14457:x1876946942250880:12345-0@lo:104: Request processed in 264us (500us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996394.016254:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789996394.016294:0:14457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fa90000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14457:1876946942250880:0@lo:104: 00010000:00010000:2.0:1789996394.016313:0:14457:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8e087f856600/0x4173739f0fc817d9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996394.016912:0:14430:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789996394.016919:0:14430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.137@tcp lock: ffff8e086fcb7600/0x4173739f0fc817a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4173739f0fc817a8 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996394.016928:0:14430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e086fcb7600 already unused, calling callback (ffffffffc1be0c20) 10000000:00010000:1.0:1789996394.016932:0:14430:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.137@tcp lock: ffff8e086fcb7600/0x4173739f0fc817a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4173739f0fc817a8 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996394.016941:0:14430:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.137@tcp lock: ffff8e086fcb7600/0x4173739f0fc817a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4173739f0fc817a8 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789996394.016949:0:14430:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.137@tcp lock: ffff8e086fcb7600/0x4173739f0fc817a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4173739f0fc817a8 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789996394.016955:0:14430:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789996394.016992:0:14430:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.137@tcp lock: ffff8e086fcb7600/0x4173739f0fc817a1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4173739f0fc817a8 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996394.016999:0:14430:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789996394.017020:0:14430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.137@tcp lock: ffff8e086fcb7600/0x4173739f0fc817a1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4173739f0fc817a8 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996394.017028:0:14430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.137@tcp lock: ffff8e086fcb7600/0x4173739f0fc817a1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4173739f0fc817a8 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996394.017044:0:14430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789996394.017046:0:14430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789996394.017047:0:14430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789996394.017071:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fc9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d64f88b3-32d6-473c-b613-b936200ef7a3:3314:1876946942251008:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789996394.017105:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996394.017224:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942251008 00000100:00100000:2.0:1789996394.017234:0:14426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942251008 00010000:00010000:2.0:1789996394.017258:0:14426:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e08429c6600/0x4173739f0fc817a8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4173739f0fc817a1 expref: 13 pid: 14435 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789996394.017284:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789996394.017293:0:14426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fc9aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d64f88b3-32d6-473c-b613-b936200ef7a3+13:3314:x1876946942251008:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789996394.017304:0:14426:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789996394.017309:0:14426:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e08429c6600/0x4173739f0fc817a8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4173739f0fc817a1 expref: 13 pid: 14435 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996394.017320:0:14426:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e08429c6600/0x4173739f0fc817a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4173739f0fc817a1 expref: 13 pid: 14435 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996394.017333:0:14426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e08429c6600/0x4173739f0fc817a8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4173739f0fc817a1 expref: 13 pid: 14435 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996394.017360:0:14426:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8e087f856600/0x4173739f0fc817d9 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996394.017370:0:14426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e087f856600/0x4173739f0fc817d9 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789996394.017385:0:14426:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002072069s 00010000:00010000:2.0:1789996394.017390:0:14426:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e087f856600/0x4173739f0fc817d9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996394.017397:0:14426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e087f856600/0x4173739f0fc817d9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996394.017404:0:14426:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e087f856600/0x4173739f0fc817d9 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996394.017422:0:14426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e087f856600/0x4173739f0fc817d9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996394.017427:0:14426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e087f856600 already unused, calling callback (ffffffffc1595910) 00010000:00010000:2.0:1789996394.017431:0:14426:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e087f856600/0x4173739f0fc817d9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996394.017438:0:14426:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e087f856600/0x4173739f0fc817d9 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996394.023418:0:14457:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8e087f856600/0x4173739f0fc817d9 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996394.023436:0:14457:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e087f856600/0x4173739f0fc817d9 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996394.023703:0:14426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e087f856600/0x4173739f0fc817d9 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996394.023715:0:14426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e087f856600/0x4173739f0fc817d9 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996394.023738:0:14426:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789996394.023835:0:14426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fc9aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d64f88b3-32d6-473c-b613-b936200ef7a3+12:3314:x1876946942251008:12345-0@lo:103:ldlm_bl.0 Request processed in 6540us (6725us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996394.023847:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789996394.023957:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fc9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d64f88b3-32d6-473c-b613-b936200ef7a3:3314:1876946942251008:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789996394.028154:0:14433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fded850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d64f88b3-32d6-473c-b613-b936200ef7a3+11:14423:x1876946942250752:12345-0@lo:253:mount.lustre.0 Request processed in 129193us (129947us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996394.028168:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789996394.028283:0:14423:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086faeea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d64f88b3-32d6-473c-b613-b936200ef7a3:14423:1876946942250752:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789996394.028299:0:14423:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1789996394.028302:0:14423:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789996394.028304:0:14423:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789996394.028306:0:14423:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789996394.028307:0:14423:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789996394.028309:0:14423:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789996394.028310:0:14423:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789996394.028311:0:14423:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789996394.028313:0:14423:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789996394.028314:0:14423:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789996394.028315:0:14423:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1789996394.028329:0:14423:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1789996394.040200:0:14423:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:0.0:1789996394.040979:0:14423:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1789996394.041383:0:14423:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:0.0:1789996394.041724:0:14423:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1789996394.041995:0:14423:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:0.0:1789996394.042167:0:14423:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:0.0:1789996394.043947:0:14423:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:0.0:1789996394.044085:0:14423:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:0.0:1789996394.044815:0:14423:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:0.0:1789996394.045060:0:14423:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:0.0:1789996394.046982:0:14423:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:0.0:1789996394.047180:0:14423:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:2.0:1789996394.115215:0:14423:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:3.0:1789996394.115957:0:14423:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:2.0:1789996394.116105:0:14481:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:2.0:1789996394.116109:0:14481:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:1.0:1789996394.116791:0:14482:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:1.0:1789996394.116879:0:14482:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789996394.122836:0:14482:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1789996394.122918:0:14482:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1789996394.122922:0:14482:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:01000000:3.0:1789996394.123881:0:14423:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1789996394.124040:0:14423:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1789996394.124947:0:14423:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1789996394.124959:0:14423:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1789996394.125118:0:14423:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789996394.126444:0:14423:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1789996394.126983:0:14423:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1789996394.127011:0:14423:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1789996394.127472:0:14423:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 0, last_idx 1 00080000:10000000:3.0:1789996394.129200:0:14423:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:3.0:1789996394.139076:0:14423:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:3.0:1789996394.201729:0:14423:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1789996394.201769:0:14423:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa9e8c1c73988 00100000:10000000:3.0:1789996394.201777:0:14423:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1789996394.203051:0:14423:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1789996394.203072:0:14423:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.137@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1789996394.203086:0:14423:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1789996394.203101:0:14423:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:3.0:1789996394.540177:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789996394.920796:0:14475:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789996394.920806:0:14475:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789996394.921157:0:14475:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:2.0:1789996394.921163:0:14475:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 10000000:01000000:2.0:1789996395.496667:0:14438:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789996395.496675:0:14438:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8e087fbc4800 from 6 10000000:01000000:2.0:1789996395.496698:0:14438:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789996395.496746:0:14438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.137@tcp lock: ffff8e08429c6200/0x4173739f0fc817e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996395.496758:0:14438:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.137@tcp lock: ffff8e08429c6200/0x4173739f0fc817e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996395.496769:0:14438:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.137@tcp lock: ffff8e08429c6200/0x4173739f0fc817e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789996395.496809:0:14438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086faed880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d64f88b3-32d6-473c-b613-b936200ef7a3:14438:1876946942251136:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789996395.496882:0:14438:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996395.497087:0:14438:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e08475d1480 going to sleep for 11 seconds 00000100:00100000:0.0:1789996395.497272:0:14436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942251136 00000100:00100000:0.0:1789996395.497281:0:14436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942251136 00000100:00100000:0.0:1789996395.497345:0:14436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789996395.497354:0:14436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fdec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d64f88b3-32d6-473c-b613-b936200ef7a3+11:14438:x1876946942251136:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789996395.497367:0:14436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789996395.497381:0:14436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e086fcb7e00/0x4173739f0fc817e7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4173739f0fc817e0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996395.497402:0:14436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e086fcb7e00/0x4173739f0fc817e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4173739f0fc817e0 expref: 12 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996395.497413:0:14436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e086fcb7e00/0x4173739f0fc817e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4173739f0fc817e0 expref: 12 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996395.497427:0:14436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e086fcb7e00, rc 0) 00000100:00100000:0.0:1789996395.497518:0:14436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fdec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d64f88b3-32d6-473c-b613-b936200ef7a3+12:14438:x1876946942251136:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 164us (636us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996395.497525:0:14436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789996395.501028:0:14438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086faed880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d64f88b3-32d6-473c-b613-b936200ef7a3:14438:1876946942251136:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789996395.501078:0:14438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.137@tcp lock: ffff8e08429c6200/0x4173739f0fc817e0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc817e7 expref: -99 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996395.501091:0:14438:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.137@tcp lock: ffff8e08429c6200/0x4173739f0fc817e0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4173739f0fc817e7 expref: -99 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789996395.501277:0:14438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0741a2ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d64f88b3-32d6-473c-b613-b936200ef7a3:14438:1876946942251264:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1789996395.501361:0:14438:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996395.501465:0:14438:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0741b00540 going to sleep for 11 seconds 00000100:00100000:2.0:1789996395.504190:0:14433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942251264 00000100:00100000:2.0:1789996395.504206:0:14433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942251264 00000100:00100000:2.0:1789996395.504335:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789996395.504346:0:14433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fdefc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d64f88b3-32d6-473c-b613-b936200ef7a3+12:14438:x1876946942251264:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1789996395.504372:0:14433:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789996395.504393:0:14433:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789996395.504396:0:14433:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:2.0:1789996395.504538:0:14433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fdefc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d64f88b3-32d6-473c-b613-b936200ef7a3+12:14438:x1876946942251264:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 194us (3177us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996395.504561:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789996395.504657:0:14438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0741a2ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d64f88b3-32d6-473c-b613-b936200ef7a3:14438:1876946942251264:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1789996395.504707:0:14438:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.137@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789996395.504717:0:14438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.137@tcp lock: ffff8e08429c6200/0x4173739f0fc817e0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc817e7 expref: -99 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996395.504728:0:14438:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.137@tcp lock: ffff8e08429c6200/0x4173739f0fc817e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc817e7 expref: -99 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996395.563624:0:14430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789996395.945744:0:14475:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789996395.945756:0:14475:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789996395.945796:0:14475:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:2.0:1789996395.945802:0:14475:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1789996396.587621:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789996397.609711:0:14430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789996398.632717:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789996399.082649:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789996399.082657:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789996399.082660:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789996399.082663:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789996399.082666:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1789996399.082669:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1789996399.082673:0:37:0:(import.c:65:import_set_state_nolock()) ffff8e0870a5d800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789996399.082689:0:37:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8e0870a5d800 using connection 192.168.204.137@tcp/0@lo 00000100:00100000:1.0:1789996399.082712:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e086fc98e00 x1876946942251520/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789996399.082814:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fc9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d64f88b3-32d6-473c-b613-b936200ef7a3:3315:1876946942251392:0@lo:400:kworker.0 00000100:00100000:3.0:1789996399.082883:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996399.083005:0:14435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942251392 00000100:00100000:1.0:1789996399.083014:0:14435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942251392 00000100:00100000:1.0:1789996399.083072:0:14435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789996399.083383:0:14435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fded450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d64f88b3-32d6-473c-b613-b936200ef7a3+12:3315:x1876946942251392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789996399.083444:0:14435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fded450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d64f88b3-32d6-473c-b613-b936200ef7a3+12:3315:x1876946942251392:12345-0@lo:400:kworker.0 Request processed in 363us (560us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996399.083452:0:14435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789996399.083608:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fc9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d64f88b3-32d6-473c-b613-b936200ef7a3:3315:1876946942251392:0@lo:400:kworker.0 00000100:00100000:0.0:1789996399.088346:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fc98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876946942251520:0@lo:38:kworker.0 00000100:00100000:0.0:1789996399.088425:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789996399.088744:0:14443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942251520 00000100:00100000:3.0:1789996399.088754:0:14443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942251520 00000100:00100000:3.0:1789996399.088794:0:14443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789996399.088802:0:14443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0741a29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3312:x1876946942251520:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1789996399.088830:0:14443:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 440 last 0 00000020:00000080:3.0:1789996399.088871:0:14443:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x4173739f0fc817ee 00000004:00100000:3.0:1789996399.088885:0:14443:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789996399.089021:0:14443:0:(import.c:65:import_set_state_nolock()) ffff8e087f965800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789996399.089074:0:14443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0741a29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876946942251520:12345-0@lo:38:kworker.0 Request processed in 271us (649us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996399.089098:0:14443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789996399.091651:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8e086fc98e00 x1876946942251520/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789996409 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789996399.091673:0:3312:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1789996399.091683:0:3312:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1789996399.091695:0:3312:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789996399.091699:0:3312:0:(import.c:65:import_set_state_nolock()) ffff8e0870a5d800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789996399.091707:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fc98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876946942251520:0@lo:38:kworker.0 00000001:02000400:0.0:1789996399.464395:0:14723:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg437-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1789996399.657859:0:14430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789996400.680649:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789996401.704930:0:14430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789996402.294470:0:14875:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdb55c9370 20000000:00000080:3.0:1789996402.294490:0:14875:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8e087f98f800 uarg=0000000000000000 20000000:01000000:3.0:1789996402.294524:0:14875:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1789996402.294532:0:14875:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1789996402.294536:0:14875:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1789996402.295294:0:14876:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:3.0:1789996402.295430:0:14875:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:3.0:1789996402.304047:0:14875:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1789996402.304116:0:14875:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e087f856600/0x4173739f0fc817f5 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996402.304135:0:14875:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e087f857400/0x4173739f0fc817b6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4173739f0fc817af expref: 11 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996402.304144:0:14875:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8e087f856600/0x4173739f0fc817f5 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996402.304199:0:14875:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e087f857400/0x4173739f0fc817b6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4173739f0fc817af expref: 11 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996402.304215:0:14875:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e087f857400/0x4173739f0fc817b6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4173739f0fc817af expref: 11 pid: 14433 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789996402.304229:0:14875:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fa93800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14875:1876946942251648:0@lo:104: 00000100:00100000:3.0:1789996402.304292:0:14875:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996402.304463:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942251648 00000100:00100000:0.0:1789996402.304470:0:14425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942251648 00000100:00100000:0.0:1789996402.304513:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789996402.304523:0:14425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fa92300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d64f88b3-32d6-473c-b613-b936200ef7a3+3:14875:x1876946942251648:12345-0@lo:104: 00010000:00010000:0.0:1789996402.304535:0:14425:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.137@tcp lock: ffff8e086fcb6400/0x4173739f0fc817af lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4173739f0fc817b6 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996402.304595:0:14425:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789996402.304601:0:14425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fa92300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d64f88b3-32d6-473c-b613-b936200ef7a3+3:14875:x1876946942251648:12345-0@lo:104: Request processed in 80us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996402.304608:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789996402.304692:0:14875:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0848e42240 going to sleep for 11 seconds 00000100:00100000:3.0:1789996402.304717:0:14875:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fa93800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14875:1876946942251648:0@lo:104: 00010000:00010000:3.0:1789996402.304735:0:14875:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8e087f856600/0x4173739f0fc817f5 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996402.308158:0:14429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789996402.308171:0:14429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.137@tcp lock: ffff8e086fcb6400/0x4173739f0fc817af lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4173739f0fc817b6 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996402.308182:0:14429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e086fcb6400 already unused, calling callback (ffffffffc1be0c20) 10000000:00010000:1.0:1789996402.308197:0:14429:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.137@tcp lock: ffff8e086fcb6400/0x4173739f0fc817af lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4173739f0fc817b6 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996402.308207:0:14429:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.137@tcp lock: ffff8e086fcb6400/0x4173739f0fc817af lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4173739f0fc817b6 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789996402.308214:0:14429:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.137@tcp lock: ffff8e086fcb6400/0x4173739f0fc817af lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4173739f0fc817b6 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789996402.308220:0:14429:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789996402.308275:0:14429:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.137@tcp lock: ffff8e086fcb6400/0x4173739f0fc817af lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4173739f0fc817b6 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996402.308281:0:14429:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789996402.308306:0:14429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.137@tcp lock: ffff8e086fcb6400/0x4173739f0fc817af lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4173739f0fc817b6 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996402.308312:0:14429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.137@tcp lock: ffff8e086fcb6400/0x4173739f0fc817af lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4173739f0fc817b6 expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996402.308342:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789996402.308343:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789996402.308345:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789996402.308363:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fc98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d64f88b3-32d6-473c-b613-b936200ef7a3:3316:1876946942251776:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789996402.308426:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996402.308489:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942251776 00000100:00100000:1.0:1789996402.308496:0:14426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942251776 00010000:00010000:1.0:1789996402.308525:0:14426:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e087f857400/0x4173739f0fc817b6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4173739f0fc817af expref: 12 pid: 14433 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789996402.308630:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789996402.308640:0:14426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fc99880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d64f88b3-32d6-473c-b613-b936200ef7a3+12:3316:x1876946942251776:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789996402.308653:0:14426:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789996402.308659:0:14426:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e087f857400/0x4173739f0fc817b6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4173739f0fc817af expref: 12 pid: 14433 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996402.308670:0:14426:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e087f857400/0x4173739f0fc817b6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4173739f0fc817af expref: 12 pid: 14433 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996402.308683:0:14426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e087f857400/0x4173739f0fc817b6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4173739f0fc817af expref: 12 pid: 14433 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996402.308698:0:14426:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8e087f856600/0x4173739f0fc817f5 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996402.308706:0:14426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e087f856600/0x4173739f0fc817f5 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996402.308720:0:14426:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e087f856600/0x4173739f0fc817f5 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996402.308736:0:14426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e087f856600/0x4173739f0fc817f5 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996402.308743:0:14426:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e087f856600/0x4173739f0fc817f5 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996402.308749:0:14426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e087f856600/0x4173739f0fc817f5 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996402.308754:0:14426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e087f856600 already unused, calling callback (ffffffffc1595910) 00010000:00010000:1.0:1789996402.308758:0:14426:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e087f856600/0x4173739f0fc817f5 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996402.308765:0:14426:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e087f856600/0x4173739f0fc817f5 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996402.308776:0:14426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e087f856600/0x4173739f0fc817f5 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996402.308797:0:14426:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789996402.308833:0:14426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fc99880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d64f88b3-32d6-473c-b613-b936200ef7a3+11:3316:x1876946942251776:12345-0@lo:103:ldlm_bl.0 Request processed in 195us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996402.308841:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789996402.308881:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fc98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d64f88b3-32d6-473c-b613-b936200ef7a3:3316:1876946942251776:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789996402.309474:0:14875:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8e087f856600/0x4173739f0fc817f5 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996402.309484:0:14875:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e087f856600/0x4173739f0fc817f5 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996402.309490:0:14875:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e087f856600/0x4173739f0fc817f5 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996402.728715:0:14430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789996403.180436:0:3312:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789996393/real 1789996393] req@ffff8e086faefb80 x1876946942248832/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789996403 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789996403.180465:0:3312:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8e086faefb80 x1876946942248832/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789996403 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789996403.180490:0:3312:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789996393/real 1789996393] req@ffff8e086faeed80 x1876946942248704/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789996403 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789996403.180505:0:3312:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8e086faeed80 x1876946942248704/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789996403 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789996403.180522:0:3312:0:(import.c:65:import_set_state_nolock()) ffff8e0848960000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789996403.180565:0:3312:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789996403.180569:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086faefb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3312:1876946942248832:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1789996403.180583:0:3312:0:(import.c:65:import_set_state_nolock()) ffff8e0876bb2800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789996403.180589:0:3312:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789996403.180592:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086faeed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3312:1876946942248704:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1789996403.180778:0:12638:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789996403.180783:0:12638:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1789996403.180785:0:12638:0:(import.c:65:import_set_state_nolock()) ffff8e0876bb2800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789996403.180791:0:12638:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 435 00000100:00080000:3.0:1789996403.180796:0:12638:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1789996403.180806:0:12638:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8e0876bb2800 using connection 192.168.204.137@tcp/0@lo 00000100:00100000:3.0:1789996403.180840:0:12638:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e086fa93800 x1876946942251904/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789996403.180856:0:12638:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789996403.180859:0:12638:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789996403.180861:0:12638:0:(import.c:65:import_set_state_nolock()) ffff8e0848960000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789996403.180863:0:12638:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 435 00000100:00080000:3.0:1789996403.180866:0:12638:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1789996403.180870:0:12638:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8e0848960000 using connection 192.168.204.137@tcp/0@lo 00000100:00100000:3.0:1789996403.180882:0:12638:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e086fa91f80 x1876946942252032/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789996403.180928:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fa91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876946942252160:0@lo:400:kworker.0 00000100:00100000:3.0:1789996403.180995:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789996403.181060:0:14441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942252160 00000100:00100000:3.0:1789996403.181068:0:14441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942252160 00000100:00100000:3.0:1789996403.181109:0:14441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789996403.181117:0:14441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fa90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876946942252160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789996403.181161:0:14441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fa90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876946942252160:12345-0@lo:400:kworker.0 Request processed in 45us (165us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996403.181191:0:14441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1789996403.181237:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8e086fa91c00 x1876946942252160/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789996419 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789996403.181250:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fa91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876946942252160:0@lo:400:kworker.0 00000100:00100000:0.0:1789996403.181361:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fa93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3312:1876946942251904:0@lo:8:kworker.0 00000400:00000100:0.0:1789996403.181386:0:3312:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876946942251904 offset 0 length 520: 4 00000100:00100000:0.0:1789996403.181405:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fa91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3312:1876946942252032:0@lo:8:kworker.0 00000400:00000100:0.0:1789996403.181417:0:3312:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876946942252032 offset 0 length 520: 4 00010000:00010000:2.0:1789996403.752788:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789996403.753737:0:14438:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789996403.753742:0:14438:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e087fbc4800 from 10 10000000:01000000:1.0:1789996403.753746:0:14438:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789996403.753790:0:14438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.137@tcp lock: ffff8e0876a22600/0x4173739f0fc817fc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996403.753811:0:14438:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.137@tcp lock: ffff8e0876a22600/0x4173739f0fc817fc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996403.753822:0:14438:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.137@tcp lock: ffff8e0876a22600/0x4173739f0fc817fc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789996403.753848:0:14438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fc98e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d64f88b3-32d6-473c-b613-b936200ef7a3:14438:1876946942252288:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789996403.753917:0:14438:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996403.754004:0:14438:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e08704a2600 going to sleep for 11 seconds 00000100:00100000:2.0:1789996403.757329:0:14433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942252288 00000100:00100000:2.0:1789996403.757351:0:14433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942252288 00000100:00100000:2.0:1789996403.757458:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789996403.757469:0:14433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fdecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d64f88b3-32d6-473c-b613-b936200ef7a3+11:14438:x1876946942252288:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789996403.757484:0:14433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789996403.757502:0:14433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e08429c7600/0x4173739f0fc81803 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4173739f0fc817fc expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996403.757529:0:14433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e08429c7600/0x4173739f0fc81803 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4173739f0fc817fc expref: 12 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996403.757565:0:14433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e08429c7600/0x4173739f0fc81803 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4173739f0fc817fc expref: 12 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996403.757575:0:14433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e08429c7600, rc 0) 00000100:00100000:2.0:1789996403.757690:0:14433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fdecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d64f88b3-32d6-473c-b613-b936200ef7a3+12:14438:x1876946942252288:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 223us (3772us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996403.757696:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789996403.757794:0:14438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fc98e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d64f88b3-32d6-473c-b613-b936200ef7a3:14438:1876946942252288:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789996403.757812:0:14438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.137@tcp lock: ffff8e0876a22600/0x4173739f0fc817fc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc81803 expref: -99 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996403.757821:0:14438:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.137@tcp lock: ffff8e0876a22600/0x4173739f0fc817fc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4173739f0fc81803 expref: -99 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789996403.757884:0:14438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fc98e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d64f88b3-32d6-473c-b613-b936200ef7a3:14438:1876946942252416:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789996403.757916:0:14438:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996403.759045:0:14438:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e08704a2600 going to sleep for 11 seconds 00000100:00100000:3.0:1789996403.759479:0:14436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942252416 00000100:00100000:3.0:1789996403.759487:0:14436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942252416 00000100:00100000:3.0:1789996403.759529:0:14436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789996403.759538:0:14436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0877ad7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d64f88b3-32d6-473c-b613-b936200ef7a3+12:14438:x1876946942252416:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789996403.759839:0:14436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0877ad7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d64f88b3-32d6-473c-b613-b936200ef7a3+12:14438:x1876946942252416:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 301us (1922us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996403.759847:0:14436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789996403.759965:0:14438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fc98e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d64f88b3-32d6-473c-b613-b936200ef7a3:14438:1876946942252416:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789996403.760010:0:14438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fc98e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d64f88b3-32d6-473c-b613-b936200ef7a3:14438:1876946942252544:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789996403.760064:0:14438:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996403.760085:0:14438:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e08704a2600 going to sleep for 11 seconds 00000100:00100000:3.0:1789996403.760283:0:14436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942252544 00000100:00100000:3.0:1789996403.760288:0:14436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942252544 00000100:00100000:3.0:1789996403.760308:0:14436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789996403.760315:0:14436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0877ad6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d64f88b3-32d6-473c-b613-b936200ef7a3+12:14438:x1876946942252544:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789996403.760496:0:14436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0877ad6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d64f88b3-32d6-473c-b613-b936200ef7a3+12:14438:x1876946942252544:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 181us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996403.760504:0:14436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789996403.764347:0:14438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fc98e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d64f88b3-32d6-473c-b613-b936200ef7a3:14438:1876946942252544:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789996403.772876:0:14943:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1789996403.773075:0:14438:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1789996403.773111:0:14438:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.137@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789996403.773122:0:14438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.137@tcp lock: ffff8e0876a22600/0x4173739f0fc817fc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc81803 expref: -99 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996403.773133:0:14438:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.137@tcp lock: ffff8e0876a22600/0x4173739f0fc817fc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc81803 expref: -99 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996404.776778:0:14430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789996405.160808:0:14475:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789996405.160821:0:14475:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789996405.161398:0:14475:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:3.0:1789996405.161465:0:14475:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789996405.161498:0:14475:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 1 count 1 00010000:00010000:2.0:1789996405.808257:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789996406.824790:0:14430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1789996407.127367:0:15123:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1789996407.127371:0:15123:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:0.0:1789996407.127504:0:15123:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8e08704c6000 00000020:01000004:0.0:1789996407.127520:0:15123:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1789996407.127532:0:15123:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1789996407.127768:0:15123:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8e087f8c4d40) 00000020:00000080:0.0:1789996407.127786:0:15123:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1789996407.145910:0:15123:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1789996407.146277:0:15123:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:0.0:1789996407.147078:0:15123:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1789996407.147418:0:15123:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:0.0:1789996407.151386:0:15123:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:0.0:1789996407.155494:0:15123:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 419: rc = 0 00100000:10000000:0.0:1789996407.155645:0:15123:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 419: rc = 0 00100000:10000000:0.0:1789996407.156123:0:15123:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 419: rc = 0 00100000:10000000:0.0:1789996407.158002:0:15123:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 472: rc = 0 00100000:10000000:0.0:1789996407.158480:0:15123:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 472: rc = 0 00100000:10000000:0.0:1789996407.158789:0:15123:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 472: rc = 0 00100000:10000000:0.0:1789996407.159043:0:15123:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 472: rc = 0 00100000:10000000:0.0:1789996407.161904:0:15123:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 472: rc = 0 00100000:10000000:0.0:1789996407.162494:0:15123:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 472: rc = 0 00000020:00000080:0.0:1789996407.164593:0:15123:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:0.0:1789996407.164606:0:15123:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:0.0:1789996407.164619:0:15123:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x4173739f0fc81811 00000020:01000004:0.0:1789996407.164627:0:15123:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:0.0:1789996407.164646:0:15123:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.137@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1789996407.164650:0:15123:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.137@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1789996407.164656:0:15123:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:0.0:1789996407.164660:0:15123:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:0.0:1789996407.164678:0:15123:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8e087a34cd40) 00000020:00000080:0.0:1789996407.164689:0:15123:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:1.0:1789996407.168851:0:15123:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789996407.169067:0:15123:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:1.0:1789996407.169074:0:15123:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1789996407.172535:0:15123:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1789996407.172568:0:15123:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1789996407.172958:0:15123:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1789996407.172965:0:15123:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1789996407.175600:0:15123:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789996407.175791:0:15123:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1789996407.175797:0:15123:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1789996407.183126:0:15123:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1789996407.183146:0:15123:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1789996407.228718:0:15123:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789996407.229216:0:15123:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1789996407.229223:0:15123:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1789996407.236843:0:15123:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1789996407.236861:0:15123:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1789996407.241808:0:15123:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1789996407.241830:0:15123:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1789996407.247002:0:15123:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789996407.247341:0:15123:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1789996407.247348:0:15123:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1789996407.253642:0:15123:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1789996407.253659:0:15123:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1789996407.290818:0:15123:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789996407.291028:0:15123:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1789996407.291035:0:15123:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1789996407.293485:0:15123:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1789996407.293497:0:15123:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1789996407.296620:0:15123:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1789996407.296655:0:15123:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:0.0:1789996407.296666:0:15123:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.137@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1789996407.316491:0:15123:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.137@tcp ctxt 0 is initialized 00000020:01000004:1.0:1789996407.316539:0:15123:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.137@tcp, index=0000, flags=0x20002 00000020:01000004:1.0:1789996407.316572:0:15123:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1789996407.316574:0:15123:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789996407.316576:0:15123:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789996407.316578:0:15123:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789996407.316579:0:15123:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789996407.316581:0:15123:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789996407.316582:0:15123:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789996407.316585:0:15123:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789996407.316586:0:15123:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789996407.316590:0:15123:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:1.0:1789996407.316592:0:15123:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789996407.316594:0:15123:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789996407.316595:0:15123:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789996407.316602:0:15123:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789996407.316603:0:15123:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789996407.316604:0:15123:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789996407.316605:0:15123:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789996407.316606:0:15123:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789996407.316607:0:15123:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789996407.316637:0:15123:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1789996407.316660:0:15123:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fc98e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d64f88b3-32d6-473c-b613-b936200ef7a3:15123:1876946942252672:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789996407.316879:0:15123:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996407.316933:0:15123:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0844df9840 going to sleep for 11 seconds 00000100:00100000:3.0:1789996407.317010:0:14436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942252672 00000100:00100000:3.0:1789996407.317024:0:14436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942252672 00000100:00100000:3.0:1789996407.317075:0:14436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789996407.317084:0:14436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0877ad7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d64f88b3-32d6-473c-b613-b936200ef7a3+12:15123:x1876946942252672:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1789996407.317123:0:14436:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1789996407.317126:0:14436:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:3.0:1789996407.317131:0:14436:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1789996407.384943:0:14436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0877ad7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d64f88b3-32d6-473c-b613-b936200ef7a3+12:15123:x1876946942252672:12345-0@lo:253:mount.lustre.0 Request processed in 67849us (68053us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996407.384959:0:14436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789996407.385084:0:15123:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fc98e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d64f88b3-32d6-473c-b613-b936200ef7a3:15123:1876946942252672:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789996407.385125:0:15123:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1789996407.385129:0:15123:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789996407.385141:0:15123:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789996407.385142:0:15123:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789996407.385144:0:15123:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789996407.385145:0:15123:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789996407.385151:0:15123:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789996407.385153:0:15123:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789996407.385155:0:15123:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789996407.385156:0:15123:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1789996407.385176:0:15123:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8e08704c6000 from lustre-OST0000 10000000:01000000:2.0:1789996407.385206:0:15123:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1789996407.385209:0:15123:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1789996407.385215:0:15123:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8e0876658000 local copy 00010000:00010000:2.0:1789996407.385226:0:15123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.137@tcp lock: ffff8e087f857a00/0x4173739f0fc81707 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc8170e expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789996407.385475:0:15123:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086faedc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d64f88b3-32d6-473c-b613-b936200ef7a3:15123:1876946942252800:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789996407.385511:0:15123:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996407.385604:0:15123:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0848e42b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789996407.385890:0:14435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942252800 00000100:00100000:1.0:1789996407.385898:0:14435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942252800 00000100:00100000:1.0:1789996407.385941:0:14435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789996407.385949:0:14435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0877ad4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d64f88b3-32d6-473c-b613-b936200ef7a3+12:15123:x1876946942252800:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789996407.386128:0:14435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0877ad4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d64f88b3-32d6-473c-b613-b936200ef7a3+12:15123:x1876946942252800:12345-0@lo:501:mount.lustre.0 Request processed in 179us (615us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789996407.386152:0:14435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789996407.386283:0:15123:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086faedc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d64f88b3-32d6-473c-b613-b936200ef7a3:15123:1876946942252800:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1789996407.386304:0:15123:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.137@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1789996407.386462:0:15123:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.137@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1789996407.386469:0:15123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.137@tcp lock: ffff8e087f857a00/0x4173739f0fc81707 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc8170e expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996407.386480:0:15123:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.137@tcp lock: ffff8e087f857a00/0x4173739f0fc81707 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc8170e expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789996407.386504:0:15123:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8e08704c6000 10000000:01000000:3.0:1789996407.386509:0:15123:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789996407.386514:0:15123:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8e0876658000 10000000:01000000:3.0:1789996407.386516:0:15123:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1789996407.386520:0:15123:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8e0876658000 from 1 10000000:01000000:3.0:1789996407.386522:0:15123:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1789996407.386580:0:15123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.137@tcp lock: ffff8e087f856600/0x4173739f0fc8181f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996407.386589:0:15123:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.137@tcp lock: ffff8e087f856600/0x4173739f0fc8181f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996407.386599:0:15123:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.137@tcp lock: ffff8e087f856600/0x4173739f0fc8181f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789996407.386626:0:15123:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fa91c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d64f88b3-32d6-473c-b613-b936200ef7a3:15123:1876946942252928:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789996407.386658:0:15123:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789996407.386679:0:15123:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e086d5920c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789996407.387011:0:14436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942252928 00000100:00100000:1.0:1789996407.387017:0:14436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942252928 00000100:00100000:1.0:1789996407.387054:0:14436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789996407.387062:0:14436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0877ad6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d64f88b3-32d6-473c-b613-b936200ef7a3+12:15123:x1876946942252928:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789996407.387073:0:14436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789996407.387097:0:14436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e0876a22200/0x4173739f0fc81826 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4173739f0fc8181f expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996407.387119:0:14436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e0876a22200/0x4173739f0fc81826 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4173739f0fc8181f expref: 13 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996407.387161:0:14436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e0876a22200/0x4173739f0fc81826 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4173739f0fc8181f expref: 13 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996407.387171:0:14436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e0876a22200, rc 0) 00000100:00100000:1.0:1789996407.387206:0:14436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0877ad6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d64f88b3-32d6-473c-b613-b936200ef7a3+13:15123:x1876946942252928:12345-0@lo:101:mount.lustre.0 Request processed in 144us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996407.387212:0:14436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789996407.387982:0:15123:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fa91c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d64f88b3-32d6-473c-b613-b936200ef7a3:15123:1876946942252928:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789996407.387999:0:15123:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.137@tcp lock: ffff8e087f856600/0x4173739f0fc8181f lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc81826 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996407.388008:0:15123:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.137@tcp lock: ffff8e087f856600/0x4173739f0fc8181f lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4173739f0fc81826 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789996407.388026:0:15123:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.137@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1789996407.388041:0:15123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.137@tcp lock: ffff8e087f856600/0x4173739f0fc8181f lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc81826 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996407.388048:0:15123:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.137@tcp lock: ffff8e087f856600/0x4173739f0fc8181f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc81826 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789996407.388055:0:15123:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1789996407.388060:0:15123:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789996407.388065:0:15123:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1789996407.388067:0:15123:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1789996407.388099:0:15123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.137@tcp lock: ffff8e087f857c00/0x4173739f0fc8182d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996407.388107:0:15123:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.137@tcp lock: ffff8e087f857c00/0x4173739f0fc8182d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996407.388114:0:15123:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.137@tcp lock: ffff8e087f857c00/0x4173739f0fc8182d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789996407.388156:0:15123:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fa91c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d64f88b3-32d6-473c-b613-b936200ef7a3:15123:1876946942253056:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789996407.388190:0:15123:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789996407.388225:0:15123:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e086d5920c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789996407.388334:0:14436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942253056 00000100:00100000:2.0:1789996407.388339:0:14436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942253056 00000100:00100000:2.0:1789996407.388375:0:14436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789996407.388383:0:14436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0877ad6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d64f88b3-32d6-473c-b613-b936200ef7a3+13:15123:x1876946942253056:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789996407.388391:0:14436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789996407.388401:0:14436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e08429c6600/0x4173739f0fc81834 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4173739f0fc8182d expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996407.388431:0:14436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e08429c6600/0x4173739f0fc81834 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4173739f0fc8182d expref: 14 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996407.388440:0:14436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e08429c6600/0x4173739f0fc81834 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4173739f0fc8182d expref: 14 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996407.388454:0:14436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e08429c6600, rc 0) 00000100:00100000:2.0:1789996407.388486:0:14436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0877ad6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d64f88b3-32d6-473c-b613-b936200ef7a3+14:15123:x1876946942253056:12345-0@lo:101:mount.lustre.0 Request processed in 105us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996407.388492:0:14436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789996407.390621:0:15123:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fa91c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d64f88b3-32d6-473c-b613-b936200ef7a3:15123:1876946942253056:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789996407.390646:0:15123:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.137@tcp lock: ffff8e087f857c00/0x4173739f0fc8182d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc81834 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996407.390657:0:15123:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.137@tcp lock: ffff8e087f857c00/0x4173739f0fc8182d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x4173739f0fc81834 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789996407.392428:0:15123:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1789996407.395356:0:15123:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789996407.395995:0:15123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1789996407.396046:0:15123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1789996407.396081:0:15123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1789996407.396277:0:15123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1789996407.396318:0:15123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1789996407.396351:0:15123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1789996407.396425:0:15123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1789996407.396435:0:15123:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1789996407.396968:0:15123:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086faee680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d64f88b3-32d6-473c-b613-b936200ef7a3:15123:1876946942253184:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789996407.397038:0:15123:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996407.397131:0:15123:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0848e42b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789996407.400999:0:14435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942253184 00000100:00100000:3.0:1789996407.401015:0:14435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942253184 00000100:00100000:3.0:1789996407.401100:0:14435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789996407.401112:0:14435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0877ad4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d64f88b3-32d6-473c-b613-b936200ef7a3+14:15123:x1876946942253184:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789996407.404351:0:14435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0877ad4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d64f88b3-32d6-473c-b613-b936200ef7a3+14:15123:x1876946942253184:12345-0@lo:501:mount.lustre.0 Request processed in 3235us (7306us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996407.404364:0:14435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789996407.404643:0:15123:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086faee680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d64f88b3-32d6-473c-b613-b936200ef7a3:15123:1876946942253184:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789996407.404698:0:15123:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086faee680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d64f88b3-32d6-473c-b613-b936200ef7a3:15123:1876946942253312:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789996407.404752:0:15123:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996407.404780:0:15123:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0848e42b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789996407.405678:0:14433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942253312 00000100:00100000:3.0:1789996407.405688:0:14433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942253312 00000100:00100000:1.0:1789996407.406002:0:14436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789996407.406016:0:14436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0877ad4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d64f88b3-32d6-473c-b613-b936200ef7a3+14:15123:x1876946942253312:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789996407.408916:0:15123:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086faee680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d64f88b3-32d6-473c-b613-b936200ef7a3:15123:1876946942253312:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789996407.409004:0:14436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0877ad4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d64f88b3-32d6-473c-b613-b936200ef7a3+14:15123:x1876946942253312:12345-0@lo:503:mount.lustre.0 Request processed in 2842us (4102us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996407.409016:0:14436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000040:00080000:2.0:1789996407.409964:0:15123:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789996407.410039:0:15123:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086faee680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d64f88b3-32d6-473c-b613-b936200ef7a3:15123:1876946942253440:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789996407.410113:0:15123:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996407.410276:0:15123:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0844df9840 going to sleep for 11 seconds 00000100:00100000:3.0:1789996407.410479:0:14435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942253440 00000100:00100000:3.0:1789996407.410488:0:14435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942253440 00000100:00100000:3.0:1789996407.410537:0:14435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789996407.410569:0:14435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0877ad4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d64f88b3-32d6-473c-b613-b936200ef7a3+14:15123:x1876946942253440:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789996407.410901:0:14435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0877ad4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d64f88b3-32d6-473c-b613-b936200ef7a3+14:15123:x1876946942253440:12345-0@lo:502:mount.lustre.0 Request processed in 335us (787us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996407.410918:0:14435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789996407.411079:0:15123:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086faee680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d64f88b3-32d6-473c-b613-b936200ef7a3:15123:1876946942253440:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789996407.411465:0:15123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:0.0:1789996407.411517:0:15123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1789996407.411968:0:15123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1789996407.412037:0:15123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1789996407.412077:0:15123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1789996407.412130:0:15123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1789996407.412328:0:15123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1789996407.412366:0:15123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1789996407.412422:0:15123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:2.0:1789996407.412489:0:15123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:2.0:1789996407.412532:0:15123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:2.0:1789996407.413727:0:15123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:2.0:1789996407.413898:0:15123:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086faeca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d64f88b3-32d6-473c-b613-b936200ef7a3:15123:1876946942253568:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789996407.413987:0:15123:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996407.414100:0:15123:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0848e42b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789996407.417694:0:14436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942253568 00000100:00100000:1.0:1789996407.417712:0:14436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942253568 00000100:00100000:1.0:1789996407.417838:0:14436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789996407.417850:0:14436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0877ad7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d64f88b3-32d6-473c-b613-b936200ef7a3+14:15123:x1876946942253568:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789996407.418161:0:14436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0877ad7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d64f88b3-32d6-473c-b613-b936200ef7a3+14:15123:x1876946942253568:12345-0@lo:502:mount.lustre.0 Request processed in 313us (4174us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996407.418170:0:14436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789996407.418276:0:15123:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086faeca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d64f88b3-32d6-473c-b613-b936200ef7a3:15123:1876946942253568:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789996407.418390:0:15123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:0.0:1789996407.418405:0:15123:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:2.0:1789996407.419947:0:15140:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789996407.419957:0:15140:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:2.0:1789996407.419964:0:15140:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789996407.419966:0:15140:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1789996407.419973:0:15140:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789996407.419989:0:15140:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8e0879950000) 00000020:00000080:2.0:1789996407.420009:0:15140:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:2.0:1789996407.420014:0:15140:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1789996407.420103:0:15140:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e08704c6000 from lustre-OST0000, refs=2 00080000:01000000:2.0:1789996407.420112:0:15140:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789996407.420118:0:15140:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x4173739f0fc81842 00010000:00010000:2.0:1789996407.425758:0:15140:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:2.0:1789996407.426480:0:15140:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:2.0:1789996407.428706:0:15140:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:2.0:1789996407.431914:0:15140:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1789996407.431928:0:15140:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789996407.431936:0:15140:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789996407.431939:0:15140:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1789996407.431943:0:15140:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1789996407.431956:0:15140:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:2.0:1789996407.431957:0:15140:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789996407.431959:0:15140:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789996407.431961:0:15140:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1789996407.431963:0:15140:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789996407.431964:0:15140:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:2.0:1789996407.431967:0:15140:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789996407.431969:0:15140:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789996407.431970:0:15140:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789996407.431973:0:15140:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789996407.431975:0:15140:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1789996407.431977:0:15140:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789996407.431979:0:15140:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789996407.431981:0:15140:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:2.0:1789996407.431983:0:15140:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789996407.431985:0:15140:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789996407.431986:0:15140:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1789996407.431989:0:15140:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1789996407.432058:0:15140:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789996407.432061:0:15140:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789996407.432062:0:15140:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1789996407.432066:0:15140:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:0.0:1789996407.437298:0:15123:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:0.0:1789996407.437342:0:15123:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.137@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1789996407.438316:0:15123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.137@tcp lock: ffff8e087f857c00/0x4173739f0fc8182d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc81834 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996407.438331:0:15123:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.137@tcp lock: ffff8e087f857c00/0x4173739f0fc8182d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc81834 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789996407.440309:0:15123:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e08704c6000 from 1 10000000:01000000:0.0:1789996407.440318:0:15123:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789996407.440366:0:15123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.137@tcp lock: ffff8e086fcb7000/0x4173739f0fc81849 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996407.440377:0:15123:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.137@tcp lock: ffff8e086fcb7000/0x4173739f0fc81849 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996407.440388:0:15123:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.137@tcp lock: ffff8e086fcb7000/0x4173739f0fc81849 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789996407.440413:0:15123:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0741a28700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d64f88b3-32d6-473c-b613-b936200ef7a3:15123:1876946942253696:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789996407.440489:0:15123:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996407.440535:0:15123:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0849c250c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789996407.440944:0:14433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942253696 00000100:00100000:2.0:1789996407.440953:0:14433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942253696 00000100:00100000:2.0:1789996407.441005:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789996407.441015:0:14433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0877ad5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d64f88b3-32d6-473c-b613-b936200ef7a3+14:15123:x1876946942253696:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789996407.441028:0:14433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789996407.441041:0:14433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e08429c7200/0x4173739f0fc81850 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4173739f0fc81849 expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996407.441064:0:14433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e08429c7200/0x4173739f0fc81850 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4173739f0fc81849 expref: 15 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996407.441074:0:14433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e08429c7200/0x4173739f0fc81850 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4173739f0fc81849 expref: 15 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996407.441101:0:14433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e08429c7200, rc 0) 00000100:00100000:2.0:1789996407.441224:0:14433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0877ad5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d64f88b3-32d6-473c-b613-b936200ef7a3+15:15123:x1876946942253696:12345-0@lo:101:mount.lustre.0 Request processed in 209us (733us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996407.441231:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789996407.441697:0:15123:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0741a28700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d64f88b3-32d6-473c-b613-b936200ef7a3:15123:1876946942253696:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789996407.441713:0:15123:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.137@tcp lock: ffff8e086fcb7000/0x4173739f0fc81849 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc81850 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996407.441724:0:15123:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.137@tcp lock: ffff8e086fcb7000/0x4173739f0fc81849 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4173739f0fc81850 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789996407.442437:0:15123:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:0.0:1789996407.444125:0:15123:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789996407.445016:0:15123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1789996407.445072:0:15123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1789996407.445303:0:15123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1789996407.445312:0:15123:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1789996407.445412:0:15123:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fc98000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d64f88b3-32d6-473c-b613-b936200ef7a3:15123:1876946942253824:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789996407.445474:0:15123:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996407.445525:0:15123:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e08475afe40 going to sleep for 11 seconds 00000100:00100000:2.0:1789996407.445719:0:14436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942253824 00000100:00100000:2.0:1789996407.445727:0:14436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942253824 00000100:00100000:2.0:1789996407.445926:0:14436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789996407.445938:0:14436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0877ad7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d64f88b3-32d6-473c-b613-b936200ef7a3+15:15123:x1876946942253824:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789996407.446193:0:14436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0877ad7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d64f88b3-32d6-473c-b613-b936200ef7a3+15:15123:x1876946942253824:12345-0@lo:501:mount.lustre.0 Request processed in 257us (718us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996407.446201:0:14436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789996407.446277:0:15123:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fc98000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d64f88b3-32d6-473c-b613-b936200ef7a3:15123:1876946942253824:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789996407.446312:0:15123:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fc98000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d64f88b3-32d6-473c-b613-b936200ef7a3:15123:1876946942253952:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789996407.446352:0:15123:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996407.446698:0:15123:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e08475afe40 going to sleep for 11 seconds 00000100:00100000:3.0:1789996407.446784:0:14433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942253952 00000100:00100000:3.0:1789996407.446797:0:14433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942253952 00000100:00100000:3.0:1789996407.446823:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789996407.446831:0:14433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0877ad5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d64f88b3-32d6-473c-b613-b936200ef7a3+15:15123:x1876946942253952:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789996407.446982:0:14433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0877ad5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d64f88b3-32d6-473c-b613-b936200ef7a3+15:15123:x1876946942253952:12345-0@lo:503:mount.lustre.0 Request processed in 151us (629us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996407.446989:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789996407.447064:0:15123:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fc98000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d64f88b3-32d6-473c-b613-b936200ef7a3:15123:1876946942253952:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789996407.447709:0:15123:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789996407.447775:0:15123:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fc98000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d64f88b3-32d6-473c-b613-b936200ef7a3:15123:1876946942254080:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789996407.447820:0:15123:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996407.447840:0:15123:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e08475afe40 going to sleep for 11 seconds 00000100:00100000:3.0:1789996407.448101:0:14433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942254080 00000100:00100000:3.0:1789996407.448107:0:14433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942254080 00000100:00100000:3.0:1789996407.448150:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789996407.448157:0:14433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0877ad5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d64f88b3-32d6-473c-b613-b936200ef7a3+15:15123:x1876946942254080:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789996407.448320:0:14433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0877ad5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d64f88b3-32d6-473c-b613-b936200ef7a3+15:15123:x1876946942254080:12345-0@lo:502:mount.lustre.0 Request processed in 162us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996407.448327:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789996407.448508:0:15123:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fc98000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d64f88b3-32d6-473c-b613-b936200ef7a3:15123:1876946942254080:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789996407.448761:0:15123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1789996407.448824:0:15123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1789996407.448875:0:15123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1789996407.448912:0:15123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1789996407.448964:0:15123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1789996407.449014:0:15123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1789996407.449051:0:15123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1789996407.449097:0:15123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:1.0:1789996407.449127:0:15123:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fc98000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d64f88b3-32d6-473c-b613-b936200ef7a3:15123:1876946942254208:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789996407.449335:0:15123:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996407.449367:0:15123:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e08475afe40 going to sleep for 11 seconds 00000100:00100000:3.0:1789996407.449501:0:14433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942254208 00000100:00100000:3.0:1789996407.449508:0:14433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942254208 00000100:00100000:3.0:1789996407.449533:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789996407.449552:0:14433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0877ad5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d64f88b3-32d6-473c-b613-b936200ef7a3+15:15123:x1876946942254208:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789996407.449701:0:14433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0877ad5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d64f88b3-32d6-473c-b613-b936200ef7a3+15:15123:x1876946942254208:12345-0@lo:502:mount.lustre.0 Request processed in 160us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996407.449708:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789996407.449822:0:15123:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fc98000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d64f88b3-32d6-473c-b613-b936200ef7a3:15123:1876946942254208:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789996407.449906:0:15123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1789996407.449916:0:15123:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:1.0:1789996407.450969:0:15144:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789996407.450986:0:15144:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789996407.450988:0:15144:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789996407.450998:0:15144:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e08704c6000 00000020:00000080:1.0:1789996407.451000:0:15144:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789996407.451007:0:15144:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789996407.451009:0:15144:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789996407.451011:0:15144:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1789996407.451013:0:15144:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789996407.451015:0:15144:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789996407.451016:0:15144:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789996407.451019:0:15144:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e08704c6000 00000020:00000080:1.0:1789996407.451020:0:15144:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789996407.451078:0:15144:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789996407.451082:0:15144:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789996407.451093:0:15144:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1789996407.451097:0:15144:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789996407.451100:0:15144:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789996407.451101:0:15144:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789996407.451104:0:15144:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8e08704c6000 00000020:00000080:1.0:1789996407.451107:0:15144:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789996407.453323:0:15144:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789996407.453334:0:15144:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789996407.453336:0:15144:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1789996407.453343:0:15144:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:1.0:1789996407.453476:0:15123:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1789996407.453506:0:15123:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.137@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789996407.453521:0:15123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.137@tcp lock: ffff8e086fcb7000/0x4173739f0fc81849 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc81850 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996407.453534:0:15123:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.137@tcp lock: ffff8e086fcb7000/0x4173739f0fc81849 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc81850 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789996407.453611:0:15123:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1789996407.453620:0:15123:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8e08704c6000 10000000:01000000:1.0:1789996407.453623:0:15123:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8e08704c6000 10000000:01000000:1.0:1789996407.453627:0:15123:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789996407.453632:0:15123:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8e08704c6000 from 1 10000000:01000000:1.0:1789996407.453635:0:15123:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789996407.453667:0:15123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.137@tcp lock: ffff8e0876a23a00/0x4173739f0fc81857 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996407.453676:0:15123:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.137@tcp lock: ffff8e0876a23a00/0x4173739f0fc81857 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996407.453687:0:15123:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.137@tcp lock: ffff8e0876a23a00/0x4173739f0fc81857 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789996407.453710:0:15123:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fc98000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d64f88b3-32d6-473c-b613-b936200ef7a3:15123:1876946942254336:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789996407.453769:0:15123:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789996407.453899:0:14433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942254336 00000100:00100000:3.0:1789996407.453907:0:14433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942254336 00000100:00100000:3.0:1789996407.453943:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789996407.453953:0:14433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0877ad0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d64f88b3-32d6-473c-b613-b936200ef7a3+15:15123:x1876946942254336:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789996407.453973:0:14433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789996407.453987:0:14433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e087f856400/0x4173739f0fc8185e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4173739f0fc81857 expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996407.454009:0:14433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e087f856400/0x4173739f0fc8185e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4173739f0fc81857 expref: 16 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996407.454020:0:14433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e087f856400/0x4173739f0fc8185e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4173739f0fc81857 expref: 16 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996407.454029:0:14433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e087f856400, rc 0) 00000100:00100000:3.0:1789996407.454170:0:14433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0877ad0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d64f88b3-32d6-473c-b613-b936200ef7a3+16:15123:x1876946942254336:12345-0@lo:101:mount.lustre.0 Request processed in 218us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996407.454178:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789996407.459332:0:15123:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e08475af900 going to sleep for 11 seconds 00000100:00100000:1.0:1789996407.459375:0:15123:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fc98000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d64f88b3-32d6-473c-b613-b936200ef7a3:15123:1876946942254336:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789996407.459565:0:15123:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.137@tcp lock: ffff8e0876a23a00/0x4173739f0fc81857 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc8185e expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996407.459581:0:15123:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.137@tcp lock: ffff8e0876a23a00/0x4173739f0fc81857 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x4173739f0fc8185e expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789996407.460533:0:15123:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:1.0:1789996407.461563:0:15123:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789996407.461841:0:15123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1789996407.463709:0:15123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1789996407.463755:0:15123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1789996407.463820:0:15123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1789996407.464724:0:15123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1789996407.464802:0:15123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1789996407.464843:0:15123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1789996407.464894:0:15123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1789996407.464961:0:15123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1789996407.464996:0:15123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1789996407.465033:0:15123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1789996407.465083:0:15123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1789996407.465144:0:15123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1789996407.465180:0:15123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1789996407.465248:0:15123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1789996407.465287:0:15123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1789996407.465325:0:15123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1789996407.465377:0:15123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1789996407.470688:0:15123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1789996407.470771:0:15123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1789996407.470839:0:15123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1789996407.470889:0:15123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1789996407.470924:0:15123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1789996407.470986:0:15123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1789996407.471037:0:15123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:1.0:1789996407.471072:0:15123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:1.0:1789996407.471137:0:15123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:1.0:1789996407.471173:0:15123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:1.0:1789996407.471279:0:15123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:1.0:1789996407.471287:0:15123:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:1.0:1789996407.472574:0:15123:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fc98000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d64f88b3-32d6-473c-b613-b936200ef7a3:15123:1876946942254464:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789996407.472642:0:15123:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996407.472683:0:15123:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e08475af900 going to sleep for 11 seconds 00000100:00100000:3.0:1789996407.472916:0:14433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942254464 00000100:00100000:3.0:1789996407.472924:0:14433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942254464 00000100:00100000:3.0:1789996407.472979:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789996407.472988:0:14433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0877ad3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d64f88b3-32d6-473c-b613-b936200ef7a3+16:15123:x1876946942254464:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789996407.474556:0:14433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0877ad3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d64f88b3-32d6-473c-b613-b936200ef7a3+16:15123:x1876946942254464:12345-0@lo:501:mount.lustre.0 Request processed in 1552us (1897us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996407.474566:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789996407.474902:0:15123:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fc98000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d64f88b3-32d6-473c-b613-b936200ef7a3:15123:1876946942254464:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789996407.474951:0:15123:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fc98000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d64f88b3-32d6-473c-b613-b936200ef7a3:15123:1876946942254592:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789996407.474996:0:15123:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996407.475020:0:15123:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e08475af900 going to sleep for 11 seconds 00000100:00100000:3.0:1789996407.475622:0:14435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942254592 00000100:00100000:3.0:1789996407.475628:0:14435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942254592 00000100:00100000:3.0:1789996407.475701:0:14435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789996407.475710:0:14435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0877ad2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d64f88b3-32d6-473c-b613-b936200ef7a3+16:15123:x1876946942254592:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789996407.475889:0:14435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0877ad2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d64f88b3-32d6-473c-b613-b936200ef7a3+16:15123:x1876946942254592:12345-0@lo:503:mount.lustre.0 Request processed in 180us (892us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996407.475906:0:14435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789996407.477444:0:15123:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fc98000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d64f88b3-32d6-473c-b613-b936200ef7a3:15123:1876946942254592:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1789996407.478036:0:15123:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789996407.478125:0:15123:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0741a28700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d64f88b3-32d6-473c-b613-b936200ef7a3:15123:1876946942254720:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789996407.478252:0:15123:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996407.483372:0:15123:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0849c25780 going to sleep for 11 seconds 00000100:00100000:1.0:1789996407.486000:0:14436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942254720 00000100:00100000:1.0:1789996407.486012:0:14436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942254720 00000100:00100000:1.0:1789996407.486071:0:14436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789996407.486081:0:14436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0877ad0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d64f88b3-32d6-473c-b613-b936200ef7a3+16:15123:x1876946942254720:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789996407.486767:0:14436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0877ad0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d64f88b3-32d6-473c-b613-b936200ef7a3+16:15123:x1876946942254720:12345-0@lo:502:mount.lustre.0 Request processed in 685us (8512us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996407.486776:0:14436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789996407.486966:0:15123:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0741a28700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d64f88b3-32d6-473c-b613-b936200ef7a3:15123:1876946942254720:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789996407.487455:0:15123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1789996407.487512:0:15123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1789996407.487674:0:15123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1789996407.487730:0:15123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1789996407.487767:0:15123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1789996407.487826:0:15123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1789996407.487885:0:15123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1789996407.487920:0:15123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1789996407.487966:0:15123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1789996407.487999:0:15123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1789996407.488028:0:15123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1789996407.488068:0:15123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1789996407.488111:0:15123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1789996407.488222:0:15123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1789996407.488265:0:15123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1789996407.488295:0:15123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1789996407.488323:0:15123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1789996407.488365:0:15123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1789996407.488395:0:15123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1789996407.488435:0:15123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1789996407.488487:0:15123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1789996407.488521:0:15123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1789996407.488574:0:15123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1789996407.488619:0:15123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1789996407.488646:0:15123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:1.0:1789996407.488670:0:15123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:1.0:1789996407.488705:0:15123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:1.0:1789996407.488737:0:15123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:1.0:1789996407.488764:0:15123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:1.0:1789996407.488820:0:15123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:1.0:1789996407.488850:0:15123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:1.0:1789996407.488877:0:15123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:1.0:1789996407.488905:0:15123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:1.0:1789996407.488949:0:15123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:1.0:1789996407.488984:0:15123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:1.0:1789996407.489027:0:15123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:1.0:1789996407.489061:0:15123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:1.0:1789996407.489109:0:15123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:1.0:1789996407.489172:0:15123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:1.0:1789996407.489211:0:15123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:1.0:1789996407.489260:0:15123:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fc99180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d64f88b3-32d6-473c-b613-b936200ef7a3:15123:1876946942254848:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789996407.489330:0:15123:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996407.489377:0:15123:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0849c6fc00 going to sleep for 11 seconds 00000100:00100000:2.0:1789996407.489583:0:14433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942254848 00000100:00100000:2.0:1789996407.489591:0:14433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942254848 00000100:00100000:2.0:1789996407.491941:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789996407.491965:0:14433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0877ad3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d64f88b3-32d6-473c-b613-b936200ef7a3+16:15123:x1876946942254848:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789996407.492437:0:14433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0877ad3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d64f88b3-32d6-473c-b613-b936200ef7a3+16:15123:x1876946942254848:12345-0@lo:502:mount.lustre.0 Request processed in 482us (3105us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996407.492445:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789996407.493790:0:15123:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fc99180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d64f88b3-32d6-473c-b613-b936200ef7a3:15123:1876946942254848:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789996407.494013:0:15123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:1.0:1789996407.494029:0:15123:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:0.0:1789996407.496612:0:15149:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1789996407.496628:0:15149:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8e087a348000) 00000020:00000080:0.0:1789996407.496649:0:15149:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:0.0:1789996407.496738:0:15149:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e08704c6000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1789996407.496742:0:15149:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8e08704c6000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1789996407.496745:0:15149:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e08704c6000 3 00010000:00080000:0.0:1789996407.496775:0:15149:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e07412ae000@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.137@tcp at head 00010000:00010000:0.0:1789996407.499003:0:15149:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:0.0:1789996407.499399:0:15149:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1789996407.499434:0:15149:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789996407.499445:0:15149:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x4173739f0fc8186c 00000100:00080000:0.0:1789996407.499456:0:15149:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789996407.499466:0:15149:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8e07412ae000 using connection 192.168.204.137@tcp/0@lo 00000100:00100000:0.0:1789996407.499500:0:15149:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e0741a2b800 x1876946942254976/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789996407.499535:0:15149:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1789996407.499601:0:12638:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789996407.499606:0:12638:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789996407.499609:0:12638:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789996407.499612:0:12638:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789996407.499719:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086faeca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876946942255104:0@lo:400:kworker.0 00000100:00100000:1.0:1789996407.499753:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0741a2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3312:1876946942254976:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789996407.499784:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996407.499843:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996407.499897:0:14441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942254976 00000100:00100000:0.0:1789996407.499904:0:14441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942254976 00000100:00100000:0.0:1789996407.499931:0:14441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942255104 00000100:00100000:0.0:1789996407.499934:0:14441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942255104 00000100:00100000:0.0:1789996407.499957:0:14441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789996407.499965:0:14441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0741a28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876946942255104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789996407.500015:0:14441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0741a28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876946942255104:12345-0@lo:400:kworker.0 Request processed in 50us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996407.500022:0:14441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789996407.500037:0:14441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789996407.500042:0:14441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fc99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3312:x1876946942254976:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1789996407.500061:0:14441:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 449 last 0 00000020:00000080:0.0:1789996407.500100:0:14441:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x4173739f0fc81873 00000004:00100000:0.0:1789996407.500115:0:14441:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000040:00080000:1.0:1789996407.500388:0:15149:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:1.0:1789996407.500440:0:15123:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1789996407.500472:0:15123:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.137@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789996407.500486:0:15123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.137@tcp lock: ffff8e0876a23a00/0x4173739f0fc81857 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc8185e expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996407.500497:0:15123:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.137@tcp lock: ffff8e0876a23a00/0x4173739f0fc81857 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc8185e expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1789996407.500577:0:15123:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1789996407.500580:0:15123:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789996407.500581:0:15123:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789996407.500582:0:15123:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789996407.500583:0:15123:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789996407.500585:0:15123:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789996407.500586:0:15123:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789996407.500588:0:15123:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789996407.500589:0:15123:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789996407.500593:0:15123:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:1.0:1789996407.500596:0:15123:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789996407.500597:0:15123:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789996407.500598:0:15123:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789996407.500599:0:15123:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789996407.500600:0:15123:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789996407.500601:0:15123:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789996407.500602:0:15123:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789996407.500603:0:15123:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789996407.500603:0:15123:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789996407.500618:0:15123:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1789996407.500629:0:15123:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fc99500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d64f88b3-32d6-473c-b613-b936200ef7a3:15123:1876946942255232:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789996407.500666:0:15123:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996407.500687:0:15123:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0849c6f180 going to sleep for 11 seconds 00000100:00080000:0.0:1789996407.501004:0:14441:0:(import.c:65:import_set_state_nolock()) ffff8e084529a000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789996407.501301:0:14441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fc99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876946942254976:12345-0@lo:38:llog_process_th.0 Request processed in 1256us (1515us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996407.501309:0:14441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1789996407.501358:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8e086faeca80 x1876946942255104/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789996423 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789996407.501371:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086faeca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876946942255104:0@lo:400:kworker.0 00010000:00080000:1.0:1789996407.501532:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8e0741a2b800 x1876946942254976/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789996417 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789996407.501564:0:3312:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789996407.501580:0:3312:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:1.0:1789996407.501587:0:3312:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1789996407.501591:0:3312:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789996407.501593:0:3312:0:(import.c:65:import_set_state_nolock()) ffff8e07412ae000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789996407.501599:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0741a2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3312:1876946942254976:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789996407.503605:0:14435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942255232 00000100:00100000:2.0:1789996407.503617:0:14435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942255232 00000100:00100000:2.0:1789996407.503669:0:14435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789996407.503678:0:14435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0877ad1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d64f88b3-32d6-473c-b613-b936200ef7a3+16:15123:x1876946942255232:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789996407.503707:0:14435:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1789996407.503721:0:14435:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1789996407.549506:0:14435:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1789996407.549526:0:14435:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1789996407.549637:0:14457:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1789996407.549642:0:14457:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1789996407.549664:0:14457:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e0876a23800/0x4173739f0fc8187a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996407.549684:0:14457:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e086fcb7e00/0x4173739f0fc817e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4173739f0fc817e0 expref: 16 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996407.549693:0:14457:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8e0876a23800/0x4173739f0fc8187a lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996407.549733:0:14457:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e086fcb7e00/0x4173739f0fc817e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4173739f0fc817e0 expref: 16 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996407.549747:0:14457:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e086fcb7e00/0x4173739f0fc817e7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4173739f0fc817e0 expref: 16 pid: 14436 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789996407.549761:0:14457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fc9ad80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14457:1876946942255360:0@lo:104: 00000100:00100000:1.0:1789996407.549823:0:14457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996407.550148:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942255360 00000100:00100000:0.0:1789996407.550156:0:14425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942255360 00000100:00100000:0.0:1789996407.550227:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789996407.550236:0:14425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fc98700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d64f88b3-32d6-473c-b613-b936200ef7a3+3:14457:x1876946942255360:12345-0@lo:104: 00010000:00010000:0.0:1789996407.550249:0:14425:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.137@tcp lock: ffff8e08429c6200/0x4173739f0fc817e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4173739f0fc817e7 expref: -99 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789996407.550263:0:14457:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0849c6f3c0 going to sleep for 11 seconds 00010000:00010000:0.0:1789996407.550298:0:14425:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789996407.550304:0:14425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fc98700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d64f88b3-32d6-473c-b613-b936200ef7a3+3:14457:x1876946942255360:12345-0@lo:104: Request processed in 70us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996407.550310:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789996407.550312:0:14457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fc9ad80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14457:1876946942255360:0@lo:104: 00010000:00010000:1.0:1789996407.550331:0:14457:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8e0876a23800/0x4173739f0fc8187a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996407.550420:0:14429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789996407.550426:0:14429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.137@tcp lock: ffff8e08429c6200/0x4173739f0fc817e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4173739f0fc817e7 expref: -99 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996407.550434:0:14429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e08429c6200 already unused, calling callback (ffffffffc1be0c20) 10000000:00010000:2.0:1789996407.550438:0:14429:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.137@tcp lock: ffff8e08429c6200/0x4173739f0fc817e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4173739f0fc817e7 expref: -99 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996407.550447:0:14429:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.137@tcp lock: ffff8e08429c6200/0x4173739f0fc817e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4173739f0fc817e7 expref: -99 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789996407.550454:0:14429:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.137@tcp lock: ffff8e08429c6200/0x4173739f0fc817e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4173739f0fc817e7 expref: -99 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789996407.550460:0:14429:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789996407.550494:0:14429:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.137@tcp lock: ffff8e08429c6200/0x4173739f0fc817e0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4173739f0fc817e7 expref: -99 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996407.550500:0:14429:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789996407.550520:0:14429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.137@tcp lock: ffff8e08429c6200/0x4173739f0fc817e0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4173739f0fc817e7 expref: -99 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996407.550537:0:14429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.137@tcp lock: ffff8e08429c6200/0x4173739f0fc817e0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4173739f0fc817e7 expref: -99 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996407.550572:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789996407.550574:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789996407.550576:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789996407.550592:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086faee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d64f88b3-32d6-473c-b613-b936200ef7a3:3315:1876946942255488:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789996407.550624:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996407.550666:0:14428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942255488 00000100:00100000:2.0:1789996407.550670:0:14428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942255488 00010000:00010000:2.0:1789996407.550688:0:14428:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e086fcb7e00/0x4173739f0fc817e7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4173739f0fc817e0 expref: 17 pid: 14436 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789996407.550717:0:14428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789996407.550725:0:14428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086faedc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d64f88b3-32d6-473c-b613-b936200ef7a3+17:3315:x1876946942255488:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789996407.550735:0:14428:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789996407.550740:0:14428:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e086fcb7e00/0x4173739f0fc817e7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4173739f0fc817e0 expref: 17 pid: 14436 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996407.550750:0:14428:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e086fcb7e00/0x4173739f0fc817e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4173739f0fc817e0 expref: 17 pid: 14436 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996407.550763:0:14428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e086fcb7e00/0x4173739f0fc817e7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4173739f0fc817e0 expref: 17 pid: 14436 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996407.550775:0:14428:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8e0876a23800/0x4173739f0fc8187a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996407.550793:0:14428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e0876a23800/0x4173739f0fc8187a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789996407.550805:0:14428:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002072069s 00010000:00010000:2.0:1789996407.550810:0:14428:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e0876a23800/0x4173739f0fc8187a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996407.550816:0:14428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e0876a23800/0x4173739f0fc8187a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996407.550823:0:14428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e0876a23800/0x4173739f0fc8187a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996407.550829:0:14428:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e0876a23800/0x4173739f0fc8187a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996407.550833:0:14428:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0876a23800 already unused, calling callback (ffffffffc1595910) 00010000:00010000:2.0:1789996407.550837:0:14428:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e0876a23800/0x4173739f0fc8187a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996407.550844:0:14428:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e0876a23800/0x4173739f0fc8187a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996407.551037:0:14428:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e0876a23800/0x4173739f0fc8187a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996407.551125:0:14428:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789996407.551125:0:14457:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8e0876a23800/0x4173739f0fc8187a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996407.551133:0:14457:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e0876a23800/0x4173739f0fc8187a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996407.551140:0:14457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e0876a23800/0x4173739f0fc8187a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789996407.551284:0:14428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086faedc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d64f88b3-32d6-473c-b613-b936200ef7a3+16:3315:x1876946942255488:12345-0@lo:103:ldlm_bl.0 Request processed in 560us (659us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996407.551292:0:14428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789996407.551395:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086faee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d64f88b3-32d6-473c-b613-b936200ef7a3:3315:1876946942255488:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789996407.571495:0:14435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0877ad1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d64f88b3-32d6-473c-b613-b936200ef7a3+15:15123:x1876946942255232:12345-0@lo:253:mount.lustre.0 Request processed in 67808us (70819us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996407.571510:0:14435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789996407.571667:0:15123:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fc99500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d64f88b3-32d6-473c-b613-b936200ef7a3:15123:1876946942255232:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789996407.571683:0:15123:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1789996407.571686:0:15123:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789996407.571688:0:15123:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789996407.571689:0:15123:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789996407.571691:0:15123:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789996407.571692:0:15123:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789996407.571693:0:15123:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789996407.571694:0:15123:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789996407.571696:0:15123:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789996407.571698:0:15123:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1789996407.571713:0:15123:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1789996407.581665:0:15123:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1789996407.581836:0:15123:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1789996407.582051:0:15123:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1789996407.582216:0:15123:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1789996407.582378:0:15123:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1789996407.584281:0:15123:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1789996407.588763:0:15123:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:0.0:1789996407.675651:0:15123:0:(ofd_obd.c:541:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1789996407.675661:0:15123:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1789996407.675701:0:15123:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1789996407.675777:0:15123:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.137@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1789996407.675795:0:15123:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1789996407.675826:0:15123:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:3.0:1789996407.852907:0:14430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789996408.872961:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789996408.936727:0:14438:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789996408.936737:0:14438:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8e087fbc4800 from 7 10000000:01000000:0.0:1789996408.936743:0:14438:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789996408.936866:0:14438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.137@tcp lock: ffff8e086fcb6c00/0x4173739f0fc81881 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996408.936878:0:14438:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.137@tcp lock: ffff8e086fcb6c00/0x4173739f0fc81881 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996408.936890:0:14438:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.137@tcp lock: ffff8e086fcb6c00/0x4173739f0fc81881 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789996408.936917:0:14438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0741a2b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d64f88b3-32d6-473c-b613-b936200ef7a3:14438:1876946942255616:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789996408.937216:0:14438:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996408.937311:0:14438:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e08475af780 going to sleep for 11 seconds 00000100:00100000:2.0:1789996408.939686:0:14436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942255616 00000100:00100000:2.0:1789996408.939701:0:14436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942255616 00000100:00100000:3.0:1789996408.944228:0:14436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789996408.944245:0:14436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0877ad2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d64f88b3-32d6-473c-b613-b936200ef7a3+15:14438:x1876946942255616:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789996408.944263:0:14436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789996408.944283:0:14436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e087f857800/0x4173739f0fc81888 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4173739f0fc81881 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996408.944311:0:14436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e087f857800/0x4173739f0fc81888 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4173739f0fc81881 expref: 16 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996408.944324:0:14436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e087f857800/0x4173739f0fc81888 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4173739f0fc81881 expref: 16 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996408.944334:0:14436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e087f857800, rc 0) 00000100:00100000:3.0:1789996408.944427:0:14436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0877ad2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d64f88b3-32d6-473c-b613-b936200ef7a3+16:14438:x1876946942255616:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 187us (7212us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996408.944434:0:14436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789996408.944519:0:14438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0741a2b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d64f88b3-32d6-473c-b613-b936200ef7a3:14438:1876946942255616:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789996408.944538:0:14438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.137@tcp lock: ffff8e086fcb6c00/0x4173739f0fc81881 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc81888 expref: -99 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996408.944574:0:14438:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.137@tcp lock: ffff8e086fcb6c00/0x4173739f0fc81881 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4173739f0fc81888 expref: -99 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789996408.944643:0:14438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0741a2b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d64f88b3-32d6-473c-b613-b936200ef7a3:14438:1876946942255744:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1789996408.944683:0:14438:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996408.952249:0:14438:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e08475af780 going to sleep for 11 seconds 00000100:00100000:2.0:1789996408.952311:0:14433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942255744 00000100:00100000:2.0:1789996408.952321:0:14433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942255744 00000100:00100000:2.0:1789996408.952436:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789996408.952446:0:14433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0877ad3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d64f88b3-32d6-473c-b613-b936200ef7a3+16:14438:x1876946942255744:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1789996408.952473:0:14433:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789996408.952493:0:14433:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789996408.952497:0:14433:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:2.0:1789996408.952629:0:14433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0877ad3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d64f88b3-32d6-473c-b613-b936200ef7a3+16:14438:x1876946942255744:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 184us (7944us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996408.952636:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789996408.952753:0:14438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0741a2b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d64f88b3-32d6-473c-b613-b936200ef7a3:14438:1876946942255744:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1789996408.952901:0:14438:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.137@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789996408.952910:0:14438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.137@tcp lock: ffff8e086fcb6c00/0x4173739f0fc81881 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc81888 expref: -99 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996408.952921:0:14438:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.137@tcp lock: ffff8e086fcb6c00/0x4173739f0fc81881 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc81888 expref: -99 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996409.897192:0:14430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789996410.922662:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789996411.945047:0:14430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789996412.904940:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789996412.904947:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789996412.904950:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789996412.904953:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789996412.905012:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086faeed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d64f88b3-32d6-473c-b613-b936200ef7a3:3316:1876946942255872:0@lo:400:kworker.0 00000100:00100000:2.0:1789996412.905245:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996412.905309:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086faefb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876946942256000:0@lo:400:kworker.0 00000100:00100000:2.0:1789996412.905336:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996412.905354:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789996412.905360:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086faed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1876946942256128:0@lo:400:kworker.0 00000100:00100000:2.0:1789996412.905404:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996412.905438:0:14433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942255872 00000100:00100000:2.0:1789996412.905446:0:14433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942255872 00000100:00100000:2.0:1789996412.905488:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789996412.905497:0:14433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0877ad1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d64f88b3-32d6-473c-b613-b936200ef7a3+16:3316:x1876946942255872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789996412.905562:0:14433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0877ad1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d64f88b3-32d6-473c-b613-b936200ef7a3+16:3316:x1876946942255872:12345-0@lo:400:kworker.0 Request processed in 65us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996412.905569:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789996412.905600:0:14441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942256000 00000100:00100000:2.0:1789996412.905604:0:14441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942256000 00000100:00100000:2.0:1789996412.905627:0:14441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942256128 00000100:00100000:2.0:1789996412.905630:0:14441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942256128 00000100:00100000:2.0:1789996412.905654:0:14441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789996412.905660:0:14441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086faeea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876946942256000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789996412.905692:0:14441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086faeea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876946942256000:12345-0@lo:400:kworker.0 Request processed in 33us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996412.905698:0:14441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789996412.905710:0:14441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789996412.905715:0:14441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086faec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876946942256128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789996412.905739:0:14441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086faec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876946942256128:12345-0@lo:400:kworker.0 Request processed in 24us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996412.905745:0:14441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1789996412.905782:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e086faed880 x1876946942256128/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789996428 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789996412.905797:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086faed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1876946942256128:0@lo:400:kworker.0 00010000:00080000:2.0:1789996412.905807:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e086faefb80 x1876946942256000/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789996428 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789996412.905823:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086faefb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876946942256000:0@lo:400:kworker.0 00000100:00100000:2.0:1789996412.905853:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086faeed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d64f88b3-32d6-473c-b613-b936200ef7a3:3316:1876946942255872:0@lo:400:kworker.0 00000100:00080000:2.0:1789996412.906653:0:14437:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789996412.970038:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789996413.993558:0:14430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789996414.086269:0:15493:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg437-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1789996415.016914:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789996415.402473:0:14475:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789996416.047416:0:14430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789996417.067448:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789996418.025593:0:12638:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789996418.025603:0:12638:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789996418.025606:0:12638:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789996418.025609:0:12638:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789996418.025663:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086faeed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d64f88b3-32d6-473c-b613-b936200ef7a3:3315:1876946942256256:0@lo:400:kworker.0 00000100:00100000:2.0:1789996418.025736:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996418.025809:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789996418.025815:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086faefb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876946942256384:0@lo:400:kworker.0 00000100:00100000:2.0:1789996418.025841:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996418.025871:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086faed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1876946942256512:0@lo:400:kworker.0 00000100:00100000:2.0:1789996418.025906:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996418.025947:0:14441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942256384 00000100:00100000:2.0:1789996418.025956:0:14441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942256384 00000100:00100000:2.0:1789996418.025993:0:14441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942256512 00000100:00100000:2.0:1789996418.025996:0:14441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942256512 00000100:00100000:2.0:1789996418.026023:0:14441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789996418.026030:0:14441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086faef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876946942256384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789996418.026077:0:14441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086faef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876946942256384:12345-0@lo:400:kworker.0 Request processed in 47us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996418.026098:0:14441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789996418.026116:0:14441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789996418.026121:0:14441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086faec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876946942256512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789996418.026166:0:14441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086faec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876946942256512:12345-0@lo:400:kworker.0 Request processed in 45us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996418.026172:0:14441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:2.0:1789996418.026194:0:14437:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1789996418.026221:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e086faed880 x1876946942256512/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789996434 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789996418.026236:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086faed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1876946942256512:0@lo:400:kworker.0 00010000:00080000:2.0:1789996418.026265:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e086faefb80 x1876946942256384/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789996434 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789996418.026273:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086faefb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876946942256384:0@lo:400:kworker.0 00000100:00100000:3.0:1789996418.026991:0:14436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942256256 00000100:00100000:3.0:1789996418.027000:0:14436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942256256 00000100:00100000:3.0:1789996418.027039:0:14436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789996418.027047:0:14436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0877ad0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d64f88b3-32d6-473c-b613-b936200ef7a3+16:3315:x1876946942256256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789996418.027097:0:14436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0877ad0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d64f88b3-32d6-473c-b613-b936200ef7a3+16:3315:x1876946942256256:12345-0@lo:400:kworker.0 Request processed in 51us (1362us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996418.027113:0:14436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789996418.027154:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086faeed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d64f88b3-32d6-473c-b613-b936200ef7a3:3315:1876946942256256:0@lo:400:kworker.0 00010000:00010000:2.0:1789996418.088964:0:14430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789996418.795847:0:3312:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789996403/real 1789996403] req@ffff8e086fa93800 x1876946942251904/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789996418 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789996418.795895:0:3312:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8e086fa93800 x1876946942251904/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789996418 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789996418.795906:0:3312:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789996403/real 1789996403] req@ffff8e086fa91f80 x1876946942252032/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789996418 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789996418.795981:0:3312:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8e086fa91f80 x1876946942252032/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789996418 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789996418.796002:0:3312:0:(import.c:65:import_set_state_nolock()) ffff8e0876bb2800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789996418.796076:0:3312:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1789996418.796080:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fa93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3312:1876946942251904:0@lo:8:kworker.0 00000100:00080000:2.0:1789996418.796087:0:3312:0:(import.c:65:import_set_state_nolock()) ffff8e0848960000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:3.0:1789996418.796193:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00080000:0.0:1789996418.796311:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789996418.796316:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1789996418.796319:0:37:0:(import.c:65:import_set_state_nolock()) ffff8e0876bb2800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789996418.796324:0:37:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 444 00000100:00080000:0.0:1789996418.796329:0:37:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1789996418.796343:0:37:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8e0876bb2800 using connection 192.168.204.137@tcp/0@lo 00000100:00100000:0.0:1789996418.796368:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e0741a28700 x1876946942256768/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789996418.796378:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789996418.796381:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1789996418.796383:0:37:0:(import.c:65:import_set_state_nolock()) ffff8e0848960000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789996418.796386:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 444 00000100:00080000:0.0:1789996418.796389:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1789996418.796392:0:37:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8e0848960000 using connection 192.168.204.137@tcp/0@lo 00000100:00100000:0.0:1789996418.796402:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e0741a2ad80 x1876946942256896/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789996418.796464:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0741a29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3316:1876946942257152:0@lo:400:kworker.0 00000100:00100000:0.0:1789996418.796564:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996418.796626:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789996418.796633:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0741a28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3316:1876946942257024:0@lo:400:kworker.0 00000100:00100000:0.0:1789996418.796654:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996418.796689:0:14441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942257152 00000100:00100000:0.0:1789996418.796696:0:14441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942257152 00000100:00100000:0.0:1789996418.796738:0:14441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942257024 00000100:00100000:0.0:1789996418.796741:0:14441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942257024 00000100:00100000:0.0:1789996418.796756:0:14441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789996418.796764:0:14441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0741a29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1876946942257152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789996418.796813:0:14441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0741a29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1876946942257152:12345-0@lo:400:kworker.0 Request processed in 48us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996418.796820:0:14441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789996418.796837:0:14441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789996418.796843:0:14441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0741a29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1876946942257024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789996418.796886:0:14441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0741a29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1876946942257024:12345-0@lo:400:kworker.0 Request processed in 43us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996418.796891:0:14441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1789996418.797080:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e0741a28000 x1876946942257024/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789996434 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789996418.797093:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0741a28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3316:1876946942257024:0@lo:400:kworker.0 00010000:00080000:0.0:1789996418.797103:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e0741a29c00 x1876946942257152/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789996434 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789996418.797111:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0741a29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3316:1876946942257152:0@lo:400:kworker.0 00000100:00080000:2.0:1789996418.797426:0:3312:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1789996418.797432:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fa91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3312:1876946942252032:0@lo:8:kworker.0 00000100:00100000:2.0:1789996418.797460:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0741a28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3312:1876946942256768:0@lo:8:kworker.0 00000100:00100000:2.0:1789996418.797504:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996418.797624:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0741a2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3312:1876946942256896:0@lo:8:kworker.0 00000100:00100000:2.0:1789996418.797653:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789996418.797816:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0741a2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d64f88b3-32d6-473c-b613-b936200ef7a3:3313:1876946942256640:0@lo:400:kworker.0 00000100:00100000:3.0:1789996418.797853:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996418.798014:0:14435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942256640 00000100:00100000:0.0:1789996418.798021:0:14435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942256640 00000100:00100000:0.0:1789996418.798068:0:14435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789996418.798086:0:14435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0877ad0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d64f88b3-32d6-473c-b613-b936200ef7a3+16:3313:x1876946942256640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789996418.798132:0:14435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0877ad0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d64f88b3-32d6-473c-b613-b936200ef7a3+16:3313:x1876946942256640:12345-0@lo:400:kworker.0 Request processed in 48us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996418.798138:0:14435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789996418.798179:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0741a2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d64f88b3-32d6-473c-b613-b936200ef7a3:3313:1876946942256640:0@lo:400:kworker.0 00000100:00100000:1.0:1789996418.801073:0:15124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942256768 00000100:00100000:1.0:1789996418.801090:0:15124:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942256768 00000100:00100000:1.0:1789996418.801143:0:15124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942256896 00000100:00100000:1.0:1789996418.801147:0:15124:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942256896 00000100:00100000:1.0:1789996418.801163:0:15124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789996418.801172:0:15124:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086faefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3312:x1876946942256768:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1789996418.801280:0:15124:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 460 last 0 00000020:00000080:1.0:1789996418.801320:0:15124:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4173739f0fc8188f 00002000:00100000:1.0:1789996418.801335:0:15124:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8e07412ad800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a3f ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1789996418.801339:0:15124:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1789996418.801343:0:15124:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1789996418.801734:0:15124:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1789996418.801770:0:15124:0:(import.c:65:import_set_state_nolock()) ffff8e07412ab000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789996418.801881:0:15124:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086faefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3312:x1876946942256768:12345-0@lo:8:kworker.0 Request processed in 708us (4374us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996418.801900:0:15124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789996418.802029:0:15125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789996418.802037:0:15125:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086faed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3312:x1876946942256896:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1789996418.802050:0:15125:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1789996418.802084:0:15125:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086faed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3312:x1876946942256896:12345-0@lo:8:kworker.0 Request processed in 48us (4430us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789996418.802090:0:15125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789996418.802447:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e0741a28700 x1876946942256768/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789996438 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789996418.802459:0:3312:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789996418.802467:0:3312:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1789996418.802474:0:3312:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1789996418.802480:0:3312:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1789996418.802482:0:3312:0:(import.c:65:import_set_state_nolock()) ffff8e0876bb2800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1789996418.802512:0:3312:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1789996418.802517:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0741a28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3312:1876946942256768:0@lo:8:kworker.0 00000100:00080000:1.0:1789996418.802534:0:3312:0:(import.c:65:import_set_state_nolock()) ffff8e0848960000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789996418.802538:0:3312:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789996418.802566:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0741a2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3312:1876946942256896:0@lo:8:kworker.0 00000004:00080000:2.0:1789996418.802636:0:14463:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1789996418.802990:0:14463:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 460522446265ns, next at 0ns, rc = 0 00000004:00080000:0.0:1789996418.803140:0:14464:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x5:0x0] 00000100:00100000:0.0:1789996418.803161:0:14464:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0741a29c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14464:1876946942257408:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1789996418.803214:0:14464:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996418.803236:0:14464:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0849c6f840 going to sleep for 11 seconds 00000100:00100000:0.0:1789996418.803250:0:15125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942257408 00000100:00100000:0.0:1789996418.803256:0:15125:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942257408 00000100:00100000:0.0:1789996418.803301:0:15125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789996418.803308:0:15125:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0741a28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14464:x1876946942257408:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1789996418.804323:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789996418.804339:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0741a2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876946942257280:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789996418.804386:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996418.806087:0:15127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942257280 00000100:00100000:0.0:1789996418.806107:0:15127:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942257280 00000100:00100000:0.0:1789996418.806179:0:15127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789996418.806191:0:15127:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fc99500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3314:x1876946942257280:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789996418.807409:0:15127:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789996418.807521:0:15127:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fc99500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3314:x1876946942257280:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1330us (3131us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996418.807554:0:15127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1789996418.809016:0:14437:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789996418.812299:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e0741a2b800 x1876946942257280/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789996434 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789996418.812332:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0741a2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876946942257280:0@lo:13:osp-pre-0-0.0 00002000:00080000:0.0:1789996418.817793:0:15125:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:0.0:1789996418.817805:0:15125:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:0.0:1789996418.817810:0:15125:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:6 to 0x240000400:33) 00002000:00010000:0.0:1789996418.835601:0:15125:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789996418.835615:0:15125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000359ca922/0x4173739f0fc81896 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996418.835633:0:15125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=460s v=(0 0) 00010000:00010000:0.0:1789996418.835637:0:15125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789996418.835644:0:15125:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000359ca922/0x4173739f0fc81896 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996418.835663:0:15125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000359ca922/0x4173739f0fc81896 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996418.835674:0:15125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000359ca922/0x4173739f0fc81896 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996418.835682:0:15125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000359ca922/0x4173739f0fc81896 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996418.835697:0:15125:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789996418.836181:0:15125:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789996418.836188:0:15125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ed3db555/0x4173739f0fc8189d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996418.836432:0:14429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789996418.836440:0:14429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000359ca922/0x4173739f0fc81896 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996418.836448:0:14429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e086fcb7200 already unused, calling callback (ffffffffc1595910) 00010000:00010000:3.0:1789996418.836452:0:14429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000359ca922/0x4173739f0fc81896 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996418.836463:0:14429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000359ca922/0x4173739f0fc81896 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996418.836484:0:14429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000359ca922/0x4173739f0fc81896 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996418.836492:0:14429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000359ca922/0x4173739f0fc81896 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996418.836513:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789996418.836514:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789996418.836516:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789996418.839745:0:15125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=460s v=(0 0) 00010000:00010000:0.0:1789996418.839750:0:15125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789996418.839825:0:15125:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ed3db555/0x4173739f0fc8189d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996418.839847:0:15125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ed3db555/0x4173739f0fc8189d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996418.839858:0:15125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ed3db555/0x4173739f0fc8189d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996418.839875:0:15125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ed3db555/0x4173739f0fc8189d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996418.839905:0:15125:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789996418.840078:0:14430:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789996418.840086:0:14430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ed3db555/0x4173739f0fc8189d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996418.840093:0:14430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e086fcb7600 already unused, calling callback (ffffffffc1595910) 00010000:00010000:2.0:1789996418.840098:0:14430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ed3db555/0x4173739f0fc8189d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996418.840108:0:14430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ed3db555/0x4173739f0fc8189d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996418.840146:0:14430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ed3db555/0x4173739f0fc8189d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996418.840155:0:14430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ed3db555/0x4173739f0fc8189d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996418.840179:0:14430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789996418.840182:0:14430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789996418.840184:0:14430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789996418.841160:0:15125:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789996418.841171:0:15125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000754eb88/0x4173739f0fc818a4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996418.841183:0:15125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=460s v=(0 0) 00010000:00010000:0.0:1789996418.841187:0:15125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789996418.841193:0:15125:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000754eb88/0x4173739f0fc818a4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996418.841215:0:15125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000754eb88/0x4173739f0fc818a4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996418.841237:0:15125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000754eb88/0x4173739f0fc818a4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996418.841245:0:15125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000754eb88/0x4173739f0fc818a4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996418.841267:0:15125:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789996418.842213:0:15125:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789996418.842222:0:15125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b2db54a/0x4173739f0fc818ab lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996418.842233:0:15125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=460s v=(0 0) 00010000:00010000:0.0:1789996418.842237:0:15125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789996418.842242:0:15125:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003b2db54a/0x4173739f0fc818ab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996418.842252:0:15125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003b2db54a/0x4173739f0fc818ab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996418.842261:0:15125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b2db54a/0x4173739f0fc818ab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996418.842268:0:15125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003b2db54a/0x4173739f0fc818ab lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996418.842302:0:15125:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1789996418.842732:0:15125:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789996418.842739:0:15125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002e50c207/0x4173739f0fc818b2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996418.842746:0:15125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=460s v=(0 0) 00010000:00010000:0.0:1789996418.842749:0:15125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789996418.842753:0:15125:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002e50c207/0x4173739f0fc818b2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996418.842955:0:14430:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789996418.842965:0:14430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000754eb88/0x4173739f0fc818a4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996418.842973:0:14430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e086fcb6e00 already unused, calling callback (ffffffffc1595910) 00010000:00010000:2.0:1789996418.842978:0:14430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000754eb88/0x4173739f0fc818a4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996418.842987:0:14430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000754eb88/0x4173739f0fc818a4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996418.843006:0:14430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000754eb88/0x4173739f0fc818a4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996418.843013:0:14430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000754eb88/0x4173739f0fc818a4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996418.843044:0:14430:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789996418.843048:0:14430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003b2db54a/0x4173739f0fc818ab lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996418.843054:0:14430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e086fcb7400 already unused, calling callback (ffffffffc1595910) 00010000:00010000:2.0:1789996418.843057:0:14430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003b2db54a/0x4173739f0fc818ab lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996418.843065:0:14430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003b2db54a/0x4173739f0fc818ab lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996418.843076:0:14430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003b2db54a/0x4173739f0fc818ab lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996418.843083:0:14430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003b2db54a/0x4173739f0fc818ab lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996418.843095:0:14430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789996418.843096:0:14430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789996418.843098:0:14430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789996418.843191:0:15125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002e50c207/0x4173739f0fc818b2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996418.843259:0:15125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002e50c207/0x4173739f0fc818b2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996418.843268:0:15125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002e50c207/0x4173739f0fc818b2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996418.843323:0:15125:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789996418.843873:0:15125:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789996418.843880:0:15125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000075361c22/0x4173739f0fc818b9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996418.843890:0:15125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=460s v=(0 0) 00010000:00010000:0.0:1789996418.843901:0:15125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789996418.843906:0:15125:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000075361c22/0x4173739f0fc818b9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996418.843988:0:15125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000075361c22/0x4173739f0fc818b9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996418.843997:0:15125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000075361c22/0x4173739f0fc818b9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996418.844004:0:15125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000075361c22/0x4173739f0fc818b9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996418.844754:0:14430:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789996418.845963:0:14430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002e50c207/0x4173739f0fc818b2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996418.845981:0:14430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e086fcb6400 already unused, calling callback (ffffffffc1595910) 00010000:00010000:2.0:1789996418.845995:0:14430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002e50c207/0x4173739f0fc818b2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996418.846006:0:14430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002e50c207/0x4173739f0fc818b2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996418.846026:0:14430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002e50c207/0x4173739f0fc818b2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996418.846035:0:14430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002e50c207/0x4173739f0fc818b2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996418.846057:0:14430:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789996418.846062:0:14430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000075361c22/0x4173739f0fc818b9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996418.846068:0:14430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e086fcb6800 already unused, calling callback (ffffffffc1595910) 00010000:00010000:2.0:1789996418.846071:0:14430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000075361c22/0x4173739f0fc818b9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996418.846078:0:14430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000075361c22/0x4173739f0fc818b9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996418.846088:0:14430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000075361c22/0x4173739f0fc818b9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996418.846094:0:14430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789996418.846101:0:14430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789996418.846104:0:14430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789996418.846164:0:15125:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1789996418.846172:0:15125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000075361c22/0x4173739f0fc818b9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996418.846291:0:14430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789996418.847052:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789996418.847622:0:15125:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789996418.847632:0:15125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005c66cbf9/0x4173739f0fc818c0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996418.847647:0:15125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=460s v=(0 0) 00010000:00010000:0.0:1789996418.847652:0:15125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789996418.847658:0:15125:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005c66cbf9/0x4173739f0fc818c0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996418.847672:0:15125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005c66cbf9/0x4173739f0fc818c0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996418.847692:0:15125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005c66cbf9/0x4173739f0fc818c0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996418.847700:0:15125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005c66cbf9/0x4173739f0fc818c0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996418.847718:0:15125:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789996418.848370:0:14430:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789996418.848378:0:14430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005c66cbf9/0x4173739f0fc818c0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996418.848388:0:14430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e086fcb7e00 already unused, calling callback (ffffffffc1595910) 00010000:00010000:2.0:1789996418.848393:0:14430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005c66cbf9/0x4173739f0fc818c0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996418.848402:0:14430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005c66cbf9/0x4173739f0fc818c0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996418.848418:0:14430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005c66cbf9/0x4173739f0fc818c0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996418.848425:0:14430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005c66cbf9/0x4173739f0fc818c0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996418.848442:0:14430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789996418.848444:0:14430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789996418.848445:0:14430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789996418.849238:0:15125:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789996418.849246:0:15125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c9294bac/0x4173739f0fc818c7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996418.849258:0:15125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=460s v=(0 0) 00010000:00010000:0.0:1789996418.849262:0:15125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789996418.849267:0:15125:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c9294bac/0x4173739f0fc818c7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996418.849278:0:15125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c9294bac/0x4173739f0fc818c7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996418.849286:0:15125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c9294bac/0x4173739f0fc818c7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996418.849292:0:15125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c9294bac/0x4173739f0fc818c7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996418.849331:0:15125:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789996418.849716:0:14429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789996418.849728:0:14429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c9294bac/0x4173739f0fc818c7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996418.849741:0:14429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e086fcb6200 already unused, calling callback (ffffffffc1595910) 00010000:00010000:3.0:1789996418.849745:0:14429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c9294bac/0x4173739f0fc818c7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996418.849754:0:14429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c9294bac/0x4173739f0fc818c7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996418.849768:0:14429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c9294bac/0x4173739f0fc818c7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996418.849775:0:14429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c9294bac/0x4173739f0fc818c7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996418.849791:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789996418.849793:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789996418.849794:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789996418.850029:0:15125:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789996418.850035:0:15125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c023b5b0/0x4173739f0fc818ce lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996418.850043:0:15125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=460s v=(0 0) 00010000:00010000:0.0:1789996418.850046:0:15125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789996418.850050:0:15125:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c023b5b0/0x4173739f0fc818ce lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996418.850059:0:15125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c023b5b0/0x4173739f0fc818ce lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996418.850066:0:15125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c023b5b0/0x4173739f0fc818ce lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996418.850072:0:15125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c023b5b0/0x4173739f0fc818ce lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996418.850096:0:15125:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789996418.850622:0:15125:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789996418.850628:0:15125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000018022673/0x4173739f0fc818d5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996418.850637:0:15125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=460s v=(0 0) 00010000:00010000:0.0:1789996418.850646:0:15125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789996418.850652:0:15125:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000018022673/0x4173739f0fc818d5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996418.850661:0:15125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000018022673/0x4173739f0fc818d5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996418.850670:0:15125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000018022673/0x4173739f0fc818d5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996418.850677:0:15125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000018022673/0x4173739f0fc818d5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996418.850694:0:15125:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1789996418.850706:0:14429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789996418.850711:0:14429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c023b5b0/0x4173739f0fc818ce lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996418.850719:0:14429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e086fcb6000 already unused, calling callback (ffffffffc1595910) 00010000:00010000:0.0:1789996418.850724:0:14429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c023b5b0/0x4173739f0fc818ce lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996418.850732:0:14429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c023b5b0/0x4173739f0fc818ce lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996418.850745:0:14429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c023b5b0/0x4173739f0fc818ce lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996418.850764:0:14429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c023b5b0/0x4173739f0fc818ce lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996418.850780:0:14429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789996418.850782:0:14429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000018022673/0x4173739f0fc818d5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996418.850788:0:14429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e086fcb6a00 already unused, calling callback (ffffffffc1595910) 00010000:00010000:0.0:1789996418.850791:0:14429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000018022673/0x4173739f0fc818d5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996418.850798:0:14429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000018022673/0x4173739f0fc818d5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996418.850807:0:14429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000018022673/0x4173739f0fc818d5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996418.850813:0:14429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000018022673/0x4173739f0fc818d5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996418.850823:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789996418.850825:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789996418.850826:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789996418.850984:0:14430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789996418.851471:0:15125:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789996418.851478:0:15125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000085c60d68/0x4173739f0fc818dc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996418.851493:0:15125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=460s v=(0 0) 00010000:00010000:0.0:1789996418.851496:0:15125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789996418.851501:0:15125:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000085c60d68/0x4173739f0fc818dc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996418.851510:0:15125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000085c60d68/0x4173739f0fc818dc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996418.851519:0:15125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000085c60d68/0x4173739f0fc818dc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996418.851525:0:15125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000085c60d68/0x4173739f0fc818dc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996418.852302:0:15125:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789996418.852978:0:15125:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789996418.852987:0:15125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000359ca922/0x4173739f0fc818e3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996418.853001:0:15125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=460s v=(0 0) 00010000:00010000:0.0:1789996418.853005:0:15125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789996418.853011:0:15125:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000359ca922/0x4173739f0fc818e3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996418.853024:0:15125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000359ca922/0x4173739f0fc818e3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996418.853046:0:15125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000359ca922/0x4173739f0fc818e3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996418.853054:0:15125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000359ca922/0x4173739f0fc818e3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996418.853426:0:14429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789996418.853437:0:14429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000085c60d68/0x4173739f0fc818dc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996418.853446:0:14429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e086fcb7800 already unused, calling callback (ffffffffc1595910) 00010000:00010000:3.0:1789996418.853450:0:14429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000085c60d68/0x4173739f0fc818dc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996418.853472:0:14429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000085c60d68/0x4173739f0fc818dc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996418.853489:0:14429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000085c60d68/0x4173739f0fc818dc lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996418.853496:0:14429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000085c60d68/0x4173739f0fc818dc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996418.853515:0:14429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789996418.853518:0:14429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000359ca922/0x4173739f0fc818e3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996418.853524:0:14429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e086fcb7200 already unused, calling callback (ffffffffc1595910) 00010000:00010000:3.0:1789996418.853527:0:14429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000359ca922/0x4173739f0fc818e3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996418.853533:0:14429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000359ca922/0x4173739f0fc818e3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996418.853567:0:14429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000359ca922/0x4173739f0fc818e3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996418.853576:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789996418.853578:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789996418.853586:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789996418.853710:0:15125:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1789996418.853716:0:15125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000359ca922/0x4173739f0fc818e3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996418.854514:0:14430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789996418.854642:0:15125:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789996418.854650:0:15125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002e50c207/0x4173739f0fc818ea lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996418.854666:0:15125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=460s v=(0 0) 00010000:00010000:0.0:1789996418.854671:0:15125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789996418.854677:0:15125:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002e50c207/0x4173739f0fc818ea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996418.854690:0:15125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002e50c207/0x4173739f0fc818ea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996418.854700:0:15125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002e50c207/0x4173739f0fc818ea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996418.854720:0:15125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002e50c207/0x4173739f0fc818ea lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996418.854736:0:15125:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789996418.855200:0:15125:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789996418.855383:0:14429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789996418.855393:0:14429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002e50c207/0x4173739f0fc818ea lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996418.855402:0:14429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e086fcb6400 already unused, calling callback (ffffffffc1595910) 00010000:00010000:3.0:1789996418.855407:0:14429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002e50c207/0x4173739f0fc818ea lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996418.855416:0:14429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002e50c207/0x4173739f0fc818ea lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996418.855435:0:14429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002e50c207/0x4173739f0fc818ea lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996418.855443:0:14429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002e50c207/0x4173739f0fc818ea lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996418.855462:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789996418.855463:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789996418.855465:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789996418.855498:0:15125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b2db54a/0x4173739f0fc818f1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996418.855507:0:15125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=460s v=(0 0) 00010000:00010000:0.0:1789996418.855510:0:15125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789996418.855514:0:15125:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003b2db54a/0x4173739f0fc818f1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996418.855524:0:15125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003b2db54a/0x4173739f0fc818f1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996418.855531:0:15125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b2db54a/0x4173739f0fc818f1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996418.855538:0:15125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003b2db54a/0x4173739f0fc818f1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996418.855664:0:15125:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789996418.856132:0:15125:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789996418.856139:0:15125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000754eb88/0x4173739f0fc818f8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996418.856155:0:15125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=460s v=(0 0) 00010000:00010000:0.0:1789996418.856158:0:15125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789996418.856163:0:15125:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000754eb88/0x4173739f0fc818f8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996418.856172:0:15125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000754eb88/0x4173739f0fc818f8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996418.856180:0:15125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000754eb88/0x4173739f0fc818f8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996418.856187:0:15125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000754eb88/0x4173739f0fc818f8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996418.857065:0:15125:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1789996418.857327:0:14430:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789996418.857335:0:14430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003b2db54a/0x4173739f0fc818f1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996418.857344:0:14430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e086fcb7400 already unused, calling callback (ffffffffc1595910) 00010000:00010000:3.0:1789996418.857348:0:14430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003b2db54a/0x4173739f0fc818f1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996418.857366:0:14430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003b2db54a/0x4173739f0fc818f1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996418.857383:0:14430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003b2db54a/0x4173739f0fc818f1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996418.857392:0:14430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003b2db54a/0x4173739f0fc818f1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996418.857417:0:14430:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789996418.857420:0:14430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000754eb88/0x4173739f0fc818f8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996418.857426:0:14430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e086fcb6e00 already unused, calling callback (ffffffffc1595910) 00010000:00010000:3.0:1789996418.857429:0:14430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000754eb88/0x4173739f0fc818f8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996418.857435:0:14430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000754eb88/0x4173739f0fc818f8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996418.857581:0:14430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000754eb88/0x4173739f0fc818f8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996418.857589:0:14430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000754eb88/0x4173739f0fc818f8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996418.857615:0:14430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789996418.857617:0:14430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789996418.857619:0:14430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789996418.858419:0:15125:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789996418.858427:0:15125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ed3db555/0x4173739f0fc818ff lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996418.858438:0:15125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=460s v=(0 0) 00010000:00010000:0.0:1789996418.858442:0:15125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789996418.858448:0:15125:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ed3db555/0x4173739f0fc818ff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996418.858459:0:15125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ed3db555/0x4173739f0fc818ff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996418.858480:0:15125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ed3db555/0x4173739f0fc818ff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996418.858487:0:15125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ed3db555/0x4173739f0fc818ff lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996418.858599:0:15125:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789996418.859892:0:15125:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789996418.859902:0:15125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005fd30b26/0x4173739f0fc81906 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996418.859914:0:15125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=460s v=(0 0) 00010000:00010000:0.0:1789996418.859918:0:15125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789996418.859924:0:15125:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005fd30b26/0x4173739f0fc81906 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996418.859936:0:15125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005fd30b26/0x4173739f0fc81906 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996418.859945:0:15125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005fd30b26/0x4173739f0fc81906 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996418.859952:0:15125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005fd30b26/0x4173739f0fc81906 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996418.860024:0:14430:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789996418.860032:0:14430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ed3db555/0x4173739f0fc818ff lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996418.860040:0:14430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e086fcb7600 already unused, calling callback (ffffffffc1595910) 00010000:00010000:1.0:1789996418.860044:0:14430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ed3db555/0x4173739f0fc818ff lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996418.860063:0:14430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ed3db555/0x4173739f0fc818ff lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996418.860080:0:14430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ed3db555/0x4173739f0fc818ff lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996418.860087:0:14430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ed3db555/0x4173739f0fc818ff lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996418.860107:0:14430:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789996418.860111:0:14430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005fd30b26/0x4173739f0fc81906 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996418.860117:0:14430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0840031a00 already unused, calling callback (ffffffffc1595910) 00010000:00010000:1.0:1789996418.860120:0:14430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005fd30b26/0x4173739f0fc81906 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996418.860127:0:14430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005fd30b26/0x4173739f0fc81906 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996418.860136:0:14430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005fd30b26/0x4173739f0fc81906 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996418.860143:0:14430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789996418.860145:0:14430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789996418.860153:0:14430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789996418.860312:0:15125:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1789996418.860319:0:15125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005fd30b26/0x4173739f0fc81906 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996418.860602:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789996418.861180:0:15125:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789996418.861188:0:15125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d785f2bd/0x4173739f0fc8190d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996418.861200:0:15125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=460s v=(0 0) 00010000:00010000:0.0:1789996418.861205:0:15125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789996418.861210:0:15125:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d785f2bd/0x4173739f0fc8190d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996418.861220:0:15125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d785f2bd/0x4173739f0fc8190d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996418.861229:0:15125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d785f2bd/0x4173739f0fc8190d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996418.861236:0:15125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d785f2bd/0x4173739f0fc8190d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996418.864301:0:15125:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789996418.865041:0:15125:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789996418.865052:0:15125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c585f656/0x4173739f0fc81914 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996418.865079:0:15125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=460s v=(0 0) 00010000:00010000:0.0:1789996418.865083:0:15125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789996418.865090:0:15125:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c585f656/0x4173739f0fc81914 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996418.865106:0:15125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c585f656/0x4173739f0fc81914 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996418.865117:0:15125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c585f656/0x4173739f0fc81914 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996418.865125:0:15125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c585f656/0x4173739f0fc81914 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996418.865197:0:14429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789996418.865207:0:14429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d785f2bd/0x4173739f0fc8190d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996418.865215:0:14429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0840030600 already unused, calling callback (ffffffffc1595910) 00010000:00010000:3.0:1789996418.865220:0:14429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d785f2bd/0x4173739f0fc8190d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996418.865230:0:14429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d785f2bd/0x4173739f0fc8190d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996418.865250:0:14429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d785f2bd/0x4173739f0fc8190d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996418.865258:0:14429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d785f2bd/0x4173739f0fc8190d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996418.865281:0:14429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789996418.865285:0:14429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c585f656/0x4173739f0fc81914 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996418.865291:0:14429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0840031800 already unused, calling callback (ffffffffc1595910) 00010000:00010000:3.0:1789996418.865302:0:14429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c585f656/0x4173739f0fc81914 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996418.865310:0:14429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c585f656/0x4173739f0fc81914 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996418.865320:0:14429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c585f656/0x4173739f0fc81914 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996418.865326:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789996418.865328:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789996418.865330:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789996418.865389:0:14430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789996418.865473:0:15125:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1789996418.865479:0:15125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c585f656/0x4173739f0fc81914 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789996418.866011:0:15125:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789996418.866018:0:15125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000092ef4a07/0x4173739f0fc8191b lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996418.866032:0:15125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=460s v=(0 0) 00010000:00010000:0.0:1789996418.866035:0:15125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789996418.866040:0:15125:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000092ef4a07/0x4173739f0fc8191b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996418.866062:0:15125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000092ef4a07/0x4173739f0fc8191b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996418.866071:0:15125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000092ef4a07/0x4173739f0fc8191b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996418.866078:0:15125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000092ef4a07/0x4173739f0fc8191b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996418.869067:0:14429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789996418.869082:0:14429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000092ef4a07/0x4173739f0fc8191b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996418.869095:0:14429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0840030400 already unused, calling callback (ffffffffc1595910) 00010000:00010000:3.0:1789996418.869101:0:14429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000092ef4a07/0x4173739f0fc8191b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996418.869114:0:14429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000092ef4a07/0x4173739f0fc8191b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996418.869140:0:14429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000092ef4a07/0x4173739f0fc8191b lrc: 2/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996418.869151:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789996418.869161:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789996418.869163:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789996418.869354:0:15125:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1789996418.869365:0:15125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000092ef4a07/0x4173739f0fc8191b lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789996418.870385:0:15125:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789996418.870394:0:15125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009fb19e5b/0x4173739f0fc81922 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996418.870409:0:15125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=460s v=(0 0) 00010000:00010000:0.0:1789996418.870414:0:15125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789996418.870419:0:15125:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009fb19e5b/0x4173739f0fc81922 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996418.870433:0:15125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009fb19e5b/0x4173739f0fc81922 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996418.870466:0:15125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009fb19e5b/0x4173739f0fc81922 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996418.870474:0:15125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009fb19e5b/0x4173739f0fc81922 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996418.873290:0:14430:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789996418.873304:0:14430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009fb19e5b/0x4173739f0fc81922 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996418.873318:0:14430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0840031600 already unused, calling callback (ffffffffc1595910) 00010000:00010000:1.0:1789996418.873323:0:14430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009fb19e5b/0x4173739f0fc81922 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996418.873504:0:15125:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1789996418.873586:0:14430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009fb19e5b/0x4173739f0fc81922 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996418.873743:0:14430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009fb19e5b/0x4173739f0fc81922 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996418.873753:0:14430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009fb19e5b/0x4173739f0fc81922 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996418.873780:0:14430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789996418.873782:0:14430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789996418.873784:0:14430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789996418.873914:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789996418.874662:0:15125:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789996418.874672:0:15125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a515368b/0x4173739f0fc81929 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996418.874685:0:15125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=460s v=(0 0) 00010000:00010000:0.0:1789996418.874689:0:15125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789996418.874695:0:15125:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a515368b/0x4173739f0fc81929 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996418.874706:0:15125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a515368b/0x4173739f0fc81929 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996418.874714:0:15125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a515368b/0x4173739f0fc81929 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996418.874721:0:15125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a515368b/0x4173739f0fc81929 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996418.874751:0:15125:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789996418.876698:0:15125:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789996418.876966:0:15125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f5263168/0x4173739f0fc81930 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996418.876990:0:15125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=460s v=(0 0) 00010000:00010000:0.0:1789996418.876995:0:15125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789996418.877001:0:15125:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f5263168/0x4173739f0fc81930 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996418.877022:0:15125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f5263168/0x4173739f0fc81930 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996418.877270:0:15125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f5263168/0x4173739f0fc81930 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996418.877312:0:15125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f5263168/0x4173739f0fc81930 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996418.877347:0:15125:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1789996418.878433:0:15125:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789996418.878457:0:15125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000be066f53/0x4173739f0fc81937 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996418.878470:0:15125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=460s v=(0 0) 00010000:00010000:0.0:1789996418.878495:0:15125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789996418.878500:0:15125:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000be066f53/0x4173739f0fc81937 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996418.878524:0:15125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000be066f53/0x4173739f0fc81937 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996418.878533:0:15125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000be066f53/0x4173739f0fc81937 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996418.878540:0:15125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000be066f53/0x4173739f0fc81937 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996418.878571:0:15125:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1789996418.879764:0:15125:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789996418.879775:0:15125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043daf9a1/0x4173739f0fc8193e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996418.879789:0:15125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=460s v=(0 0) 00010000:00010000:0.0:1789996418.879793:0:15125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789996418.879799:0:15125:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000043daf9a1/0x4173739f0fc8193e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996418.879810:0:15125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043daf9a1/0x4173739f0fc8193e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996418.879819:0:15125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043daf9a1/0x4173739f0fc8193e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996418.879833:0:15125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000043daf9a1/0x4173739f0fc8193e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996418.879844:0:15125:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:2.0:1789996418.880613:0:14429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1789996418.880624:0:14429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a515368b/0x4173739f0fc81929 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996418.880634:0:14429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0840031c00 already unused, calling callback (ffffffffc1595910) 00010000:00010000:2.0:1789996418.880648:0:14429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a515368b/0x4173739f0fc81929 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996418.880657:0:14429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a515368b/0x4173739f0fc81929 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996418.880677:0:14429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a515368b/0x4173739f0fc81929 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996418.880685:0:14429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a515368b/0x4173739f0fc81929 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996418.880707:0:14429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789996418.880711:0:14429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f5263168/0x4173739f0fc81930 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996418.880718:0:14429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0840031200 already unused, calling callback (ffffffffc1595910) 00010000:00010000:2.0:1789996418.880721:0:14429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f5263168/0x4173739f0fc81930 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996418.880729:0:14429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f5263168/0x4173739f0fc81930 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996418.880739:0:14429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f5263168/0x4173739f0fc81930 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996418.880746:0:14429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f5263168/0x4173739f0fc81930 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996418.880765:0:14429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789996418.880769:0:14429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000be066f53/0x4173739f0fc81937 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996418.880775:0:14429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0840030200 already unused, calling callback (ffffffffc1595910) 00010000:00010000:2.0:1789996418.880777:0:14429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000be066f53/0x4173739f0fc81937 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996418.880785:0:14429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000be066f53/0x4173739f0fc81937 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996418.880795:0:14429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000be066f53/0x4173739f0fc81937 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996418.880802:0:14429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000be066f53/0x4173739f0fc81937 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996418.880814:0:14429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789996418.880818:0:14429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000043daf9a1/0x4173739f0fc8193e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996418.880824:0:14429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0840031000 already unused, calling callback (ffffffffc1595910) 00010000:00010000:2.0:1789996418.880828:0:14429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000043daf9a1/0x4173739f0fc8193e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996418.880847:0:14429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000043daf9a1/0x4173739f0fc8193e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996418.880858:0:14429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000043daf9a1/0x4173739f0fc8193e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996418.880879:0:14429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043daf9a1/0x4173739f0fc8193e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996418.880893:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789996418.880894:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789996418.880896:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789996418.881708:0:14430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789996418.884280:0:15125:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789996418.884294:0:15125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001f1ee166/0x4173739f0fc81945 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996418.884309:0:15125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=460s v=(0 0) 00010000:00010000:0.0:1789996418.884313:0:15125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789996418.884319:0:15125:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001f1ee166/0x4173739f0fc81945 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996418.884332:0:15125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001f1ee166/0x4173739f0fc81945 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996418.884343:0:15125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001f1ee166/0x4173739f0fc81945 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996418.884350:0:15125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001f1ee166/0x4173739f0fc81945 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996418.884378:0:15125:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789996418.884893:0:15125:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789996418.884900:0:15125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000536128ba/0x4173739f0fc8194c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996418.884917:0:15125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=460s v=(0 0) 00010000:00010000:0.0:1789996418.884920:0:15125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789996418.884924:0:15125:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000536128ba/0x4173739f0fc8194c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996418.884933:0:15125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000536128ba/0x4173739f0fc8194c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996418.884941:0:15125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000536128ba/0x4173739f0fc8194c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996418.884949:0:15125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000536128ba/0x4173739f0fc8194c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996418.884970:0:15125:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1789996418.885030:0:14430:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789996418.885038:0:14430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001f1ee166/0x4173739f0fc81945 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996418.885047:0:14430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0840031400 already unused, calling callback (ffffffffc1595910) 00010000:00010000:1.0:1789996418.885057:0:14430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001f1ee166/0x4173739f0fc81945 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996418.885067:0:14430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001f1ee166/0x4173739f0fc81945 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996418.885086:0:14430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001f1ee166/0x4173739f0fc81945 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996418.885094:0:14430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001f1ee166/0x4173739f0fc81945 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996418.885111:0:14430:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789996418.885115:0:14430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000536128ba/0x4173739f0fc8194c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996418.885121:0:14430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0840031e00 already unused, calling callback (ffffffffc1595910) 00010000:00010000:1.0:1789996418.885125:0:14430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000536128ba/0x4173739f0fc8194c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996418.885131:0:14430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000536128ba/0x4173739f0fc8194c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996418.885140:0:14430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000536128ba/0x4173739f0fc8194c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996418.885148:0:14430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000536128ba/0x4173739f0fc8194c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996418.885165:0:14430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789996418.885166:0:14430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789996418.885168:0:14430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789996418.885397:0:15125:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789996418.885404:0:15125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000359ca922/0x4173739f0fc81953 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996418.885411:0:15125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=460s v=(0 0) 00010000:00010000:0.0:1789996418.885415:0:15125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789996418.885419:0:15125:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000359ca922/0x4173739f0fc81953 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996418.885429:0:15125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000359ca922/0x4173739f0fc81953 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996418.885450:0:15125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000359ca922/0x4173739f0fc81953 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996418.885456:0:15125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000359ca922/0x4173739f0fc81953 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996418.885477:0:15125:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:0.0:1789996418.885677:0:15125:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:5 00000100:00100000:0.0:1789996418.885785:0:15125:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0741a28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14464:x1876946942257408:12345-0@lo:5:osp-pre-0-0.0 Request processed in 82472us (82576us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996418.885795:0:15125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789996418.885859:0:14464:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0741a29c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14464:1876946942257408:0@lo:5:osp-pre-0-0.0 00010000:00010000:2.0:1789996418.885922:0:14429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789996418.885928:0:14429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000359ca922/0x4173739f0fc81953 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996418.885936:0:14429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e086fcb7200 already unused, calling callback (ffffffffc1595910) 00010000:00010000:2.0:1789996418.885939:0:14429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000359ca922/0x4173739f0fc81953 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996418.885947:0:14429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000359ca922/0x4173739f0fc81953 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996418.885961:0:14429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000359ca922/0x4173739f0fc81953 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996418.885980:0:14429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000359ca922/0x4173739f0fc81953 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996418.885995:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789996418.885996:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789996418.885998:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1789996418.886051:0:14464:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x5:0x0] 00000100:00100000:0.0:1789996418.886101:0:14464:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0741a29c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14464:1876946942257536:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1789996418.886136:0:14464:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996418.886221:0:14464:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0849c6f840 going to sleep for 11 seconds 00000100:00100000:0.0:1789996418.886240:0:15125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942257536 00000100:00100000:0.0:1789996418.886249:0:15125:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942257536 00010000:00010000:1.0:1789996418.886327:0:14430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789996418.886337:0:15124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789996418.886348:0:15124:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0741a2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14464:x1876946942257536:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1789996418.886396:0:15124:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00000100:00100000:2.0:1789996418.892889:0:15124:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0741a2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:14464:x1876946942257536:12345-0@lo:5:osp-pre-0-0.0 Request processed in 6535us (6744us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1789996418.892905:0:15124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789996418.893107:0:14464:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0741a29c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14464:1876946942257536:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1789996418.893123:0:14464:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00000004:00080000:2.0:1789996418.893661:0:5868:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00010000:00010000:2.0:1789996419.123807:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789996420.137771:0:14430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789996421.164266:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1789996421.232250:0:15843:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1789996421.232253:0:15843:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:1.0:1789996421.232570:0:15843:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8e07412a9000 00000020:01000004:1.0:1789996421.232587:0:15843:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1789996421.232599:0:15843:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:1.0:1789996421.232612:0:15843:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8e0849c799c0) 00000020:00000080:1.0:1789996421.232630:0:15843:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1789996421.251158:0:15843:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1789996421.251540:0:15843:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:1.0:1789996421.252383:0:15843:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1789996421.252873:0:15843:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:1.0:1789996421.253084:0:15843:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:0.0:1789996421.257748:0:15843:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 208: rc = 0 00100000:10000000:0.0:1789996421.257932:0:15843:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 208: rc = 0 00100000:10000000:0.0:1789996421.258286:0:15843:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 208: rc = 0 00100000:10000000:0.0:1789996421.260950:0:15843:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 458: rc = 0 00100000:10000000:0.0:1789996421.261462:0:15843:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 458: rc = 0 00100000:10000000:0.0:1789996421.261883:0:15843:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 458: rc = 0 00100000:10000000:0.0:1789996421.264514:0:15843:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 458: rc = 0 00100000:10000000:2.0:1789996421.265293:0:15843:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 458: rc = 0 00100000:10000000:2.0:1789996421.267563:0:15843:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 458: rc = 0 00000020:00000080:2.0:1789996421.270190:0:15843:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1789996421.270205:0:15843:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789996421.270220:0:15843:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x4173739f0fc81961 00000020:01000004:2.0:1789996421.270229:0:15843:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1789996421.270252:0:15843:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.137@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1789996421.270255:0:15843:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.137@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1789996421.270261:0:15843:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1789996421.270286:0:15843:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1789996421.270290:0:15843:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.137@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:0.0:1789996421.295283:0:15843:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.137@tcp ctxt 0 is initialized 00000020:01000004:0.0:1789996421.295331:0:15843:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.137@tcp, index=0001, flags=0x20002 00000020:01000004:0.0:1789996421.295336:0:15843:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1789996421.295338:0:15843:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789996421.295340:0:15843:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789996421.295341:0:15843:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789996421.295343:0:15843:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789996421.295344:0:15843:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789996421.295346:0:15843:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789996421.295348:0:15843:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789996421.295349:0:15843:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789996421.295353:0:15843:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:0.0:1789996421.295355:0:15843:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789996421.295356:0:15843:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789996421.295357:0:15843:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789996421.295358:0:15843:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789996421.295360:0:15843:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789996421.295361:0:15843:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789996421.295361:0:15843:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789996421.295431:0:15843:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789996421.295433:0:15843:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789996421.295470:0:15843:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1789996421.295493:0:15843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0741a29500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d64f88b3-32d6-473c-b613-b936200ef7a3:15843:1876946942257664:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789996421.295676:0:15843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996421.295833:0:15843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e085aa6b540 going to sleep for 11 seconds 00000100:00100000:3.0:1789996421.295921:0:14433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942257664 00000100:00100000:3.0:1789996421.295929:0:14433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942257664 00000100:00100000:3.0:1789996421.296023:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789996421.296033:0:14433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0877ad3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d64f88b3-32d6-473c-b613-b936200ef7a3+16:15843:x1876946942257664:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1789996421.296062:0:14433:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1789996421.296065:0:14433:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:3.0:1789996421.296068:0:14433:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1789996421.318102:0:14433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0877ad3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d64f88b3-32d6-473c-b613-b936200ef7a3+16:15843:x1876946942257664:12345-0@lo:253:mount.lustre.0 Request processed in 22060us (22486us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996421.318118:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789996421.318301:0:15843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0741a29500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d64f88b3-32d6-473c-b613-b936200ef7a3:15843:1876946942257664:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1789996421.318320:0:15843:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1789996421.318324:0:15843:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789996421.318326:0:15843:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789996421.318327:0:15843:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789996421.318328:0:15843:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789996421.318329:0:15843:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789996421.318331:0:15843:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789996421.318332:0:15843:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789996421.318334:0:15843:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789996421.318335:0:15843:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1789996421.318357:0:15843:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8e07412a9000 from lustre-OST0001 10000000:01000000:3.0:1789996421.318384:0:15843:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1789996421.318387:0:15843:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1789996421.318395:0:15843:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8e0876658000 local copy 00010000:00010000:3.0:1789996421.318404:0:15843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.137@tcp lock: ffff8e087f857a00/0x4173739f0fc81707 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc8170e expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789996421.319057:0:15843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fa91c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d64f88b3-32d6-473c-b613-b936200ef7a3:15843:1876946942257792:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789996421.319107:0:15843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789996421.319270:0:15843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0876b7e240 going to sleep for 11 seconds 00000100:00100000:0.0:1789996421.320304:0:14436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942257792 00000100:00100000:0.0:1789996421.320316:0:14436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942257792 00000100:00100000:0.0:1789996421.320444:0:14436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789996421.320492:0:14436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0877ad2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d64f88b3-32d6-473c-b613-b936200ef7a3+16:15843:x1876946942257792:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789996421.320810:0:14436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0877ad2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d64f88b3-32d6-473c-b613-b936200ef7a3+16:15843:x1876946942257792:12345-0@lo:501:mount.lustre.0 Request processed in 321us (1701us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789996421.320834:0:14436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789996421.321179:0:15843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fa91c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d64f88b3-32d6-473c-b613-b936200ef7a3:15843:1876946942257792:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1789996421.321212:0:15843:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.137@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1789996421.321379:0:15843:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.137@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1789996421.321387:0:15843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.137@tcp lock: ffff8e087f857a00/0x4173739f0fc81707 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc8170e expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996421.321399:0:15843:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.137@tcp lock: ffff8e087f857a00/0x4173739f0fc81707 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc8170e expref: -99 pid: 14423 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789996421.321429:0:15843:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8e07412a9000 10000000:01000000:3.0:1789996421.321433:0:15843:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789996421.321439:0:15843:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1789996421.321441:0:15843:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789996421.321446:0:15843:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1789996421.321449:0:15843:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1789996421.321489:0:15843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.137@tcp lock: ffff8e087f857600/0x4173739f0fc81968 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996421.321497:0:15843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.137@tcp lock: ffff8e087f857600/0x4173739f0fc81968 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996421.321506:0:15843:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.137@tcp lock: ffff8e087f857600/0x4173739f0fc81968 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789996421.321525:0:15843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fa91c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d64f88b3-32d6-473c-b613-b936200ef7a3:15843:1876946942257920:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789996421.321586:0:15843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789996421.329019:0:15843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0876b7e240 going to sleep for 11 seconds 00000100:00100000:2.0:1789996421.329222:0:14435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942257920 00000100:00100000:2.0:1789996421.329233:0:14435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942257920 00000100:00100000:3.0:1789996421.329452:0:14435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789996421.329490:0:14435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0877ad2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d64f88b3-32d6-473c-b613-b936200ef7a3+16:15843:x1876946942257920:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789996421.329529:0:14435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789996421.329565:0:14435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e087f856e00/0x4173739f0fc8196f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x4173739f0fc81968 expref: -99 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996421.329608:0:14435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e087f856e00/0x4173739f0fc8196f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4173739f0fc81968 expref: 17 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996421.329621:0:14435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e087f856e00/0x4173739f0fc8196f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4173739f0fc81968 expref: 17 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996421.329631:0:14435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e087f856e00, rc 0) 00000100:00100000:3.0:1789996421.329729:0:14435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0877ad2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d64f88b3-32d6-473c-b613-b936200ef7a3+17:15843:x1876946942257920:12345-0@lo:101:mount.lustre.0 Request processed in 249us (8142us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996421.329735:0:14435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789996421.329806:0:15843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fa91c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d64f88b3-32d6-473c-b613-b936200ef7a3:15843:1876946942257920:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789996421.329837:0:15843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.137@tcp lock: ffff8e087f857600/0x4173739f0fc81968 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc8196f expref: -99 pid: 15843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996421.329847:0:15843:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.137@tcp lock: ffff8e087f857600/0x4173739f0fc81968 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x4173739f0fc8196f expref: -99 pid: 15843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789996421.331322:0:15843:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1789996421.334484:0:15843:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789996421.335395:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1789996421.335452:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1789996421.335519:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1789996421.335616:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1789996421.335671:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1789996421.336002:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1789996421.336092:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1789996421.336100:0:15843:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1789996421.336277:0:15843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fa91c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d64f88b3-32d6-473c-b613-b936200ef7a3:15843:1876946942258048:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789996421.336348:0:15843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789996421.336384:0:15843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0876b7e600 going to sleep for 11 seconds 00000100:00100000:0.0:1789996421.336919:0:14435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942258048 00000100:00100000:0.0:1789996421.336929:0:14435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942258048 00000100:00100000:0.0:1789996421.336980:0:14435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789996421.336990:0:14435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0876ac4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d64f88b3-32d6-473c-b613-b936200ef7a3+17:15843:x1876946942258048:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789996421.338001:0:14435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0876ac4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d64f88b3-32d6-473c-b613-b936200ef7a3+17:15843:x1876946942258048:12345-0@lo:501:mount.lustre.0 Request processed in 1009us (1649us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996421.338011:0:14435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789996421.338246:0:15843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fa91c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d64f88b3-32d6-473c-b613-b936200ef7a3:15843:1876946942258048:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789996421.338295:0:15843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fa91c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d64f88b3-32d6-473c-b613-b936200ef7a3:15843:1876946942258176:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789996421.338350:0:15843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789996421.338377:0:15843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0876b7e600 going to sleep for 11 seconds 00000100:00100000:0.0:1789996421.338503:0:14435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942258176 00000100:00100000:0.0:1789996421.338510:0:14435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942258176 00000100:00100000:0.0:1789996421.338569:0:14435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789996421.338577:0:14435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0876ac4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d64f88b3-32d6-473c-b613-b936200ef7a3+17:15843:x1876946942258176:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789996421.339350:0:14435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0876ac4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d64f88b3-32d6-473c-b613-b936200ef7a3+17:15843:x1876946942258176:12345-0@lo:503:mount.lustre.0 Request processed in 771us (997us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996421.339358:0:14435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789996421.339509:0:15843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fa91c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d64f88b3-32d6-473c-b613-b936200ef7a3:15843:1876946942258176:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789996421.341643:0:15843:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789996421.341739:0:15843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fa91c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d64f88b3-32d6-473c-b613-b936200ef7a3:15843:1876946942258304:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789996421.342077:0:15843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789996421.342184:0:15843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0876b7e600 going to sleep for 11 seconds 00000100:00100000:1.0:1789996421.342307:0:14433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942258304 00000100:00100000:1.0:1789996421.342316:0:14433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942258304 00000100:00100000:0.0:1789996421.342392:0:14435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789996421.342404:0:14435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0876ac6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d64f88b3-32d6-473c-b613-b936200ef7a3+17:15843:x1876946942258304:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789996421.343063:0:14435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0876ac6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d64f88b3-32d6-473c-b613-b936200ef7a3+17:15843:x1876946942258304:12345-0@lo:502:mount.lustre.0 Request processed in 659us (984us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996421.343071:0:14435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789996421.343322:0:15843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fa91c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d64f88b3-32d6-473c-b613-b936200ef7a3:15843:1876946942258304:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789996421.343950:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1789996421.344009:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1789996421.344038:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1789996421.344081:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1789996421.344115:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1789996421.344145:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1789996421.344281:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1789996421.344321:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1789996421.344389:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:3.0:1789996421.344434:0:15843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fa91c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d64f88b3-32d6-473c-b613-b936200ef7a3:15843:1876946942258432:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789996421.344944:0:15843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789996421.345047:0:15843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0876b7e600 going to sleep for 11 seconds 00000100:00100000:0.0:1789996421.345104:0:14435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942258432 00000100:00100000:0.0:1789996421.345111:0:14435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942258432 00000100:00100000:0.0:1789996421.345279:0:14435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789996421.345296:0:14435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0876ac5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d64f88b3-32d6-473c-b613-b936200ef7a3+17:15843:x1876946942258432:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789996421.345523:0:14435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0876ac5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d64f88b3-32d6-473c-b613-b936200ef7a3+17:15843:x1876946942258432:12345-0@lo:502:mount.lustre.0 Request processed in 229us (580us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996421.345531:0:14435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789996421.345653:0:15843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fa91c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d64f88b3-32d6-473c-b613-b936200ef7a3:15843:1876946942258432:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789996421.345737:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:3.0:1789996421.345762:0:15843:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:3.0:1789996421.346934:0:15844:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789996421.346944:0:15844:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:3.0:1789996421.346949:0:15844:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789996421.346951:0:15844:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1789996421.346956:0:15844:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789996421.346970:0:15844:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8e08545d4d40) 00000020:00000080:3.0:1789996421.346996:0:15844:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:3.0:1789996421.347001:0:15844:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789996421.347059:0:15844:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e07412a9000 from lustre-OST0001, refs=2 00080000:01000000:3.0:1789996421.347066:0:15844:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789996421.347073:0:15844:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x4173739f0fc8197d 00010000:00010000:3.0:1789996421.353385:0:15844:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:3.0:1789996421.354280:0:15844:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:2.0:1789996421.362440:0:15844:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:3.0:1789996421.365151:0:15844:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1789996421.365439:0:15844:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789996421.365445:0:15844:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789996421.365448:0:15844:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1789996421.365451:0:15844:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789996421.365455:0:15844:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789996421.365457:0:15844:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789996421.365460:0:15844:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789996421.365461:0:15844:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1789996421.365463:0:15844:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789996421.365466:0:15844:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789996421.365467:0:15844:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:3.0:1789996421.365469:0:15844:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789996421.365472:0:15844:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789996421.365473:0:15844:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1789996421.376532:0:15844:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1789996421.376654:0:15844:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789996421.376659:0:15844:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789996421.376661:0:15844:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1789996421.376665:0:15844:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:0.0:1789996421.377076:0:15843:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:0.0:1789996421.377107:0:15843:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.137@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1789996421.377126:0:15843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.137@tcp lock: ffff8e087f857600/0x4173739f0fc81968 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc8196f expref: -99 pid: 15843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996421.377140:0:15843:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.137@tcp lock: ffff8e087f857600/0x4173739f0fc81968 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc8196f expref: -99 pid: 15843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789996421.377170:0:15843:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e07412a9000 from 1 10000000:01000000:0.0:1789996421.377174:0:15843:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789996421.377215:0:15843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.137@tcp lock: ffff8e086fcb6000/0x4173739f0fc81984 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996421.377224:0:15843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.137@tcp lock: ffff8e086fcb6000/0x4173739f0fc81984 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996421.377235:0:15843:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.137@tcp lock: ffff8e086fcb6000/0x4173739f0fc81984 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789996421.377264:0:15843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0741a2b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d64f88b3-32d6-473c-b613-b936200ef7a3:15843:1876946942258560:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789996421.377338:0:15843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996421.377710:0:15843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0848b68900 going to sleep for 11 seconds 00000100:00100000:3.0:1789996421.380599:0:14436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942258560 00000100:00100000:3.0:1789996421.380615:0:14436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942258560 00000100:00100000:3.0:1789996421.380986:0:14436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789996421.380996:0:14436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0876ac6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d64f88b3-32d6-473c-b613-b936200ef7a3+17:15843:x1876946942258560:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789996421.381012:0:14436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789996421.381030:0:14436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e087f857200/0x4173739f0fc8198b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4173739f0fc81984 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996421.381058:0:14436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e087f857200/0x4173739f0fc8198b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4173739f0fc81984 expref: 18 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996421.381069:0:14436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e087f857200/0x4173739f0fc8198b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4173739f0fc81984 expref: 18 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996421.381077:0:14436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e087f857200, rc 0) 00000100:00100000:3.0:1789996421.381142:0:14436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0876ac6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d64f88b3-32d6-473c-b613-b936200ef7a3+18:15843:x1876946942258560:12345-0@lo:101:mount.lustre.0 Request processed in 148us (3805us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996421.381149:0:14436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789996421.381280:0:15843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0741a2b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d64f88b3-32d6-473c-b613-b936200ef7a3:15843:1876946942258560:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789996421.381299:0:15843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.137@tcp lock: ffff8e086fcb6000/0x4173739f0fc81984 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc8198b expref: -99 pid: 15843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996421.381320:0:15843:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.137@tcp lock: ffff8e086fcb6000/0x4173739f0fc81984 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4173739f0fc8198b expref: -99 pid: 15843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789996421.382163:0:15843:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:0.0:1789996421.383108:0:15843:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789996421.383969:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:0.0:1789996421.384036:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:0.0:1789996421.384108:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:0.0:1789996421.384116:0:15843:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:0.0:1789996421.385304:0:15843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0741a2b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d64f88b3-32d6-473c-b613-b936200ef7a3:15843:1876946942258688:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789996421.385771:0:15843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996421.386252:0:14435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942258688 00000100:00100000:1.0:1789996421.386262:0:14435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942258688 00000100:00100000:1.0:1789996421.386367:0:14435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789996421.386377:0:14435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0876ac7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d64f88b3-32d6-473c-b613-b936200ef7a3+18:15843:x1876946942258688:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789996421.386986:0:15843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0848b68900 going to sleep for 11 seconds 00000100:00100000:1.0:1789996421.387167:0:14435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0876ac7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d64f88b3-32d6-473c-b613-b936200ef7a3+18:15843:x1876946942258688:12345-0@lo:501:mount.lustre.0 Request processed in 780us (1385us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996421.387183:0:14435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789996421.387203:0:15843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0741a2b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d64f88b3-32d6-473c-b613-b936200ef7a3:15843:1876946942258688:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789996421.387253:0:15843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0741a2b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d64f88b3-32d6-473c-b613-b936200ef7a3:15843:1876946942258816:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789996421.387305:0:15843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996421.389979:0:15843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0848b68900 going to sleep for 11 seconds 00000100:00100000:3.0:1789996421.389993:0:14436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942258816 00000100:00100000:3.0:1789996421.390003:0:14436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942258816 00000100:00100000:3.0:1789996421.390064:0:14436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789996421.390077:0:14436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0876ac5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d64f88b3-32d6-473c-b613-b936200ef7a3+18:15843:x1876946942258816:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789996421.390468:0:14436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0876ac5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d64f88b3-32d6-473c-b613-b936200ef7a3+18:15843:x1876946942258816:12345-0@lo:503:mount.lustre.0 Request processed in 393us (3162us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996421.390594:0:14436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789996421.390603:0:15843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0741a2b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d64f88b3-32d6-473c-b613-b936200ef7a3:15843:1876946942258816:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1789996421.391273:0:15843:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789996421.391346:0:15843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0741a2b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d64f88b3-32d6-473c-b613-b936200ef7a3:15843:1876946942258944:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789996421.393116:0:15843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996421.393350:0:15843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e08475d1900 going to sleep for 11 seconds 00000100:00100000:3.0:1789996421.393398:0:14436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942258944 00000100:00100000:3.0:1789996421.393405:0:14436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942258944 00000100:00100000:3.0:1789996421.393580:0:14436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789996421.393592:0:14436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0876ac7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d64f88b3-32d6-473c-b613-b936200ef7a3+18:15843:x1876946942258944:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789996421.394780:0:14436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0876ac7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d64f88b3-32d6-473c-b613-b936200ef7a3+18:15843:x1876946942258944:12345-0@lo:502:mount.lustre.0 Request processed in 1185us (1661us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996421.394791:0:14436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789996421.394956:0:15843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0741a2b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d64f88b3-32d6-473c-b613-b936200ef7a3:15843:1876946942258944:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789996421.395368:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1789996421.395435:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1789996421.395811:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1789996421.395957:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1789996421.396000:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1789996421.396052:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1789996421.396090:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1789996421.396144:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:2.0:1789996421.396270:0:15843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086faed180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d64f88b3-32d6-473c-b613-b936200ef7a3:15843:1876946942259072:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789996421.396340:0:15843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996421.396442:0:15843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e08475afe40 going to sleep for 11 seconds 00000100:00100000:0.0:1789996421.396748:0:14433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942259072 00000100:00100000:0.0:1789996421.396761:0:14433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942259072 00000100:00100000:1.0:1789996421.397938:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789996421.397956:0:14433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0876b7a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d64f88b3-32d6-473c-b613-b936200ef7a3+18:15843:x1876946942259072:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789996421.398351:0:14433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0876b7a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d64f88b3-32d6-473c-b613-b936200ef7a3+18:15843:x1876946942259072:12345-0@lo:502:mount.lustre.0 Request processed in 399us (2010us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996421.398360:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789996421.399448:0:15843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086faed180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d64f88b3-32d6-473c-b613-b936200ef7a3:15843:1876946942259072:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789996421.399734:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:0.0:1789996421.399754:0:15843:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:0.0:1789996421.401246:0:15848:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789996421.401261:0:15848:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789996421.401263:0:15848:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1789996421.401270:0:15848:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e07412a9000 00000020:00000080:0.0:1789996421.401273:0:15848:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789996421.401280:0:15848:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789996421.401282:0:15848:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789996421.401283:0:15848:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1789996421.401286:0:15848:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789996421.401288:0:15848:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789996421.401289:0:15848:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1789996421.401292:0:15848:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e07412a9000 00000020:00000080:0.0:1789996421.401294:0:15848:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789996421.401358:0:15848:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789996421.401362:0:15848:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789996421.401363:0:15848:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1789996421.401366:0:15848:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789996421.401368:0:15848:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789996421.401369:0:15848:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789996421.401372:0:15848:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8e07412a9000 00000020:00000080:0.0:1789996421.401374:0:15848:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789996421.401411:0:15848:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789996421.401415:0:15848:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789996421.401416:0:15848:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1789996421.401420:0:15848:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:1.0:1789996421.406942:0:15843:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1789996421.406988:0:15843:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.137@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789996421.407062:0:15843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.137@tcp lock: ffff8e086fcb6000/0x4173739f0fc81984 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc8198b expref: -99 pid: 15843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996421.407078:0:15843:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.137@tcp lock: ffff8e086fcb6000/0x4173739f0fc81984 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc8198b expref: -99 pid: 15843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789996421.407233:0:15843:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1789996421.407237:0:15843:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8e07412a9000 10000000:01000000:1.0:1789996421.407241:0:15843:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8e07412a9000 10000000:01000000:1.0:1789996421.407247:0:15843:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789996421.407254:0:15843:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8e07412a9000 from 1 10000000:01000000:1.0:1789996421.407257:0:15843:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789996421.407297:0:15843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.137@tcp lock: ffff8e0876a23800/0x4173739f0fc81992 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996421.407306:0:15843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.137@tcp lock: ffff8e0876a23800/0x4173739f0fc81992 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996421.407316:0:15843:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.137@tcp lock: ffff8e0876a23800/0x4173739f0fc81992 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789996421.407344:0:15843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fc9ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d64f88b3-32d6-473c-b613-b936200ef7a3:15843:1876946942259200:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789996421.407416:0:15843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996421.415275:0:15843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0842b84540 going to sleep for 11 seconds 00000100:00100000:0.0:1789996421.415465:0:14436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942259200 00000100:00100000:0.0:1789996421.415486:0:14436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942259200 00000100:00100000:0.0:1789996421.415585:0:14436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789996421.415597:0:14436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0876b79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d64f88b3-32d6-473c-b613-b936200ef7a3+18:15843:x1876946942259200:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789996421.415616:0:14436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789996421.415940:0:14436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e086fcb6a00/0x4173739f0fc81999 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x4173739f0fc81992 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996421.415973:0:14436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e086fcb6a00/0x4173739f0fc81999 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4173739f0fc81992 expref: 19 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996421.415984:0:14436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e086fcb6a00/0x4173739f0fc81999 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4173739f0fc81992 expref: 19 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996421.415992:0:14436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e086fcb6a00, rc 0) 00000100:00100000:0.0:1789996421.416067:0:14436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0876b79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d64f88b3-32d6-473c-b613-b936200ef7a3+19:15843:x1876946942259200:12345-0@lo:101:mount.lustre.0 Request processed in 473us (8650us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996421.416075:0:14436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789996421.416274:0:15843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fc9ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d64f88b3-32d6-473c-b613-b936200ef7a3:15843:1876946942259200:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789996421.416292:0:15843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.137@tcp lock: ffff8e0876a23800/0x4173739f0fc81992 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc81999 expref: -99 pid: 15843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996421.416302:0:15843:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.137@tcp lock: ffff8e0876a23800/0x4173739f0fc81992 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x4173739f0fc81999 expref: -99 pid: 15843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789996421.417236:0:15843:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:3.0:1789996421.418452:0:15843:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789996421.421343:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1789996421.421425:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1789996421.421464:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1789996421.423242:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1789996421.423308:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1789996421.423363:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1789996421.423402:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1789996421.423437:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1789996421.423500:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1789996421.423608:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1789996421.425842:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1789996421.427139:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1789996421.427785:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1789996421.427848:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1789996421.428147:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1789996421.428780:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1789996421.428830:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1789996421.429267:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1789996421.429313:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1789996421.429350:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1789996421.429404:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1789996421.429442:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1789996421.429493:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1789996421.430419:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1789996421.430944:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:3.0:1789996421.431012:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:3.0:1789996421.431105:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:3.0:1789996421.431148:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:3.0:1789996421.431200:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:3.0:1789996421.431251:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:3.0:1789996421.431288:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:3.0:1789996421.431326:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:3.0:1789996421.431362:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:3.0:1789996421.431411:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:3.0:1789996421.431451:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:3.0:1789996421.431514:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:3.0:1789996421.431597:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:3.0:1789996421.431785:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:3.0:1789996421.431794:0:15843:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:3.0:1789996421.431911:0:15843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fa91c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d64f88b3-32d6-473c-b613-b936200ef7a3:15843:1876946942259328:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789996421.431979:0:15843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789996421.432030:0:15843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0848652e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789996421.432206:0:14433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942259328 00000100:00100000:2.0:1789996421.432215:0:14433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942259328 00000100:00100000:2.0:1789996421.432262:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789996421.432272:0:14433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0876b7a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d64f88b3-32d6-473c-b613-b936200ef7a3+19:15843:x1876946942259328:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789996421.432517:0:14433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0876b7a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d64f88b3-32d6-473c-b613-b936200ef7a3+19:15843:x1876946942259328:12345-0@lo:501:mount.lustre.0 Request processed in 245us (536us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996421.432525:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789996421.432995:0:15843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fa91c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d64f88b3-32d6-473c-b613-b936200ef7a3:15843:1876946942259328:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789996421.433034:0:15843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fa91c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d64f88b3-32d6-473c-b613-b936200ef7a3:15843:1876946942259456:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789996421.433082:0:15843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789996421.433115:0:15843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0848652e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789996421.433177:0:14435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942259456 00000100:00100000:2.0:1789996421.433183:0:14435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942259456 00000100:00100000:2.0:1789996421.433218:0:14435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789996421.433226:0:14435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0876b78c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d64f88b3-32d6-473c-b613-b936200ef7a3+19:15843:x1876946942259456:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789996421.433371:0:14435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0876b78c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d64f88b3-32d6-473c-b613-b936200ef7a3+19:15843:x1876946942259456:12345-0@lo:503:mount.lustre.0 Request processed in 146us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996421.433387:0:14435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789996421.433533:0:15843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fa91c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d64f88b3-32d6-473c-b613-b936200ef7a3:15843:1876946942259456:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789996421.434124:0:15843:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789996421.434203:0:15843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fa91c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d64f88b3-32d6-473c-b613-b936200ef7a3:15843:1876946942259584:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789996421.434247:0:15843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789996421.434273:0:14436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942259584 00000100:00100000:3.0:1789996421.434278:0:14436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942259584 00000100:00100000:3.0:1789996421.434303:0:14436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789996421.434310:0:14436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0876b79450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d64f88b3-32d6-473c-b613-b936200ef7a3+19:15843:x1876946942259584:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789996421.434516:0:14436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0876b79450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d64f88b3-32d6-473c-b613-b936200ef7a3+19:15843:x1876946942259584:12345-0@lo:502:mount.lustre.0 Request processed in 205us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996421.434523:0:14436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789996421.434580:0:15843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0848652e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789996421.434596:0:15843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fa91c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d64f88b3-32d6-473c-b613-b936200ef7a3:15843:1876946942259584:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789996421.434957:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1789996421.435005:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1789996421.435058:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1789996421.435134:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1789996421.435174:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1789996421.435222:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1789996421.435259:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1789996421.435294:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1789996421.435339:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1789996421.435374:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1789996421.435408:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1789996421.435457:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1789996421.435503:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1789996421.435540:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1789996421.435613:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1789996421.435650:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1789996421.435701:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1789996421.435752:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1789996421.435788:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1789996421.435839:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1789996421.435893:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1789996421.435930:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1789996421.435970:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1789996421.436043:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1789996421.436104:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:3.0:1789996421.436147:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:3.0:1789996421.436198:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:3.0:1789996421.436236:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:3.0:1789996421.436269:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:3.0:1789996421.436316:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:3.0:1789996421.436356:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:3.0:1789996421.436396:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:3.0:1789996421.440878:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:3.0:1789996421.441039:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:3.0:1789996421.441107:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:3.0:1789996421.441185:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:3.0:1789996421.441238:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:3.0:1789996421.441283:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:3.0:1789996421.441351:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:3.0:1789996421.441388:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:3.0:1789996421.441436:0:15843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fa91c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d64f88b3-32d6-473c-b613-b936200ef7a3:15843:1876946942259712:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789996421.441523:0:15843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789996421.441596:0:14433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942259712 00000100:00100000:3.0:1789996421.441604:0:14433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942259712 00000100:00100000:3.0:1789996421.443728:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789996421.443744:0:14433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0876b7b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d64f88b3-32d6-473c-b613-b936200ef7a3+19:15843:x1876946942259712:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789996421.444142:0:14433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0876b7b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d64f88b3-32d6-473c-b613-b936200ef7a3+19:15843:x1876946942259712:12345-0@lo:502:mount.lustre.0 Request processed in 404us (2618us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996421.444204:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789996421.444279:0:15843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0848652e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789996421.444312:0:15843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fa91c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d64f88b3-32d6-473c-b613-b936200ef7a3:15843:1876946942259712:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789996421.444428:0:15843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:3.0:1789996421.444444:0:15843:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:1.0:1789996421.448268:0:15853:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1789996421.448284:0:15853:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8e0849c7cd40) 00000020:00000080:1.0:1789996421.448306:0:15853:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:1.0:1789996421.448408:0:15853:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e07412a9000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1789996421.448412:0:15853:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8e07412a9000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1789996421.448415:0:15853:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e07412a9000 3 00010000:00080000:1.0:1789996421.448445:0:15853:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e07437ea000@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.137@tcp at head 00010000:00010000:0.0:1789996421.457743:0:15853:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:0.0:1789996421.462979:0:15853:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1789996421.463024:0:15853:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789996421.463037:0:15853:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x4173739f0fc819a7 00000100:00080000:0.0:1789996421.463779:0:15853:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789996421.463792:0:15853:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8e07437ea000 using connection 192.168.204.137@tcp/0@lo 00000100:00100000:0.0:1789996421.463855:0:15853:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e0741a2bb80 x1876946942259840/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789996421.463877:0:15853:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1789996421.464279:0:12638:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789996421.464285:0:12638:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789996421.464288:0:12638:0:(import.c:65:import_set_state_nolock()) ffff8e0848960000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789996421.464293:0:12638:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 460 00000100:00080000:3.0:1789996421.464298:0:12638:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1789996421.464304:0:12638:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8e0848960000 using connection 192.168.204.137@tcp/0@lo 00000100:00100000:3.0:1789996421.464319:0:12638:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e086fa93b80 x1876946942260096/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789996421.464362:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789996421.464379:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fa91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876946942259968:0@lo:400:kworker.0 00000100:00100000:3.0:1789996421.464449:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996421.465280:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0741a2bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3312:1876946942259840:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789996421.465338:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996421.465380:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fa93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3312:1876946942260096:0@lo:8:kworker.0 00000100:00100000:1.0:1789996421.465404:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996421.465450:0:14441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942259840 00000100:00100000:1.0:1789996421.465458:0:14441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942259840 00000100:00100000:1.0:1789996421.465510:0:14441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789996421.465518:0:14441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fc9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3312:x1876946942259840:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1789996421.465558:0:14441:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 463 last 0 00000020:00000080:1.0:1789996421.465596:0:14441:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x4173739f0fc819ae 00000004:00100000:1.0:1789996421.465610:0:14441:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789996421.465642:0:14441:0:(import.c:65:import_set_state_nolock()) ffff8e07437eb800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789996421.465775:0:14441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fc9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876946942259840:12345-0@lo:38:llog_process_th.0 Request processed in 255us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996421.465783:0:14441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789996421.465808:0:15126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942259968 00000100:00100000:1.0:1789996421.465822:0:15126:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942259968 00000100:00100000:1.0:1789996421.465857:0:15126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942260096 00000100:00100000:3.0:1789996421.466045:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fa90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876946942260224:0@lo:400:kworker.0 00000100:00100000:3.0:1789996421.466074:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789996421.466108:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789996421.466115:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fa90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1876946942260352:0@lo:400:kworker.0 00000100:00100000:3.0:1789996421.466139:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996421.466773:0:15126:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942260096 00000100:00100000:1.0:1789996421.466800:0:15126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789996421.466809:0:15126:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fa91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3313:x1876946942259968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789996421.467034:0:15125:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1789996421.467043:0:15125:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1789996421.467216:0:14441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942260224 00000100:00100000:3.0:1789996421.467220:0:14441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942260224 00000100:00100000:3.0:1789996421.467244:0:14441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942260352 00000100:00100000:3.0:1789996421.467247:0:14441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942260352 00000100:00100000:3.0:1789996421.467279:0:14441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789996421.467286:0:14441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fa93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876946942260224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789996421.467325:0:14441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fa93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876946942260224:12345-0@lo:400:kworker.0 Request processed in 39us (1249us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996421.467332:0:14441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789996421.467348:0:14441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789996421.467354:0:14441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fa92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876946942260352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789996421.467382:0:14441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fa92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1876946942260352:12345-0@lo:400:kworker.0 Request processed in 29us (1242us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996421.467388:0:14441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:3.0:1789996421.467422:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e086fa90700 x1876946942260352/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789996437 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789996421.467436:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fa90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3315:1876946942260352:0@lo:400:kworker.0 00010000:00080000:3.0:1789996421.467448:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e086fa90a80 x1876946942260224/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789996437 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789996421.467455:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fa90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876946942260224:0@lo:400:kworker.0 00000100:00100000:1.0:1789996421.467786:0:15126:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fa91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3313:x1876946942259968:12345-0@lo:400:kworker.0 Request processed in 977us (3336us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996421.467793:0:15126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789996421.467824:0:15126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789996421.467829:0:15126:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fc9b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3312:x1876946942260096:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1789996421.468016:0:15126:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fc9b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3312:x1876946942260096:12345-0@lo:8:kworker.0 Request processed in 185us (2610us total) trans 0 rc -11/-11 00000100:00100000:1.0:1789996421.468023:0:15126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1789996421.468043:0:14437:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789996421.468047:0:14437:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789996421.468087:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fa91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876946942259968:0@lo:400:kworker.0 00010000:00080000:1.0:1789996421.468121:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e0741a2bb80 x1876946942259840/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789996431 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789996421.468131:0:3312:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789996421.468138:0:3312:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:1.0:1789996421.468145:0:3312:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1789996421.468531:0:3312:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789996421.468535:0:3312:0:(import.c:65:import_set_state_nolock()) ffff8e07437ea000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789996421.468581:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0741a2bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3312:1876946942259840:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789996421.468595:0:3312:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789996421.468599:0:3312:0:(import.c:65:import_set_state_nolock()) ffff8e0848960000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789996421.468602:0:3312:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1789996421.468605:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fa93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3312:1876946942260096:0@lo:8:kworker.0 00000040:00080000:1.0:1789996421.469970:0:15853:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:3.0:1789996421.470422:0:15843:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1789996421.470457:0:15843:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.137@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789996421.471564:0:15843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.137@tcp lock: ffff8e0876a23800/0x4173739f0fc81992 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc81999 expref: -99 pid: 15843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996421.471592:0:15843:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.137@tcp lock: ffff8e0876a23800/0x4173739f0fc81992 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc81999 expref: -99 pid: 15843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1789996421.471649:0:15843:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1789996421.471652:0:15843:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789996421.471653:0:15843:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789996421.471654:0:15843:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789996421.471655:0:15843:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789996421.471657:0:15843:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789996421.471658:0:15843:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789996421.471660:0:15843:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789996421.471661:0:15843:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789996421.471666:0:15843:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:3.0:1789996421.471677:0:15843:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789996421.471678:0:15843:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789996421.471679:0:15843:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789996421.471681:0:15843:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789996421.471682:0:15843:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789996421.471683:0:15843:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789996421.471684:0:15843:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789996421.471685:0:15843:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789996421.471687:0:15843:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789996421.471714:0:15843:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1789996421.471732:0:15843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fa90a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d64f88b3-32d6-473c-b613-b936200ef7a3:15843:1876946942260480:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789996421.471799:0:15843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789996421.471849:0:15843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e08486529c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789996421.472025:0:14435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942260480 00000100:00100000:2.0:1789996421.472034:0:14435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942260480 00000100:00100000:2.0:1789996421.472078:0:14435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789996421.472087:0:14435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0876b78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d64f88b3-32d6-473c-b613-b936200ef7a3+19:15843:x1876946942260480:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789996421.472123:0:14435:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1789996421.472136:0:14435:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1789996421.511940:0:14435:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1789996421.511961:0:14435:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1789996421.512018:0:14457:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789996421.512024:0:14457:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1789996421.512063:0:14457:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e086fcb7e00/0x4173739f0fc819b5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996421.512083:0:14457:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e087f857800/0x4173739f0fc81888 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4173739f0fc81881 expref: 19 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996421.512114:0:14457:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8e086fcb7e00/0x4173739f0fc819b5 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996421.512158:0:14457:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e087f857800/0x4173739f0fc81888 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4173739f0fc81881 expref: 19 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996421.512174:0:14457:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e087f857800/0x4173739f0fc81888 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4173739f0fc81881 expref: 19 pid: 14436 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789996421.512188:0:14457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0741a28380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14457:1876946942260608:0@lo:104: 00000100:00100000:0.0:1789996421.512255:0:14457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996421.512304:0:14457:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0852b62f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789996421.512321:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942260608 00000100:00100000:1.0:1789996421.512336:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942260608 00000100:00100000:1.0:1789996421.512390:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789996421.512400:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0741a2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d64f88b3-32d6-473c-b613-b936200ef7a3+3:14457:x1876946942260608:12345-0@lo:104: 00010000:00010000:1.0:1789996421.512413:0:14424:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.137@tcp lock: ffff8e086fcb6c00/0x4173739f0fc81881 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4173739f0fc81888 expref: -99 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996421.512465:0:14424:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789996421.512472:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0741a2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d64f88b3-32d6-473c-b613-b936200ef7a3+3:14457:x1876946942260608:12345-0@lo:104: Request processed in 73us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996421.512479:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:2.0:1789996421.512558:0:14430:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789996421.512565:0:14430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.137@tcp lock: ffff8e086fcb6c00/0x4173739f0fc81881 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4173739f0fc81888 expref: -99 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996421.512573:0:14430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e086fcb6c00 already unused, calling callback (ffffffffc1be0c20) 10000000:00010000:2.0:1789996421.512576:0:14430:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.137@tcp lock: ffff8e086fcb6c00/0x4173739f0fc81881 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4173739f0fc81888 expref: -99 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996421.512585:0:14430:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.137@tcp lock: ffff8e086fcb6c00/0x4173739f0fc81881 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4173739f0fc81888 expref: -99 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789996421.512592:0:14430:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.137@tcp lock: ffff8e086fcb6c00/0x4173739f0fc81881 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4173739f0fc81888 expref: -99 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789996421.512598:0:14430:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:0.0:1789996421.512651:0:14457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0741a28380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14457:1876946942260608:0@lo:104: 00010000:00010000:0.0:1789996421.512672:0:14457:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8e086fcb7e00/0x4173739f0fc819b5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996421.512835:0:14430:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.137@tcp lock: ffff8e086fcb6c00/0x4173739f0fc81881 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4173739f0fc81888 expref: -99 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996421.512842:0:14430:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789996421.512863:0:14430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.137@tcp lock: ffff8e086fcb6c00/0x4173739f0fc81881 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4173739f0fc81888 expref: -99 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996421.512881:0:14430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.137@tcp lock: ffff8e086fcb6c00/0x4173739f0fc81881 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4173739f0fc81888 expref: -99 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996421.513026:0:14430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789996421.513028:0:14430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789996421.513030:0:14430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789996421.513044:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086faec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d64f88b3-32d6-473c-b613-b936200ef7a3:3313:1876946942260736:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789996421.513078:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789996421.513334:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942260736 00000100:00100000:3.0:1789996421.513340:0:14426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942260736 00010000:00010000:3.0:1789996421.513360:0:14426:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e087f857800/0x4173739f0fc81888 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4173739f0fc81881 expref: 20 pid: 14436 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789996421.513393:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789996421.513401:0:14426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086faee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d64f88b3-32d6-473c-b613-b936200ef7a3+20:3313:x1876946942260736:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789996421.513493:0:14426:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789996421.513500:0:14426:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e087f857800/0x4173739f0fc81888 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4173739f0fc81881 expref: 20 pid: 14436 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996421.513511:0:14426:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e087f857800/0x4173739f0fc81888 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4173739f0fc81881 expref: 20 pid: 14436 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996421.513526:0:14426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e087f857800/0x4173739f0fc81888 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4173739f0fc81881 expref: 20 pid: 14436 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996421.513539:0:14426:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8e086fcb7e00/0x4173739f0fc819b5 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996421.513581:0:14426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e086fcb7e00/0x4173739f0fc819b5 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789996421.513595:0:14426:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002072069s 00010000:00010000:3.0:1789996421.513600:0:14426:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e086fcb7e00/0x4173739f0fc819b5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996421.513607:0:14426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e086fcb7e00/0x4173739f0fc819b5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996421.513614:0:14426:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e086fcb7e00/0x4173739f0fc819b5 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996421.513621:0:14426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e086fcb7e00/0x4173739f0fc819b5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996421.513627:0:14426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e086fcb7e00 already unused, calling callback (ffffffffc1595910) 00010000:00010000:3.0:1789996421.513631:0:14426:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e086fcb7e00/0x4173739f0fc819b5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996421.513646:0:14426:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e086fcb7e00/0x4173739f0fc819b5 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996421.513661:0:14426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e086fcb7e00/0x4173739f0fc819b5 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996421.513672:0:14426:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789996421.513672:0:14457:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8e086fcb7e00/0x4173739f0fc819b5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996421.513680:0:14457:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e086fcb7e00/0x4173739f0fc819b5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996421.513686:0:14457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e086fcb7e00/0x4173739f0fc819b5 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789996421.513713:0:14426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086faee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d64f88b3-32d6-473c-b613-b936200ef7a3+19:3313:x1876946942260736:12345-0@lo:103:ldlm_bl.0 Request processed in 312us (633us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996421.513720:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789996421.513737:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086faec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d64f88b3-32d6-473c-b613-b936200ef7a3:3313:1876946942260736:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789996421.521639:0:14435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0876b78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d64f88b3-32d6-473c-b613-b936200ef7a3+18:15843:x1876946942260480:12345-0@lo:253:mount.lustre.0 Request processed in 49544us (49831us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996421.521655:0:14435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789996421.521973:0:15843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fa90a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d64f88b3-32d6-473c-b613-b936200ef7a3:15843:1876946942260480:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1789996421.521992:0:15843:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1789996421.521995:0:15843:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789996421.521997:0:15843:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789996421.521999:0:15843:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789996421.522000:0:15843:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789996421.522002:0:15843:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789996421.522003:0:15843:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789996421.522005:0:15843:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789996421.522006:0:15843:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789996421.522007:0:15843:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1789996421.522022:0:15843:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1789996421.526968:0:15843:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1789996421.527139:0:15843:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1789996421.527312:0:15843:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1789996421.527596:0:15843:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1789996421.527755:0:15843:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1789996421.528005:0:15843:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1789996421.529427:0:15843:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:0.0:1789996421.583069:0:15843:0:(ofd_obd.c:541:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1789996421.583080:0:15843:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1789996421.583124:0:15843:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1789996421.583443:0:15843:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.137@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1789996421.583514:0:15843:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1789996421.583582:0:15843:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:3.0:1789996422.191118:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789996422.952934:0:14438:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789996422.952941:0:14438:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8e087fbc4800 from 8 10000000:01000000:1.0:1789996422.952945:0:14438:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789996422.952990:0:14438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.137@tcp lock: ffff8e0876a23000/0x4173739f0fc819bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996422.953003:0:14438:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.137@tcp lock: ffff8e0876a23000/0x4173739f0fc819bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996422.953015:0:14438:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.137@tcp lock: ffff8e0876a23000/0x4173739f0fc819bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789996422.953119:0:14438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fc9a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d64f88b3-32d6-473c-b613-b936200ef7a3:14438:1876946942260864:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789996422.953250:0:14438:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996422.953646:0:14438:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0842b84540 going to sleep for 11 seconds 00000100:00100000:3.0:1789996422.960014:0:14436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942260864 00000100:00100000:3.0:1789996422.960058:0:14436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942260864 00000100:00100000:3.0:1789996422.960454:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789996422.960465:0:14433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0876b78850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d64f88b3-32d6-473c-b613-b936200ef7a3+18:14438:x1876946942260864:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789996422.960484:0:14433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789996422.960502:0:14433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e087f856a00/0x4173739f0fc819c3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4173739f0fc819bc expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996422.960533:0:14433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e087f856a00/0x4173739f0fc819c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4173739f0fc819bc expref: 19 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996422.960563:0:14433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e087f856a00/0x4173739f0fc819c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4173739f0fc819bc expref: 19 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996422.960573:0:14433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e087f856a00, rc 0) 00000100:00100000:3.0:1789996422.960653:0:14433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0876b78850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d64f88b3-32d6-473c-b613-b936200ef7a3+19:14438:x1876946942260864:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 190us (7402us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996422.960660:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789996422.960714:0:14438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fc9a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d64f88b3-32d6-473c-b613-b936200ef7a3:14438:1876946942260864:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789996422.960733:0:14438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.137@tcp lock: ffff8e0876a23000/0x4173739f0fc819bc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc819c3 expref: -99 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996422.960744:0:14438:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.137@tcp lock: ffff8e0876a23000/0x4173739f0fc819bc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4173739f0fc819c3 expref: -99 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789996422.961611:0:14438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fa90a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d64f88b3-32d6-473c-b613-b936200ef7a3:14438:1876946942260992:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1789996422.961671:0:14438:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789996422.961717:0:14438:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e07432d63c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789996422.961737:0:14436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942260992 00000100:00100000:3.0:1789996422.961752:0:14436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942260992 00000100:00100000:3.0:1789996422.962231:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789996422.962241:0:14433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0876b78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d64f88b3-32d6-473c-b613-b936200ef7a3+19:14438:x1876946942260992:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1789996422.962260:0:14433:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789996422.962276:0:14433:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789996422.962279:0:14433:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:3.0:1789996422.962370:0:14433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0876b78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d64f88b3-32d6-473c-b613-b936200ef7a3+19:14438:x1876946942260992:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 130us (699us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996422.962378:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789996422.962498:0:14438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fa90a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d64f88b3-32d6-473c-b613-b936200ef7a3:14438:1876946942260992:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1789996422.962590:0:14438:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.137@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789996422.962600:0:14438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.137@tcp lock: ffff8e0876a23000/0x4173739f0fc819bc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc819c3 expref: -99 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996422.962610:0:14438:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.137@tcp lock: ffff8e0876a23000/0x4173739f0fc819bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc819c3 expref: -99 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996423.211350:0:14430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789996423.276465:0:6715:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1789996423.276484:0:6715:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000100:00100000:3.0:1789996424.169403:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789996424.169427:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0741a28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876946942261120:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789996424.169497:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996424.169652:0:15127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942261120 00000100:00100000:0.0:1789996424.169662:0:15127:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942261120 00000100:00100000:0.0:1789996424.169719:0:15127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789996424.169728:0:15127:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fa90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876946942261120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789996424.169775:0:15127:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789996424.169831:0:15127:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fa90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876946942261120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996424.169852:0:15127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1789996424.169969:0:14437:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789996424.170008:0:3313:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1789996424.170029:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0741a28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876946942261120:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789996424.236010:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789996425.257703:0:14430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789996425.644762:0:14475:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789996426.282582:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789996426.733494:0:12638:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789996426.733501:0:12638:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789996426.733504:0:12638:0:(import.c:65:import_set_state_nolock()) ffff8e0848960000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789996426.733520:0:12638:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8e0848960000 using connection 192.168.204.137@tcp/0@lo 00000100:00100000:3.0:1789996426.733560:0:12638:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e086fa93100 x1876946942261504/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789996426.733646:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fa92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876946942261376:0@lo:400:kworker.0 00000100:00100000:3.0:1789996426.733727:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789996426.733797:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1789996426.733805:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fa91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d64f88b3-32d6-473c-b613-b936200ef7a3:3316:1876946942261248:0@lo:400:kworker.0 00000100:00100000:3.0:1789996426.733852:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789996426.733886:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fa90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3316:1876946942261888:0@lo:400:kworker.0 00000100:00100000:3.0:1789996426.733964:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789996426.733993:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fa91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876946942261632:0@lo:400:kworker.0 00000100:00100000:3.0:1789996426.734085:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789996426.734104:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789996426.734110:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fa90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1876946942261760:0@lo:400:kworker.0 00000100:00100000:3.0:1789996426.734133:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789996426.734384:0:14433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942261248 00000100:00100000:3.0:1789996426.734393:0:14433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942261248 00000100:00100000:3.0:1789996426.734446:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789996426.734458:0:14433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0876b7bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d64f88b3-32d6-473c-b613-b936200ef7a3+19:3316:x1876946942261248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789996426.734511:0:14433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0876b7bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d64f88b3-32d6-473c-b613-b936200ef7a3+19:3316:x1876946942261248:12345-0@lo:400:kworker.0 Request processed in 56us (658us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996426.734518:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789996426.734574:0:14441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942261888 00000100:00100000:3.0:1789996426.734578:0:14441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942261888 00000100:00100000:3.0:1789996426.734727:0:14441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942261632 00000100:00100000:3.0:1789996426.734732:0:14441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942261632 00000100:00100000:3.0:1789996426.734752:0:14441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942261760 00000100:00100000:3.0:1789996426.734754:0:14441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942261760 00000100:00100000:3.0:1789996426.734776:0:14441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789996426.734784:0:14441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fa91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1876946942261888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789996426.734820:0:14441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fa91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1876946942261888:12345-0@lo:400:kworker.0 Request processed in 38us (857us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996426.734827:0:14441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789996426.734840:0:14441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789996426.734855:0:14441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fa91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876946942261632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789996426.734899:0:14441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fa91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1876946942261632:12345-0@lo:400:kworker.0 Request processed in 45us (814us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996426.734906:0:14441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789996426.734918:0:14441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789996426.734925:0:14441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fa93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876946942261760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789996426.735139:0:14441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fa93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1876946942261760:12345-0@lo:400:kworker.0 Request processed in 213us (1003us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996426.735146:0:14441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789996426.735261:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fa91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d64f88b3-32d6-473c-b613-b936200ef7a3:3316:1876946942261248:0@lo:400:kworker.0 00010000:00080000:3.0:1789996426.735276:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e086fa90a80 x1876946942261888/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789996442 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789996426.735287:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fa90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3316:1876946942261888:0@lo:400:kworker.0 00000100:00080000:3.0:1789996426.735447:0:14437:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1789996426.735467:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e086fa90e00 x1876946942261760/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789996442 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789996426.735477:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fa90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3313:1876946942261760:0@lo:400:kworker.0 00010000:00080000:3.0:1789996426.735485:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e086fa91500 x1876946942261632/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789996442 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789996426.735493:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fa91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3313:1876946942261632:0@lo:400:kworker.0 00000100:00100000:1.0:1789996426.737367:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fa93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3312:1876946942261504:0@lo:8:kworker.0 00000100:00100000:1.0:1789996426.737432:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996426.737603:0:15124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942261376 00000100:00100000:2.0:1789996426.737612:0:15124:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942261376 00000100:00100000:2.0:1789996426.737658:0:15124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942261504 00000100:00100000:2.0:1789996426.737662:0:15124:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942261504 00000100:00100000:2.0:1789996426.737678:0:15124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789996426.737686:0:15124:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fa93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1876946942261376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789996426.737752:0:15124:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fa93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3316:x1876946942261376:12345-0@lo:400:kworker.0 Request processed in 66us (4025us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996426.737818:0:15124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789996426.737839:0:15124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789996426.737844:0:15124:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fc9bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3312:x1876946942261504:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1789996426.737870:0:15124:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 468 last 0 00000020:00000080:2.0:1789996426.737905:0:15124:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4173739f0fc819ca 00002000:00100000:2.0:1789996426.737918:0:15124:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8e087995e800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a3f ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1789996426.737922:0:15124:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1789996426.737924:0:15124:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1789996426.738573:0:15124:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789996426.738597:0:15124:0:(import.c:65:import_set_state_nolock()) ffff8e087995e000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789996426.738823:0:15124:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fc9bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3312:x1876946942261504:12345-0@lo:8:kworker.0 Request processed in 975us (1388us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996426.738831:0:15124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:2.0:1789996426.738852:0:14437:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789996426.738884:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fa92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876946942261376:0@lo:400:kworker.0 00010000:00080000:2.0:1789996426.738918:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e086fa93100 x1876946942261504/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789996451 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789996426.738931:0:3312:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1789996426.739514:0:3312:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1789996426.739520:0:3312:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1789996426.739523:0:3312:0:(import.c:65:import_set_state_nolock()) ffff8e0848960000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1789996426.739565:0:3312:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1789996426.739571:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fa93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3312:1876946942261504:0@lo:8:kworker.0 00000004:00080000:3.0:1789996426.740720:0:14465:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1789996426.741472:0:14465:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 468460927397ns, next at 0ns, rc = 0 00000004:00080000:1.0:1789996426.741698:0:14466:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x6:0x0] 00000100:00100000:1.0:1789996426.741740:0:14466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fc9a680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14466:1876946942262144:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1789996426.741806:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789996426.741817:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fc98a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876946942262016:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789996426.741863:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996426.741909:0:15127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942262016 00000100:00100000:1.0:1789996426.741916:0:15127:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942262016 00000100:00100000:1.0:1789996426.741970:0:15127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789996426.742002:0:15127:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fc9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3315:x1876946942262016:12345-0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1789996426.742063:0:14437:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:1.0:1789996426.742084:0:15127:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789996426.742138:0:15127:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fc9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3315:x1876946942262016:12345-0@lo:13:osp-pre-1-0.0 Request processed in 136us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996426.742147:0:15127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1789996426.742187:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e086fc98a80 x1876946942262016/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789996442 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789996426.742207:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fc98a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876946942262016:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789996426.742245:0:14466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996426.742269:0:14466:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0741b00540 going to sleep for 11 seconds 00000100:00100000:3.0:1789996426.742430:0:15125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942262144 00000100:00100000:3.0:1789996426.742441:0:15125:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942262144 00000100:00100000:3.0:1789996426.742483:0:15125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789996426.742491:0:15125:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fc98a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14466:x1876946942262144:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1789996426.746647:0:15125:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:3.0:1789996426.746659:0:15125:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:3.0:1789996426.746664:0:15125:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:7 to 0x280000400:33) 00002000:00010000:3.0:1789996426.755339:0:15125:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789996426.755351:0:15125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c5af67dd/0x4173739f0fc819d1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996426.755367:0:15125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=468s v=(0 0) 00010000:00010000:3.0:1789996426.755372:0:15125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789996426.755379:0:15125:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c5af67dd/0x4173739f0fc819d1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996426.755398:0:15125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c5af67dd/0x4173739f0fc819d1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996426.755410:0:15125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c5af67dd/0x4173739f0fc819d1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996426.755417:0:15125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c5af67dd/0x4173739f0fc819d1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996426.755443:0:15125:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789996426.755751:0:14430:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789996426.755761:0:14430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c5af67dd/0x4173739f0fc819d1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996426.755772:0:14430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e087f857800 already unused, calling callback (ffffffffc1595910) 00010000:00010000:2.0:1789996426.755777:0:14430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c5af67dd/0x4173739f0fc819d1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996426.755800:0:14430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c5af67dd/0x4173739f0fc819d1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996426.755821:0:14430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c5af67dd/0x4173739f0fc819d1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996426.755829:0:14430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c5af67dd/0x4173739f0fc819d1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996426.755849:0:14430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789996426.755851:0:14430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789996426.755854:0:14430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789996426.756196:0:15125:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789996426.756203:0:15125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005795b565/0x4173739f0fc819d8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996426.756218:0:15125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=468s v=(0 0) 00010000:00010000:3.0:1789996426.756222:0:15125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789996426.756228:0:15125:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005795b565/0x4173739f0fc819d8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996426.756239:0:15125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005795b565/0x4173739f0fc819d8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996426.756247:0:15125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005795b565/0x4173739f0fc819d8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996426.756255:0:15125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005795b565/0x4173739f0fc819d8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996426.756370:0:15125:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789996426.757207:0:15125:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789996426.757214:0:15125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008ee5a869/0x4173739f0fc819df lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996426.757224:0:15125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=468s v=(0 0) 00010000:00010000:3.0:1789996426.757228:0:15125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789996426.757232:0:15125:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008ee5a869/0x4173739f0fc819df lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996426.757243:0:15125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008ee5a869/0x4173739f0fc819df lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996426.757263:0:15125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008ee5a869/0x4173739f0fc819df lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996426.757270:0:15125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008ee5a869/0x4173739f0fc819df lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996426.760689:0:14429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789996426.760705:0:14429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005795b565/0x4173739f0fc819d8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996426.760734:0:14429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e087f856200 already unused, calling callback (ffffffffc1595910) 00010000:00010000:2.0:1789996426.760739:0:14429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005795b565/0x4173739f0fc819d8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996426.760749:0:14429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005795b565/0x4173739f0fc819d8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996426.760771:0:14429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005795b565/0x4173739f0fc819d8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996426.760797:0:14429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005795b565/0x4173739f0fc819d8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996426.760820:0:14429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789996426.760824:0:14429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008ee5a869/0x4173739f0fc819df lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996426.760831:0:14429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e087f856c00 already unused, calling callback (ffffffffc1595910) 00010000:00010000:2.0:1789996426.760835:0:14429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008ee5a869/0x4173739f0fc819df lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996426.760843:0:14429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008ee5a869/0x4173739f0fc819df lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996426.760854:0:14429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008ee5a869/0x4173739f0fc819df lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996426.760861:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789996426.760863:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789996426.760865:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789996426.761082:0:14430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789996426.761092:0:15125:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789996426.761101:0:15125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008ee5a869/0x4173739f0fc819df lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789996426.762464:0:15125:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789996426.762475:0:15125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004df7f958/0x4173739f0fc819e6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996426.762489:0:15125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=468s v=(0 0) 00010000:00010000:2.0:1789996426.762499:0:15125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789996426.762506:0:15125:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004df7f958/0x4173739f0fc819e6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996426.762521:0:15125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004df7f958/0x4173739f0fc819e6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996426.762532:0:15125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004df7f958/0x4173739f0fc819e6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996426.762540:0:15125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004df7f958/0x4173739f0fc819e6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996426.763025:0:15125:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789996426.763039:0:14429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789996426.763046:0:14429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004df7f958/0x4173739f0fc819e6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996426.763055:0:14429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e08429c6a00 already unused, calling callback (ffffffffc1595910) 00010000:00010000:2.0:1789996426.763059:0:14429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004df7f958/0x4173739f0fc819e6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996426.763080:0:14429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004df7f958/0x4173739f0fc819e6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996426.763096:0:14429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004df7f958/0x4173739f0fc819e6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996426.763116:0:14429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004df7f958/0x4173739f0fc819e6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996426.763138:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789996426.763140:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789996426.763142:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789996426.764391:0:15125:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789996426.764401:0:15125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000648b98b3/0x4173739f0fc819ed lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996426.764414:0:15125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=468s v=(0 0) 00010000:00010000:2.0:1789996426.764419:0:15125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789996426.764425:0:15125:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000648b98b3/0x4173739f0fc819ed lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996426.764438:0:15125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000648b98b3/0x4173739f0fc819ed lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996426.764448:0:15125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000648b98b3/0x4173739f0fc819ed lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996426.764456:0:15125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000648b98b3/0x4173739f0fc819ed lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996426.764475:0:15125:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789996426.764885:0:14430:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789996426.764895:0:14430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000648b98b3/0x4173739f0fc819ed lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996426.764907:0:14430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e08429c6c00 already unused, calling callback (ffffffffc1595910) 00010000:00010000:1.0:1789996426.764912:0:14430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000648b98b3/0x4173739f0fc819ed lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996426.764923:0:14430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000648b98b3/0x4173739f0fc819ed lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996426.764945:0:14430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000648b98b3/0x4173739f0fc819ed lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996426.764953:0:14430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000648b98b3/0x4173739f0fc819ed lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789996426.764973:0:15125:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789996426.764983:0:14430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789996426.764986:0:14430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789996426.764988:0:15125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005d6f0066/0x4173739f0fc819f4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996426.764988:0:14430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789996426.764999:0:15125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=468s v=(0 0) 00010000:00010000:2.0:1789996426.765003:0:15125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789996426.765008:0:15125:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005d6f0066/0x4173739f0fc819f4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996426.765019:0:15125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005d6f0066/0x4173739f0fc819f4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996426.765029:0:15125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005d6f0066/0x4173739f0fc819f4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996426.765035:0:15125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005d6f0066/0x4173739f0fc819f4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996426.765051:0:15125:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789996426.765062:0:14429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789996426.765067:0:14429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005d6f0066/0x4173739f0fc819f4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996426.765075:0:14429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e08429c6e00 already unused, calling callback (ffffffffc1595910) 00010000:00010000:2.0:1789996426.765079:0:14429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005d6f0066/0x4173739f0fc819f4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996426.765086:0:14429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005d6f0066/0x4173739f0fc819f4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996426.765106:0:14429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005d6f0066/0x4173739f0fc819f4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996426.765112:0:14429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005d6f0066/0x4173739f0fc819f4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996426.765128:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789996426.765130:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789996426.765133:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789996426.766023:0:15125:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789996426.766031:0:15125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000057448660/0x4173739f0fc819fb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996426.766043:0:15125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=468s v=(0 0) 00010000:00010000:2.0:1789996426.766046:0:15125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789996426.766052:0:15125:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000057448660/0x4173739f0fc819fb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996426.766062:0:15125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000057448660/0x4173739f0fc819fb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996426.766071:0:15125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000057448660/0x4173739f0fc819fb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996426.766080:0:15125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000057448660/0x4173739f0fc819fb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996426.766106:0:15125:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789996426.766640:0:14430:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789996426.766649:0:14430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000057448660/0x4173739f0fc819fb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996426.766660:0:14430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e08429c6000 already unused, calling callback (ffffffffc1595910) 00010000:00010000:1.0:1789996426.766664:0:14430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000057448660/0x4173739f0fc819fb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996426.766674:0:14430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000057448660/0x4173739f0fc819fb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789996426.766689:0:15125:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789996426.766691:0:14430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000057448660/0x4173739f0fc819fb lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996426.766697:0:15125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005f608171/0x4173739f0fc81a02 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996426.766703:0:14430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000057448660/0x4173739f0fc819fb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996426.766735:0:14430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789996426.766737:0:14430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789996426.766739:0:14430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789996426.767323:0:15125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=468s v=(0 0) 00010000:00010000:2.0:1789996426.767328:0:15125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789996426.767334:0:15125:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005f608171/0x4173739f0fc81a02 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996426.767346:0:15125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005f608171/0x4173739f0fc81a02 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996426.767356:0:15125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005f608171/0x4173739f0fc81a02 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996426.767783:0:15125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005f608171/0x4173739f0fc81a02 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996426.767817:0:15125:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789996426.767843:0:14429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789996426.767850:0:14429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005f608171/0x4173739f0fc81a02 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996426.767874:0:14429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e08429c6200 already unused, calling callback (ffffffffc1595910) 00010000:00010000:1.0:1789996426.767879:0:14429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005f608171/0x4173739f0fc81a02 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996426.767887:0:14429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005f608171/0x4173739f0fc81a02 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996426.767903:0:14429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005f608171/0x4173739f0fc81a02 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996426.767911:0:14429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005f608171/0x4173739f0fc81a02 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996426.767935:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789996426.767938:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789996426.767940:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789996426.768363:0:15125:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789996426.768370:0:15125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d3f2e53c/0x4173739f0fc81a09 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996426.768828:0:15125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=468s v=(0 0) 00010000:00010000:2.0:1789996426.768839:0:15125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789996426.768845:0:15125:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d3f2e53c/0x4173739f0fc81a09 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996426.768859:0:15125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d3f2e53c/0x4173739f0fc81a09 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996426.768867:0:15125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d3f2e53c/0x4173739f0fc81a09 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996426.768874:0:15125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d3f2e53c/0x4173739f0fc81a09 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996426.768890:0:15125:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789996426.769780:0:15125:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789996426.769787:0:15125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000048efa3e4/0x4173739f0fc81a10 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996426.769798:0:15125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=468s v=(0 0) 00010000:00010000:2.0:1789996426.769801:0:15125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789996426.769805:0:15125:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000048efa3e4/0x4173739f0fc81a10 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996426.769815:0:15125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000048efa3e4/0x4173739f0fc81a10 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996426.769822:0:15125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000048efa3e4/0x4173739f0fc81a10 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996426.769835:0:15125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000048efa3e4/0x4173739f0fc81a10 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996426.769852:0:15125:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1789996426.770182:0:14430:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789996426.770192:0:14430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d3f2e53c/0x4173739f0fc81a09 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996426.770202:0:14430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e08429c7c00 already unused, calling callback (ffffffffc1595910) 00010000:00010000:1.0:1789996426.770206:0:14430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d3f2e53c/0x4173739f0fc81a09 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996426.770216:0:14430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d3f2e53c/0x4173739f0fc81a09 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996426.770241:0:14430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d3f2e53c/0x4173739f0fc81a09 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996426.770248:0:14430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d3f2e53c/0x4173739f0fc81a09 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996426.770270:0:14430:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789996426.770274:0:14430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000048efa3e4/0x4173739f0fc81a10 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996426.770281:0:14430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e08429c7e00 already unused, calling callback (ffffffffc1595910) 00010000:00010000:1.0:1789996426.770285:0:14430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000048efa3e4/0x4173739f0fc81a10 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996426.770293:0:14430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000048efa3e4/0x4173739f0fc81a10 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996426.770304:0:14430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000048efa3e4/0x4173739f0fc81a10 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996426.770311:0:14430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000048efa3e4/0x4173739f0fc81a10 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996426.770335:0:14430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789996426.770337:0:14430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789996426.770345:0:14430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789996426.770352:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789996426.772267:0:15125:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789996426.772277:0:15125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000093f780be/0x4173739f0fc81a17 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996426.772525:0:15125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=468s v=(0 0) 00010000:00010000:2.0:1789996426.772530:0:15125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789996426.772536:0:15125:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000093f780be/0x4173739f0fc81a17 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996426.772573:0:15125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000093f780be/0x4173739f0fc81a17 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996426.772584:0:15125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000093f780be/0x4173739f0fc81a17 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996426.772592:0:15125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000093f780be/0x4173739f0fc81a17 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996426.772613:0:15125:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789996426.772652:0:14430:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789996426.772660:0:14430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000093f780be/0x4173739f0fc81a17 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996426.772670:0:14430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0741a5ba00 already unused, calling callback (ffffffffc1595910) 00010000:00010000:1.0:1789996426.772675:0:14430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000093f780be/0x4173739f0fc81a17 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996426.772685:0:14430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000093f780be/0x4173739f0fc81a17 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996426.772703:0:14430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000093f780be/0x4173739f0fc81a17 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996426.772723:0:14430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000093f780be/0x4173739f0fc81a17 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996426.772742:0:14430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789996426.772744:0:14430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789996426.772746:0:14430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789996426.775272:0:15125:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789996426.775288:0:15125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d2a6e253/0x4173739f0fc81a1e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996426.775312:0:15125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=468s v=(0 0) 00010000:00010000:2.0:1789996426.775317:0:15125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789996426.775324:0:15125:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d2a6e253/0x4173739f0fc81a1e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996426.775339:0:15125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d2a6e253/0x4173739f0fc81a1e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996426.775348:0:15125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d2a6e253/0x4173739f0fc81a1e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996426.775356:0:15125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d2a6e253/0x4173739f0fc81a1e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996426.775386:0:15125:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789996426.776556:0:14429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00002000:00010000:2.0:1789996426.776632:0:15125:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789996426.776641:0:15125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e0f3dd2a/0x4173739f0fc81a25 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996426.776654:0:15125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=468s v=(0 0) 00010000:00010000:1.0:1789996426.776656:0:14429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d2a6e253/0x4173739f0fc81a1e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996426.776660:0:15125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789996426.776675:0:14429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0741a5a400 already unused, calling callback (ffffffffc1595910) 00010000:00010000:1.0:1789996426.776681:0:14429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d2a6e253/0x4173739f0fc81a1e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996426.776699:0:14429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d2a6e253/0x4173739f0fc81a1e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996426.776730:0:14429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d2a6e253/0x4173739f0fc81a1e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996426.776739:0:14429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d2a6e253/0x4173739f0fc81a1e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996426.776746:0:15125:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e0f3dd2a/0x4173739f0fc81a25 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996426.776761:0:15125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e0f3dd2a/0x4173739f0fc81a25 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996426.776762:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789996426.776766:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789996426.776769:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789996426.776786:0:15125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e0f3dd2a/0x4173739f0fc81a25 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996426.776794:0:15125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e0f3dd2a/0x4173739f0fc81a25 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996426.776814:0:15125:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789996426.776822:0:14430:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789996426.776829:0:14430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e0f3dd2a/0x4173739f0fc81a25 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996426.776838:0:14430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0741a5b400 already unused, calling callback (ffffffffc1595910) 00010000:00010000:1.0:1789996426.776842:0:14430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e0f3dd2a/0x4173739f0fc81a25 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996426.776852:0:14430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e0f3dd2a/0x4173739f0fc81a25 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996426.776865:0:14430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e0f3dd2a/0x4173739f0fc81a25 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996426.776885:0:14430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e0f3dd2a/0x4173739f0fc81a25 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996426.776903:0:14430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789996426.776905:0:14430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789996426.776907:0:14430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789996426.778092:0:15125:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789996426.778102:0:15125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e07d6079/0x4173739f0fc81a2c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996426.778116:0:15125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=468s v=(0 0) 00010000:00010000:2.0:1789996426.778120:0:15125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789996426.778125:0:15125:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e07d6079/0x4173739f0fc81a2c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996426.778138:0:15125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e07d6079/0x4173739f0fc81a2c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996426.778148:0:15125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e07d6079/0x4173739f0fc81a2c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996426.778155:0:15125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e07d6079/0x4173739f0fc81a2c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996426.778193:0:15125:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789996426.778734:0:14429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789996426.778743:0:14429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e07d6079/0x4173739f0fc81a2c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996426.778754:0:14429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0741a5b800 already unused, calling callback (ffffffffc1595910) 00010000:00010000:3.0:1789996426.778758:0:14429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e07d6079/0x4173739f0fc81a2c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996426.778768:0:14429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e07d6079/0x4173739f0fc81a2c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996426.778786:0:14429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e07d6079/0x4173739f0fc81a2c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996426.778794:0:14429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e07d6079/0x4173739f0fc81a2c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996426.778825:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789996426.778828:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789996426.778831:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789996426.779146:0:15125:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789996426.779154:0:15125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000d0dd002/0x4173739f0fc81a33 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996426.779165:0:15125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=468s v=(0 0) 00010000:00010000:2.0:1789996426.779169:0:15125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789996426.779174:0:15125:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000d0dd002/0x4173739f0fc81a33 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996426.779183:0:15125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000d0dd002/0x4173739f0fc81a33 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996426.779191:0:15125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000d0dd002/0x4173739f0fc81a33 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996426.779197:0:15125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000d0dd002/0x4173739f0fc81a33 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996426.779212:0:15125:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789996426.781361:0:15125:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789996426.781387:0:15125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002a97aed8/0x4173739f0fc81a3a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996426.781406:0:14430:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789996426.781411:0:15125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=468s v=(0 0) 00010000:00010000:1.0:1789996426.781416:0:14430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000d0dd002/0x4173739f0fc81a33 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996426.781429:0:15125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789996426.781431:0:14430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0741a5a600 already unused, calling callback (ffffffffc1595910) 00010000:00010000:1.0:1789996426.781437:0:14430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000d0dd002/0x4173739f0fc81a33 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996426.781439:0:15125:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002a97aed8/0x4173739f0fc81a3a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996426.781457:0:14430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000d0dd002/0x4173739f0fc81a33 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996426.781464:0:15125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002a97aed8/0x4173739f0fc81a3a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996426.781475:0:15125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002a97aed8/0x4173739f0fc81a3a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996426.781478:0:14430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000d0dd002/0x4173739f0fc81a33 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996426.781491:0:15125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002a97aed8/0x4173739f0fc81a3a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996426.781494:0:14430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000d0dd002/0x4173739f0fc81a33 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996426.781517:0:15125:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789996426.781525:0:14430:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789996426.781530:0:14430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002a97aed8/0x4173739f0fc81a3a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996426.781562:0:14430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0741a5bc00 already unused, calling callback (ffffffffc1595910) 00010000:00010000:1.0:1789996426.781652:0:14430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002a97aed8/0x4173739f0fc81a3a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996426.781660:0:14430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002a97aed8/0x4173739f0fc81a3a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996426.781672:0:14430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002a97aed8/0x4173739f0fc81a3a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996426.781679:0:14430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002a97aed8/0x4173739f0fc81a3a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996426.781696:0:14430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789996426.781699:0:14430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789996426.781701:0:14430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789996426.781923:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789996426.782091:0:15125:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789996426.782097:0:15125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008b792b14/0x4173739f0fc81a41 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996426.782107:0:15125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=468s v=(0 0) 00010000:00010000:2.0:1789996426.782110:0:15125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789996426.782116:0:15125:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008b792b14/0x4173739f0fc81a41 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996426.782126:0:15125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008b792b14/0x4173739f0fc81a41 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996426.782134:0:15125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008b792b14/0x4173739f0fc81a41 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996426.782148:0:15125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008b792b14/0x4173739f0fc81a41 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996426.782168:0:15125:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789996426.782175:0:14430:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789996426.782181:0:14430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008b792b14/0x4173739f0fc81a41 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996426.782189:0:14430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0741a5a200 already unused, calling callback (ffffffffc1595910) 00010000:00010000:1.0:1789996426.782192:0:14430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008b792b14/0x4173739f0fc81a41 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996426.782201:0:14430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008b792b14/0x4173739f0fc81a41 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996426.782220:0:14430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008b792b14/0x4173739f0fc81a41 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996426.782227:0:14430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008b792b14/0x4173739f0fc81a41 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996426.782244:0:14430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789996426.782248:0:14430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789996426.782251:0:14430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789996426.782745:0:15125:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789996426.782752:0:15125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002b66da5e/0x4173739f0fc81a48 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996426.782761:0:15125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=468s v=(0 0) 00010000:00010000:2.0:1789996426.782764:0:15125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789996426.782768:0:15125:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002b66da5e/0x4173739f0fc81a48 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996426.782778:0:15125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002b66da5e/0x4173739f0fc81a48 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996426.782786:0:15125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002b66da5e/0x4173739f0fc81a48 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996426.782793:0:15125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002b66da5e/0x4173739f0fc81a48 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996426.782808:0:15125:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789996426.783333:0:15125:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789996426.783340:0:15125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e80b4a47/0x4173739f0fc81a4f lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996426.783356:0:15125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=468s v=(0 0) 00010000:00010000:2.0:1789996426.783359:0:15125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789996426.783364:0:15125:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e80b4a47/0x4173739f0fc81a4f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996426.783374:0:15125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e80b4a47/0x4173739f0fc81a4f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996426.783383:0:15125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e80b4a47/0x4173739f0fc81a4f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996426.783391:0:15125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e80b4a47/0x4173739f0fc81a4f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996426.783406:0:15125:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1789996426.783430:0:14430:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789996426.783438:0:14430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002b66da5e/0x4173739f0fc81a48 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996426.783446:0:14430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0741a5be00 already unused, calling callback (ffffffffc1595910) 00010000:00010000:1.0:1789996426.783450:0:14430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002b66da5e/0x4173739f0fc81a48 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996426.783460:0:14430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002b66da5e/0x4173739f0fc81a48 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996426.783476:0:14430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002b66da5e/0x4173739f0fc81a48 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996426.783484:0:14430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002b66da5e/0x4173739f0fc81a48 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996426.783519:0:14430:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789996426.783523:0:14430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e80b4a47/0x4173739f0fc81a4f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996426.783531:0:14430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0741a5ae00 already unused, calling callback (ffffffffc1595910) 00010000:00010000:1.0:1789996426.783535:0:14430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e80b4a47/0x4173739f0fc81a4f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996426.783561:0:14430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e80b4a47/0x4173739f0fc81a4f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996426.783573:0:14430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e80b4a47/0x4173739f0fc81a4f lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996426.783581:0:14430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e80b4a47/0x4173739f0fc81a4f lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996426.783597:0:14430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789996426.783600:0:14430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789996426.783603:0:14430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789996426.783824:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789996426.786289:0:15125:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789996426.786300:0:15125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f7854922/0x4173739f0fc81a56 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996426.786314:0:15125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=468s v=(0 0) 00010000:00010000:2.0:1789996426.786318:0:15125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789996426.786324:0:15125:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f7854922/0x4173739f0fc81a56 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996426.786339:0:15125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f7854922/0x4173739f0fc81a56 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996426.786362:0:15125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f7854922/0x4173739f0fc81a56 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996426.787026:0:15125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f7854922/0x4173739f0fc81a56 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996426.787046:0:15125:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789996426.787657:0:15125:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789996426.787664:0:15125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000073094f38/0x4173739f0fc81a5d lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996426.787692:0:15125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=468s v=(0 0) 00010000:00010000:2.0:1789996426.787697:0:15125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789996426.787703:0:15125:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000073094f38/0x4173739f0fc81a5d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996426.787726:0:15125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000073094f38/0x4173739f0fc81a5d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996426.787736:0:15125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000073094f38/0x4173739f0fc81a5d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996426.787743:0:15125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000073094f38/0x4173739f0fc81a5d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996426.787778:0:15125:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1789996426.788039:0:14429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789996426.788049:0:14429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f7854922/0x4173739f0fc81a56 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996426.788060:0:14429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0741a5a800 already unused, calling callback (ffffffffc1595910) 00010000:00010000:3.0:1789996426.788066:0:14429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f7854922/0x4173739f0fc81a56 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996426.788076:0:14429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f7854922/0x4173739f0fc81a56 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996426.788095:0:14429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f7854922/0x4173739f0fc81a56 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996426.788104:0:14429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f7854922/0x4173739f0fc81a56 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996426.788125:0:14429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789996426.788130:0:14429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000073094f38/0x4173739f0fc81a5d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996426.788149:0:14429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0741a5a000 already unused, calling callback (ffffffffc1595910) 00010000:00010000:3.0:1789996426.788152:0:14429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000073094f38/0x4173739f0fc81a5d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996426.788160:0:14429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000073094f38/0x4173739f0fc81a5d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996426.788172:0:14429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000073094f38/0x4173739f0fc81a5d lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996426.788179:0:14429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000073094f38/0x4173739f0fc81a5d lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996426.788197:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789996426.788199:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789996426.788201:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789996426.788233:0:15125:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789996426.788239:0:15125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000d09b582/0x4173739f0fc81a64 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996426.788247:0:15125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=468s v=(0 0) 00010000:00010000:2.0:1789996426.788251:0:15125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789996426.788255:0:15125:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000d09b582/0x4173739f0fc81a64 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996426.788265:0:15125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000d09b582/0x4173739f0fc81a64 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996426.788273:0:15125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000d09b582/0x4173739f0fc81a64 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996426.788276:0:14430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789996426.788282:0:15125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000d09b582/0x4173739f0fc81a64 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996426.788311:0:15125:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789996426.788742:0:15125:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789996426.788748:0:15125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001bd7ca57/0x4173739f0fc81a6b lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996426.788756:0:15125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=468s v=(0 0) 00010000:00010000:2.0:1789996426.788764:0:15125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789996426.788768:0:15125:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001bd7ca57/0x4173739f0fc81a6b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996426.788778:0:15125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001bd7ca57/0x4173739f0fc81a6b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996426.788787:0:15125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001bd7ca57/0x4173739f0fc81a6b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996426.788793:0:15125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001bd7ca57/0x4173739f0fc81a6b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996426.788807:0:15125:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1789996426.789356:0:14429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789996426.789364:0:14429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000d09b582/0x4173739f0fc81a64 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996426.789374:0:14429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0741a5ac00 already unused, calling callback (ffffffffc1595910) 00010000:00010000:3.0:1789996426.789378:0:14429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000d09b582/0x4173739f0fc81a64 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996426.789388:0:14429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000d09b582/0x4173739f0fc81a64 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996426.789414:0:14429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000d09b582/0x4173739f0fc81a64 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996426.789422:0:14429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000d09b582/0x4173739f0fc81a64 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996426.789442:0:14429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789996426.789446:0:14429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001bd7ca57/0x4173739f0fc81a6b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996426.789535:0:14429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0741a5aa00 already unused, calling callback (ffffffffc1595910) 00010000:00010000:3.0:1789996426.789539:0:14429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001bd7ca57/0x4173739f0fc81a6b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996426.789564:0:14429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001bd7ca57/0x4173739f0fc81a6b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996426.789576:0:14429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001bd7ca57/0x4173739f0fc81a6b lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996426.789584:0:14429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001bd7ca57/0x4173739f0fc81a6b lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996426.789666:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789996426.789668:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789996426.789676:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789996426.789973:0:15125:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789996426.789980:0:15125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000005916618/0x4173739f0fc81a72 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996426.789990:0:15125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=468s v=(0 0) 00010000:00010000:2.0:1789996426.789994:0:15125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789996426.789998:0:15125:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000005916618/0x4173739f0fc81a72 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996426.790009:0:15125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000005916618/0x4173739f0fc81a72 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996426.790017:0:15125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000005916618/0x4173739f0fc81a72 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996426.790031:0:15125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000005916618/0x4173739f0fc81a72 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996426.790055:0:15125:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789996426.790334:0:14430:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789996426.790342:0:14430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000005916618/0x4173739f0fc81a72 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996426.790351:0:14430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0741a5b600 already unused, calling callback (ffffffffc1595910) 00010000:00010000:1.0:1789996426.790361:0:14430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000005916618/0x4173739f0fc81a72 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996426.790370:0:14430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000005916618/0x4173739f0fc81a72 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996426.790385:0:14430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000005916618/0x4173739f0fc81a72 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996426.790392:0:14430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000005916618/0x4173739f0fc81a72 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996426.790848:0:14430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789996426.790852:0:14430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789996426.790855:0:14430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789996426.790883:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789996426.791158:0:15125:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789996426.791166:0:15125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a27c179e/0x4173739f0fc81a79 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996426.791176:0:15125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=468s v=(0 0) 00010000:00010000:2.0:1789996426.791179:0:15125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789996426.791184:0:15125:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a27c179e/0x4173739f0fc81a79 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996426.791196:0:15125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a27c179e/0x4173739f0fc81a79 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996426.791205:0:15125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a27c179e/0x4173739f0fc81a79 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996426.791212:0:15125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a27c179e/0x4173739f0fc81a79 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996426.791236:0:15125:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789996426.791400:0:14430:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789996426.791406:0:14430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a27c179e/0x4173739f0fc81a79 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996426.791424:0:14430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0741a5b200 already unused, calling callback (ffffffffc1595910) 00010000:00010000:1.0:1789996426.791428:0:14430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a27c179e/0x4173739f0fc81a79 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996426.791438:0:14430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a27c179e/0x4173739f0fc81a79 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996426.791451:0:14430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a27c179e/0x4173739f0fc81a79 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996426.791465:0:14430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a27c179e/0x4173739f0fc81a79 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996426.791480:0:14430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789996426.791481:0:14430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789996426.791483:0:14430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789996426.791977:0:15125:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789996426.791984:0:15125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c381e11b/0x4173739f0fc81a80 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996426.791998:0:15125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=468s v=(0 0) 00010000:00010000:2.0:1789996426.792002:0:15125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789996426.792007:0:15125:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c381e11b/0x4173739f0fc81a80 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996426.792017:0:15125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c381e11b/0x4173739f0fc81a80 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996426.792025:0:15125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c381e11b/0x4173739f0fc81a80 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996426.792032:0:15125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c381e11b/0x4173739f0fc81a80 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996426.792053:0:15125:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789996426.792391:0:14429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789996426.792398:0:14429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c381e11b/0x4173739f0fc81a80 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996426.792408:0:14429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0741a5b000 already unused, calling callback (ffffffffc1595910) 00010000:00010000:3.0:1789996426.792421:0:14429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c381e11b/0x4173739f0fc81a80 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996426.792430:0:14429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c381e11b/0x4173739f0fc81a80 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996426.792444:0:14429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c381e11b/0x4173739f0fc81a80 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996426.792452:0:14429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c381e11b/0x4173739f0fc81a80 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996426.792467:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789996426.792468:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789996426.792470:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789996426.793042:0:15125:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789996426.793048:0:15125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e07d6079/0x4173739f0fc81a87 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996426.793058:0:15125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=468s v=(0 0) 00010000:00010000:2.0:1789996426.793061:0:15125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789996426.793066:0:15125:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e07d6079/0x4173739f0fc81a87 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996426.793074:0:15125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e07d6079/0x4173739f0fc81a87 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996426.793093:0:15125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e07d6079/0x4173739f0fc81a87 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996426.793101:0:15125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e07d6079/0x4173739f0fc81a87 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996426.793116:0:15125:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:2.0:1789996426.793317:0:15125:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:6 00000100:00100000:2.0:1789996426.793506:0:15125:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fc98a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14466:x1876946942262144:12345-0@lo:5:osp-pre-1-0.0 Request processed in 51012us (51256us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996426.793517:0:15125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789996426.793590:0:14466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fc9a680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14466:1876946942262144:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1789996426.793604:0:14466:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x6:0x0] 00000100:00100000:2.0:1789996426.793647:0:14466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086faec000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14466:1876946942262272:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1789996426.793766:0:14466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996426.793807:0:14466:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e084a7f1300 going to sleep for 11 seconds 00000100:00100000:2.0:1789996426.793827:0:15126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942262272 00000100:00100000:2.0:1789996426.793834:0:15126:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942262272 00000100:00100000:2.0:1789996426.793873:0:15126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789996426.793882:0:15126:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086faece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14466:x1876946942262272:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1789996426.793919:0:15126:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00010000:00010000:1.0:1789996426.795863:0:14430:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789996426.795875:0:14430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e07d6079/0x4173739f0fc81a87 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996426.795892:0:14430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0741a5b800 already unused, calling callback (ffffffffc1595910) 00010000:00010000:1.0:1789996426.795898:0:14430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e07d6079/0x4173739f0fc81a87 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996426.795911:0:14430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e07d6079/0x4173739f0fc81a87 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996426.795932:0:14430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e07d6079/0x4173739f0fc81a87 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996426.795942:0:14430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e07d6079/0x4173739f0fc81a87 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996426.795967:0:14430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789996426.795970:0:14430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789996426.795973:0:14430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789996426.802390:0:15126:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086faece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:14466:x1876946942262272:12345-0@lo:5:osp-pre-1-0.0 Request processed in 8499us (8614us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1789996426.802421:0:15126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789996426.802592:0:14466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086faec000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14466:1876946942262272:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1789996426.802612:0:14466:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000004:00080000:1.0:1789996426.810570:0:5868:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000001:02000400:1.0:1789996427.069318:0:16204:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg437-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1789996427.305652:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789996428.332624:0:14430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789996428.798877:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996428.799068:0:14435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927590144 00000100:00100000:0.0:1789996428.799084:0:14435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927590144 00000100:00100000:0.0:1789996428.799146:0:14435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 74 00000100:00100000:0.0:1789996428.799156:0:14435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0876b79c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2361:x1876946927590144:12345-192.168.204.37@tcp:250:mount.lustre.0 00010000:00080000:0.0:1789996428.799191:0:14435:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 50790d52-45a2-4d53-a399-c22b3a6afc1a@192.168.204.37@tcp t0 exp 0000000000000000 cur 470 last 0 00000020:00000080:0.0:1789996428.799223:0:14435:0:(genops.c:1384:class_connect()) connect: client 50790d52-45a2-4d53-a399-c22b3a6afc1a, cookie 0x4173739f0fc81a8e 00000100:00080000:0.0:1789996428.799373:0:14435:0:(import.c:65:import_set_state_nolock()) ffff8e0742d1b800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789996428.799710:0:14435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0876b79c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50790d52-45a2-4d53-a399-c22b3a6afc1a+5:2361:x1876946927590144:12345-192.168.204.37@tcp:250:mount.lustre.0 Request processed in 552us (841us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996428.799719:0:14435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 74 00000100:00100000:1.0:1789996428.803782:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1789996428.803844:0:14436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927590272 00000100:00100000:3.0:1789996428.803854:0:14436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927590272 00000100:00100000:3.0:1789996428.803932:0:14436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 75 00000100:00100000:3.0:1789996428.803944:0:14436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0876b79050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50790d52-45a2-4d53-a399-c22b3a6afc1a+5:13734:x1876946927590272:12345-192.168.204.37@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789996428.803961:0:14436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789996428.803981:0:14436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e087f856c00/0x4173739f0fc81a95 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b97003095e3589d expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996428.804011:0:14436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e087f856c00/0x4173739f0fc81a95 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e3589d expref: 6 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996428.804023:0:14436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e087f856c00/0x4173739f0fc81a95 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e3589d expref: 6 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996428.804032:0:14436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e087f856c00, rc 0) 00000100:00100000:3.0:1789996428.804098:0:14436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0876b79050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50790d52-45a2-4d53-a399-c22b3a6afc1a+6:13734:x1876946927590272:12345-192.168.204.37@tcp:101:mount.lustre.0 Request processed in 156us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996428.804105:0:14436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 75 00000100:00100000:1.0:1789996428.807343:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1789996428.807469:0:14433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927590400 00000100:00100000:3.0:1789996428.807482:0:14433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927590400 00000100:00100000:3.0:1789996428.807809:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 76 00000100:00100000:3.0:1789996428.807821:0:14433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0876b7ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50790d52-45a2-4d53-a399-c22b3a6afc1a+6:13734:x1876946927590400:12345-192.168.204.37@tcp:501:mount.lustre.0 00000100:00100000:3.0:1789996428.808349:0:14433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0876b7ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50790d52-45a2-4d53-a399-c22b3a6afc1a+6:13734:x1876946927590400:12345-192.168.204.37@tcp:501:mount.lustre.0 Request processed in 529us (1020us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789996428.808359:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 76 00000100:00100000:1.0:1789996428.814488:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996428.815168:0:14435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927590528 00000100:00100000:0.0:1789996428.815180:0:14435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927590528 00000100:00100000:0.0:1789996428.815240:0:14435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 77 00000100:00100000:0.0:1789996428.815252:0:14435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fdee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50790d52-45a2-4d53-a399-c22b3a6afc1a+6:13734:x1876946927590528:12345-192.168.204.37@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789996428.815271:0:14435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789996428.815290:0:14435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e086fcb6800/0x4173739f0fc81a9c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b97003095e358a4 expref: -99 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996428.815320:0:14435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e086fcb6800/0x4173739f0fc81a9c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e358a4 expref: 7 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996428.815331:0:14435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e086fcb6800/0x4173739f0fc81a9c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e358a4 expref: 7 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996428.815341:0:14435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e086fcb6800, rc 0) 00000100:00100000:0.0:1789996428.815514:0:14435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fdee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50790d52-45a2-4d53-a399-c22b3a6afc1a+7:13734:x1876946927590528:12345-192.168.204.37@tcp:101:mount.lustre.0 Request processed in 263us (1038us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996428.815522:0:14435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 77 00000100:00100000:1.0:1789996428.821415:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1789996428.822692:0:14433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927590656 00000100:00100000:3.0:1789996428.822707:0:14433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927590656 00000100:00100000:2.0:1789996428.823251:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 78 00000100:00100000:2.0:1789996428.823263:0:14433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fdef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50790d52-45a2-4d53-a399-c22b3a6afc1a+7:13734:x1876946927590656:12345-192.168.204.37@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789996428.823894:0:14433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fdef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50790d52-45a2-4d53-a399-c22b3a6afc1a+8:13734:x1876946927590656:12345-192.168.204.37@tcp:501:mount.lustre.0 Request processed in 630us (2487us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996428.823904:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 78 00000100:00100000:1.0:1789996428.826207:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996428.826296:0:14435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927590784 00000100:00100000:0.0:1789996428.826307:0:14435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927590784 00000100:00100000:0.0:1789996428.826411:0:14435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 79 00000100:00100000:0.0:1789996428.826423:0:14435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fdee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50790d52-45a2-4d53-a399-c22b3a6afc1a+8:13734:x1876946927590784:12345-192.168.204.37@tcp:503:mount.lustre.0 00000100:00100000:0.0:1789996428.826872:0:14435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fdee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50790d52-45a2-4d53-a399-c22b3a6afc1a+8:13734:x1876946927590784:12345-192.168.204.37@tcp:503:mount.lustre.0 Request processed in 449us (672us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996428.826880:0:14435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 79 00000100:00100000:1.0:1789996428.830254:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996428.830407:0:14433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927590912 00000100:00100000:0.0:1789996428.830417:0:14433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927590912 00000100:00100000:0.0:1789996428.830477:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 80 00000100:00100000:0.0:1789996428.830487:0:14433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fdee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50790d52-45a2-4d53-a399-c22b3a6afc1a+8:13752:x1876946927590912:12345-192.168.204.37@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789996428.831119:0:14433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fdee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50790d52-45a2-4d53-a399-c22b3a6afc1a+8:13752:x1876946927590912:12345-192.168.204.37@tcp:502:llog_process_th.0 Request processed in 631us (874us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996428.831128:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 80 00000100:00100000:1.0:1789996428.837661:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996428.837892:0:14435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927591040 00000100:00100000:0.0:1789996428.837905:0:14435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927591040 00000100:00100000:0.0:1789996428.837960:0:14435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 81 00000100:00100000:0.0:1789996428.837971:0:14435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fdec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50790d52-45a2-4d53-a399-c22b3a6afc1a+8:13752:x1876946927591040:12345-192.168.204.37@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789996428.838452:0:14435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fdec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50790d52-45a2-4d53-a399-c22b3a6afc1a+8:13752:x1876946927591040:12345-192.168.204.37@tcp:502:llog_process_th.0 Request processed in 480us (801us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996428.838461:0:14435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 81 00000100:00100000:1.0:1789996428.847242:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996428.848339:0:14433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927591168 00000100:00100000:0.0:1789996428.848364:0:14433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927591168 00000100:00100000:0.0:1789996428.848518:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 82 00000100:00100000:0.0:1789996428.848530:0:14433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fdec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50790d52-45a2-4d53-a399-c22b3a6afc1a+8:13734:x1876946927591168:12345-192.168.204.37@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789996428.848659:0:14433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789996428.848691:0:14433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e086fcb6c00/0x4173739f0fc81aa3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b97003095e358ce expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996428.848725:0:14433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e086fcb6c00/0x4173739f0fc81aa3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e358ce expref: 9 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996428.848737:0:14433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e086fcb6c00/0x4173739f0fc81aa3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e358ce expref: 9 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996428.848748:0:14433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e086fcb6c00, rc 0) 00000100:00100000:0.0:1789996428.848867:0:14433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fdec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50790d52-45a2-4d53-a399-c22b3a6afc1a+9:13734:x1876946927591168:12345-192.168.204.37@tcp:101:mount.lustre.0 Request processed in 339us (1635us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996428.848874:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 82 00000100:00100000:1.0:1789996428.852591:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996428.852681:0:14435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927591296 00000100:00100000:0.0:1789996428.852692:0:14435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927591296 00000100:00100000:0.0:1789996428.852756:0:14435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 83 00000100:00100000:0.0:1789996428.852766:0:14435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fdeec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50790d52-45a2-4d53-a399-c22b3a6afc1a+9:13734:x1876946927591296:12345-192.168.204.37@tcp:256:mount.lustre.0 20000000:01000000:0.0:1789996428.852798:0:14435:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1789996428.852816:0:14435:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1789996428.852821:0:14435:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1789996428.852823:0:14435:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1789996428.852826:0:14435:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:0.0:1789996428.857746:0:14435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fdeec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50790d52-45a2-4d53-a399-c22b3a6afc1a+9:13734:x1876946927591296:12345-192.168.204.37@tcp:256:mount.lustre.0 Request processed in 4969us (5192us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996428.857776:0:14435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 83 00000100:00100000:1.0:1789996428.863270:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996428.863398:0:14433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927591424 00000100:00100000:0.0:1789996428.863407:0:14433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927591424 00000100:00100000:0.0:1789996428.863513:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 84 00000100:00100000:0.0:1789996428.863524:0:14433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fdedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50790d52-45a2-4d53-a399-c22b3a6afc1a+9:13734:x1876946927591424:12345-192.168.204.37@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789996428.863629:0:14433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789996428.863652:0:14433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e086fcb7e00/0x4173739f0fc81aaa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b97003095e358d5 expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996428.863692:0:14433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e086fcb7e00/0x4173739f0fc81aaa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e358d5 expref: 10 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996428.863705:0:14433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e086fcb7e00/0x4173739f0fc81aaa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e358d5 expref: 10 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996428.863714:0:14433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e086fcb7e00, rc 0) 00000100:00100000:0.0:1789996428.863816:0:14433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fdedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50790d52-45a2-4d53-a399-c22b3a6afc1a+10:13734:x1876946927591424:12345-192.168.204.37@tcp:101:mount.lustre.0 Request processed in 294us (564us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996428.863824:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 84 00000100:00100000:1.0:1789996428.865773:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996428.865897:0:14435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927591552 00000100:00100000:2.0:1789996428.865907:0:14435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927591552 00000100:00100000:2.0:1789996428.865955:0:14435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 85 00000100:00100000:2.0:1789996428.865964:0:14435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fded050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50790d52-45a2-4d53-a399-c22b3a6afc1a+10:13734:x1876946927591552:12345-192.168.204.37@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789996428.866420:0:14435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fded050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50790d52-45a2-4d53-a399-c22b3a6afc1a+10:13734:x1876946927591552:12345-192.168.204.37@tcp:501:mount.lustre.0 Request processed in 454us (653us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996428.866428:0:14435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 85 00000100:00100000:1.0:1789996428.868402:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1789996428.868715:0:14436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927591680 00000100:00100000:3.0:1789996428.868725:0:14436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927591680 00000100:00100000:3.0:1789996428.868833:0:14436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 86 00000100:00100000:3.0:1789996428.868859:0:14436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fded850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50790d52-45a2-4d53-a399-c22b3a6afc1a+10:13734:x1876946927591680:12345-192.168.204.37@tcp:503:mount.lustre.0 00000100:00100000:3.0:1789996428.870696:0:14436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fded850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50790d52-45a2-4d53-a399-c22b3a6afc1a+10:13734:x1876946927591680:12345-192.168.204.37@tcp:503:mount.lustre.0 Request processed in 1829us (2303us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996428.870709:0:14436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 86 00000100:00100000:1.0:1789996428.873724:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996428.874001:0:14433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927591808 00000100:00100000:0.0:1789996428.874011:0:14433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927591808 00000100:00100000:0.0:1789996428.874128:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 87 00000100:00100000:0.0:1789996428.874195:0:14433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fdec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50790d52-45a2-4d53-a399-c22b3a6afc1a+10:13757:x1876946927591808:12345-192.168.204.37@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789996428.874496:0:14433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fdec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50790d52-45a2-4d53-a399-c22b3a6afc1a+10:13757:x1876946927591808:12345-192.168.204.37@tcp:502:llog_process_th.0 Request processed in 303us (794us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996428.874503:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 87 00000100:00100000:1.0:1789996428.882841:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1789996428.882945:0:14436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927591936 00000100:00100000:3.0:1789996428.882956:0:14436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927591936 00000100:00100000:3.0:1789996428.883073:0:14436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 88 00000100:00100000:3.0:1789996428.883086:0:14436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fdefc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50790d52-45a2-4d53-a399-c22b3a6afc1a+10:13757:x1876946927591936:12345-192.168.204.37@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789996428.883375:0:14436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fdefc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50790d52-45a2-4d53-a399-c22b3a6afc1a+10:13757:x1876946927591936:12345-192.168.204.37@tcp:502:llog_process_th.0 Request processed in 290us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996428.883385:0:14436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 88 00000100:00100000:1.0:1789996428.889869:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1789996428.890299:0:14441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927592064 00000100:00100000:3.0:1789996428.890311:0:14441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927592064 00000100:00100000:3.0:1789996428.890414:0:14441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 4 00000100:00100000:3.0:1789996428.890422:0:14441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fc98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2361:x1876946927592064:12345-192.168.204.37@tcp:38:mount.lustre.0 00010000:00080000:3.0:1789996428.890454:0:14441:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 504eef0e-44e7-471d-93df-2fb9c0c14b08@192.168.204.37@tcp t0 exp 0000000000000000 cur 470 last 0 00000020:00000080:3.0:1789996428.890502:0:14441:0:(genops.c:1384:class_connect()) connect: client 504eef0e-44e7-471d-93df-2fb9c0c14b08, cookie 0x4173739f0fc81ab1 00000004:00100000:3.0:1789996428.890534:0:14441:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:3.0:1789996428.890586:0:14441:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:3.0:1789996428.915414:0:14441:0:(import.c:65:import_set_state_nolock()) ffff8e0847d07000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789996428.915511:0:14441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fc98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:504eef0e-44e7-471d-93df-2fb9c0c14b08+6:2361:x1876946927592064:12345-192.168.204.37@tcp:38:mount.lustre.0 Request processed in 25086us (25652us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996428.915523:0:14441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 4 00000100:00100000:1.0:1789996428.919135:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996428.919503:0:14443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927592320 00000100:00100000:2.0:1789996428.919514:0:14443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927592320 00000100:00100000:2.0:1789996428.919611:0:14443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 5 00000100:00100000:2.0:1789996428.919622:0:14443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fc98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:504eef0e-44e7-471d-93df-2fb9c0c14b08+6:13734:x1876946927592320:12345-192.168.204.37@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789996428.919682:0:14443:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00080000:3.0:1789996428.919787:0:14437:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789996428.921573:0:14443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fc98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:504eef0e-44e7-471d-93df-2fb9c0c14b08+6:13734:x1876946927592320:12345-192.168.204.37@tcp:41:mount.lustre.0 Request processed in 1942us (2438us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996428.921588:0:14443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 5 00000100:00100000:1.0:1789996428.921944:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996428.922084:0:14441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927592192 00000100:00100000:2.0:1789996428.922098:0:14441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927592192 00000100:00100000:2.0:1789996428.922146:0:14441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 6 00000100:00100000:2.0:1789996428.922155:0:14441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fc9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:504eef0e-44e7-471d-93df-2fb9c0c14b08+6:0:x1876946927592192:12345-192.168.204.37@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789996428.922203:0:14441:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1789996428.922411:0:14441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fc9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:504eef0e-44e7-471d-93df-2fb9c0c14b08+6:0:x1876946927592192:12345-192.168.204.37@tcp:41:mount.lustre.0 Request processed in 256us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996428.922419:0:14441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 6 00000100:00100000:1.0:1789996428.928662:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996428.928971:0:14443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927592448 00000100:00100000:2.0:1789996428.928982:0:14443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927592448 00000100:00100000:2.0:1789996428.929048:0:14443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 7 00000100:00100000:2.0:1789996428.929059:0:14443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fc99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:504eef0e-44e7-471d-93df-2fb9c0c14b08+6:13734:x1876946927592448:12345-192.168.204.37@tcp:40:mount.lustre.0 00000100:00100000:2.0:1789996428.929152:0:14443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fc99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:504eef0e-44e7-471d-93df-2fb9c0c14b08+6:13734:x1876946927592448:12345-192.168.204.37@tcp:40:mount.lustre.0 Request processed in 95us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996428.929160:0:14443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 7 00000100:00100000:3.0:1789996428.933723:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1789996428.933793:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996428.935405:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1789996428.935941:0:14444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927592832 00000100:00100000:3.0:1789996428.935952:0:14444:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927592832 00000100:00100000:3.0:1789996428.936010:0:14444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 0 00000100:00100000:3.0:1789996428.936022:0:14444:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0741a2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:504eef0e-44e7-471d-93df-2fb9c0c14b08+6:13734:x1876946927592832:12345-192.168.204.37@tcp:33:mount.lustre.0 00000004:00080000:3.0:1789996428.937013:0:14444:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 917us 00000100:00100000:2.0:1789996428.940098:0:15124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927592576 00000100:00100000:2.0:1789996428.940114:0:15124:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927592576 00000100:00100000:2.0:1789996428.940177:0:15124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927592704 00000100:00100000:2.0:1789996428.940181:0:15124:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927592704 00000100:00100000:2.0:1789996428.940212:0:15126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 8 00000100:00100000:2.0:1789996428.940222:0:15126:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fa91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2361:x1876946927592576:12345-192.168.204.37@tcp:8:mount.lustre.0 00010000:00080000:2.0:1789996428.940272:0:15126:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 504eef0e-44e7-471d-93df-2fb9c0c14b08@192.168.204.37@tcp t0 exp 0000000000000000 cur 470 last 0 00000020:00000080:2.0:1789996428.940303:0:15126:0:(genops.c:1384:class_connect()) connect: client 504eef0e-44e7-471d-93df-2fb9c0c14b08, cookie 0x4173739f0fc81ab8 00002000:00100000:2.0:1789996428.940317:0:15126:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 504eef0e-44e7-471d-93df-2fb9c0c14b08/ffff8e0848964000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a3f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789996428.940339:0:15126:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:1.0:1789996428.942980:0:15856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 9 00000100:00100000:1.0:1789996428.942994:0:15856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fa90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2361:x1876946927592704:12345-192.168.204.37@tcp:8:mount.lustre.0 00010000:00080000:1.0:1789996428.943028:0:15856:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 504eef0e-44e7-471d-93df-2fb9c0c14b08@192.168.204.37@tcp t0 exp 0000000000000000 cur 470 last 0 00000020:00000080:1.0:1789996428.943070:0:15856:0:(genops.c:1384:class_connect()) connect: client 504eef0e-44e7-471d-93df-2fb9c0c14b08, cookie 0x4173739f0fc81abf 00002000:00100000:1.0:1789996428.943084:0:15856:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 504eef0e-44e7-471d-93df-2fb9c0c14b08/ffff8e07437ec800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a3f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789996428.943129:0:15856:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789996428.943732:0:15856:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789996428.943775:0:15856:0:(import.c:65:import_set_state_nolock()) ffff8e07437ef000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789996428.943849:0:15856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fa90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:504eef0e-44e7-471d-93df-2fb9c0c14b08+6:2361:x1876946927592704:12345-192.168.204.37@tcp:8:mount.lustre.0 Request processed in 855us (10054us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996428.943860:0:15856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 9 00002000:00080000:2.0:1789996428.944119:0:15126:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1789996428.944144:0:15126:0:(import.c:65:import_set_state_nolock()) ffff8e0848965000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789996428.944192:0:15126:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fa91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:504eef0e-44e7-471d-93df-2fb9c0c14b08+6:2361:x1876946927592576:12345-192.168.204.37@tcp:8:mount.lustre.0 Request processed in 3970us (10480us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996428.944211:0:15126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 8 00000004:00200000:1.0:1789996428.973723:0:14444:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1789996428.973861:0:14444:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0741a2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:504eef0e-44e7-471d-93df-2fb9c0c14b08+6:13734:x1876946927592832:12345-192.168.204.37@tcp:33:mount.lustre.0 Request processed in 37834us (38455us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996428.973877:0:14444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 0 00000100:00100000:1.0:1789996429.148800:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996429.148925:0:14441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927592960 00000100:00100000:2.0:1789996429.148936:0:14441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927592960 00000100:00100000:2.0:1789996429.149002:0:14441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 8 00000100:00100000:2.0:1789996429.149012:0:14441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fc9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:504eef0e-44e7-471d-93df-2fb9c0c14b08+6:13778:x1876946927592960:12345-192.168.204.37@tcp:101:mkdir.0 00010000:00010000:2.0:1789996429.149033:0:14441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789996429.149059:0:14441:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5a600/0x4173739f0fc81ac6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b97003095e358ff expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996429.149140:0:14441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5b400/0x4173739f0fc81acd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996429.149156:0:14441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5b400/0x4173739f0fc81acd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996429.149171:0:14441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5b400/0x4173739f0fc81acd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789996429.149291:0:14441:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789996429.149296:0:14441:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789996429.149341:0:14441:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5b400/0x4173739f0fc81acd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996429.149370:0:14441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5a600/0x4173739f0fc81ac6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e358ff expref: 8 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996429.149392:0:14441:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5b400/0x4173739f0fc81acd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e358ff expref: 7 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996429.149420:0:14441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e0850c28000) 00010000:00010000:2.0:1789996429.149423:0:14441:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789996429.149427:0:14441:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e0741a5b400, rc 0) 00000100:00100000:2.0:1789996429.149510:0:14441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fc9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:504eef0e-44e7-471d-93df-2fb9c0c14b08+7:13778:x1876946927592960:12345-192.168.204.37@tcp:101:mkdir.0 Request processed in 499us (721us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996429.149517:0:14441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 8 00000100:00100000:3.0:1789996429.289350:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0741a2a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876946942262400:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789996429.289433:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996429.289580:0:15129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942262400 00000100:00100000:1.0:1789996429.289589:0:15129:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942262400 00000100:00100000:1.0:1789996429.289655:0:15129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789996429.289676:0:15129:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fa90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876946942262400:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789996429.289698:0:15129:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789996429.289746:0:15129:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fa90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876946942262400:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996429.289753:0:15129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1789996429.290103:0:14437:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789996429.290140:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0741a2a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876946942262400:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789996429.352891:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789996430.376965:0:14430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789996431.002582:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1789996431.004883:0:14442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927593088 00000100:00100000:1.0:1789996431.004898:0:14442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927593088 00000100:00100000:1.0:1789996431.004987:0:14442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 9 00000100:00100000:1.0:1789996431.004999:0:14442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fa91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:504eef0e-44e7-471d-93df-2fb9c0c14b08+7:13830:x1876946927593088:12345-192.168.204.37@tcp:41:lfs.0 00000100:00080000:3.0:1789996431.005006:0:14437:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000024:1.0:1789996431.005056:0:14442:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1789996431.005303:0:14442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fa91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:504eef0e-44e7-471d-93df-2fb9c0c14b08+7:13830:x1876946927593088:12345-192.168.204.37@tcp:41:lfs.0 Request processed in 305us (2769us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996431.005324:0:14442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 9 00000100:00100000:0.0:1789996431.009263:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1789996431.009362:0:15129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927593216 00000100:00100000:1.0:1789996431.009373:0:15129:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927593216 00000100:00080000:3.0:1789996431.009498:0:14437:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789996431.010186:0:15129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 4 00000100:00100000:1.0:1789996431.010199:0:15129:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0741a28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:504eef0e-44e7-471d-93df-2fb9c0c14b08+6:13830:x1876946927593216:12345-192.168.204.37@tcp:13:lfs.0 00002000:00000024:1.0:1789996431.010236:0:15129:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789996431.010319:0:15129:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0741a28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:504eef0e-44e7-471d-93df-2fb9c0c14b08+6:13830:x1876946927593216:12345-192.168.204.37@tcp:13:lfs.0 Request processed in 124us (1067us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996431.010327:0:15129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 4 00000100:00100000:2.0:1789996431.013313:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996431.013394:0:15127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927593344 00000100:00100000:0.0:1789996431.013405:0:15127:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927593344 00000100:00100000:0.0:1789996431.013477:0:15127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 5 00000100:00100000:0.0:1789996431.013488:0:15127:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086faedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:504eef0e-44e7-471d-93df-2fb9c0c14b08+6:13830:x1876946927593344:12345-192.168.204.37@tcp:13:lfs.0 00002000:00000024:0.0:1789996431.013526:0:15127:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789996431.013643:0:15127:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086faedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:504eef0e-44e7-471d-93df-2fb9c0c14b08+6:13830:x1876946927593344:12345-192.168.204.37@tcp:13:lfs.0 Request processed in 157us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996431.013651:0:15127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 5 00000100:00080000:3.0:1789996431.013726:0:14437:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789996431.209982:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996431.210375:0:14433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927593472 00000100:00100000:0.0:1789996431.210386:0:14433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927593472 00000100:00100000:0.0:1789996431.210450:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 89 00000100:00100000:0.0:1789996431.210461:0:14433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fded450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50790d52-45a2-4d53-a399-c22b3a6afc1a+10:13865:x1876946927593472:12345-192.168.204.37@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789996431.210478:0:14433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789996431.210497:0:14433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e086fcb7400/0x4173739f0fc81ad4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b97003095e35906 expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996431.210527:0:14433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e086fcb7400/0x4173739f0fc81ad4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35906 expref: 11 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996431.210539:0:14433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e086fcb7400/0x4173739f0fc81ad4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35906 expref: 11 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996431.210577:0:14433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e086fcb7400, rc 0) 00000100:00100000:0.0:1789996431.210649:0:14433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fded450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50790d52-45a2-4d53-a399-c22b3a6afc1a+11:13865:x1876946927593472:12345-192.168.204.37@tcp:101:mount.lustre.0 Request processed in 190us (678us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996431.210656:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 89 00000100:00100000:2.0:1789996431.217007:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1789996431.219971:0:14436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927593600 00000100:00100000:3.0:1789996431.219988:0:14436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927593600 00000100:00100000:3.0:1789996431.220384:0:14436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 90 00000100:00100000:3.0:1789996431.220396:0:14436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fdecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50790d52-45a2-4d53-a399-c22b3a6afc1a+11:13865:x1876946927593600:12345-192.168.204.37@tcp:501:mount.lustre.0 00000100:00100000:3.0:1789996431.220751:0:14436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fdecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50790d52-45a2-4d53-a399-c22b3a6afc1a+11:13865:x1876946927593600:12345-192.168.204.37@tcp:501:mount.lustre.0 Request processed in 356us (3753us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996431.220760:0:14436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 90 00000100:00100000:1.0:1789996431.229074:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996431.229279:0:14435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927593728 00000100:00100000:2.0:1789996431.229289:0:14435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927593728 00000100:00100000:2.0:1789996431.229348:0:14435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 91 00000100:00100000:2.0:1789996431.229357:0:14435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0877ad7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50790d52-45a2-4d53-a399-c22b3a6afc1a+11:13865:x1876946927593728:12345-192.168.204.37@tcp:503:mount.lustre.0 00000100:00100000:2.0:1789996431.229642:0:14435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0877ad7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50790d52-45a2-4d53-a399-c22b3a6afc1a+11:13865:x1876946927593728:12345-192.168.204.37@tcp:503:mount.lustre.0 Request processed in 284us (587us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996431.229650:0:14435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 91 00000100:00100000:1.0:1789996431.236657:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1789996431.236841:0:14436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927593856 00000100:00100000:3.0:1789996431.236851:0:14436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927593856 00000100:00100000:3.0:1789996431.236910:0:14436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 92 00000100:00100000:3.0:1789996431.236920:0:14436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0877ad6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50790d52-45a2-4d53-a399-c22b3a6afc1a+11:13869:x1876946927593856:12345-192.168.204.37@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789996431.237222:0:14436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0877ad6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50790d52-45a2-4d53-a399-c22b3a6afc1a+11:13869:x1876946927593856:12345-192.168.204.37@tcp:502:llog_process_th.0 Request processed in 301us (574us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996431.237230:0:14436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 92 00000100:00100000:2.0:1789996431.248004:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996431.248103:0:14433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927593984 00000100:00100000:0.0:1789996431.248113:0:14433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927593984 00000100:00100000:0.0:1789996431.248258:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 93 00000100:00100000:0.0:1789996431.248270:0:14433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0877ad7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50790d52-45a2-4d53-a399-c22b3a6afc1a+11:13869:x1876946927593984:12345-192.168.204.37@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789996431.248597:0:14433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0877ad7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50790d52-45a2-4d53-a399-c22b3a6afc1a+11:13869:x1876946927593984:12345-192.168.204.37@tcp:502:llog_process_th.0 Request processed in 329us (602us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996431.248606:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 93 00000100:00100000:1.0:1789996431.264648:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996431.264894:0:14435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927594112 00000100:00100000:2.0:1789996431.264905:0:14435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927594112 00000100:00100000:2.0:1789996431.264963:0:14435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 94 00000100:00100000:2.0:1789996431.264974:0:14435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0877ad4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50790d52-45a2-4d53-a399-c22b3a6afc1a+11:13865:x1876946927594112:12345-192.168.204.37@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789996431.264991:0:14435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789996431.265011:0:14435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e0741a5ba00/0x4173739f0fc81adb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b97003095e35930 expref: -99 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996431.265063:0:14435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e0741a5ba00/0x4173739f0fc81adb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35930 expref: 12 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996431.265076:0:14435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e0741a5ba00/0x4173739f0fc81adb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35930 expref: 12 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996431.265084:0:14435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e0741a5ba00, rc 0) 00000100:00100000:2.0:1789996431.265535:0:14435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0877ad4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50790d52-45a2-4d53-a399-c22b3a6afc1a+12:13865:x1876946927594112:12345-192.168.204.37@tcp:101:mount.lustre.0 Request processed in 560us (896us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996431.265575:0:14435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 94 00000100:00100000:1.0:1789996431.275445:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1789996431.275910:0:14436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927594240 00000100:00100000:3.0:1789996431.275922:0:14436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927594240 00000100:00100000:3.0:1789996431.276020:0:14436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 95 00000100:00100000:3.0:1789996431.276031:0:14436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0877ad6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50790d52-45a2-4d53-a399-c22b3a6afc1a+12:13865:x1876946927594240:12345-192.168.204.37@tcp:256:mount.lustre.0 20000000:01000000:3.0:1789996431.276056:0:14436:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1789996431.276081:0:14436:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1789996431.276085:0:14436:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1789996431.276088:0:14436:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1789996431.276091:0:14436:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:2.0:1789996431.286616:0:14436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0877ad6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50790d52-45a2-4d53-a399-c22b3a6afc1a+12:13865:x1876946927594240:12345-192.168.204.37@tcp:256:mount.lustre.0 Request processed in 10575us (11170us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996431.286642:0:14436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 95 00000100:00100000:1.0:1789996431.292231:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996431.292325:0:14435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927594368 00000100:00100000:2.0:1789996431.292336:0:14435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927594368 00000100:00100000:2.0:1789996431.292396:0:14435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 96 00000100:00100000:2.0:1789996431.292406:0:14435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0877ad6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50790d52-45a2-4d53-a399-c22b3a6afc1a+12:13865:x1876946927594368:12345-192.168.204.37@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789996431.292423:0:14435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789996431.292442:0:14435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e0741a5a400/0x4173739f0fc81ae2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b97003095e35937 expref: -99 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996431.292469:0:14435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e0741a5a400/0x4173739f0fc81ae2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35937 expref: 13 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996431.292480:0:14435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e0741a5a400/0x4173739f0fc81ae2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35937 expref: 13 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996431.292506:0:14435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e0741a5a400, rc 0) 00000100:00100000:2.0:1789996431.292603:0:14435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0877ad6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50790d52-45a2-4d53-a399-c22b3a6afc1a+13:13865:x1876946927594368:12345-192.168.204.37@tcp:101:mount.lustre.0 Request processed in 198us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996431.292610:0:14435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 96 00000100:00100000:1.0:1789996431.295407:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996431.295597:0:14436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927594496 00000100:00100000:2.0:1789996431.295608:0:14436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927594496 00000100:00100000:2.0:1789996431.295686:0:14436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 97 00000100:00100000:2.0:1789996431.295697:0:14436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0877ad4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50790d52-45a2-4d53-a399-c22b3a6afc1a+13:13865:x1876946927594496:12345-192.168.204.37@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789996431.295992:0:14436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0877ad4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50790d52-45a2-4d53-a399-c22b3a6afc1a+13:13865:x1876946927594496:12345-192.168.204.37@tcp:501:mount.lustre.0 Request processed in 296us (594us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996431.296000:0:14436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 97 00000100:00100000:1.0:1789996431.299156:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996431.299257:0:14433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927594624 00000100:00100000:0.0:1789996431.299267:0:14433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927594624 00000100:00100000:0.0:1789996431.299324:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 98 00000100:00100000:0.0:1789996431.299336:0:14433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0877ad4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50790d52-45a2-4d53-a399-c22b3a6afc1a+13:13865:x1876946927594624:12345-192.168.204.37@tcp:503:mount.lustre.0 00000100:00100000:0.0:1789996431.299608:0:14433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0877ad4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50790d52-45a2-4d53-a399-c22b3a6afc1a+13:13865:x1876946927594624:12345-192.168.204.37@tcp:503:mount.lustre.0 Request processed in 274us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996431.299616:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 98 00000100:00100000:1.0:1789996431.302511:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996431.303293:0:14435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927594752 00000100:00100000:0.0:1789996431.303304:0:14435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927594752 00000100:00100000:0.0:1789996431.303403:0:14435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 99 00000100:00100000:0.0:1789996431.303414:0:14435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0877ad4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50790d52-45a2-4d53-a399-c22b3a6afc1a+13:13875:x1876946927594752:12345-192.168.204.37@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789996431.303732:0:14435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0877ad4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50790d52-45a2-4d53-a399-c22b3a6afc1a+13:13875:x1876946927594752:12345-192.168.204.37@tcp:502:llog_process_th.0 Request processed in 319us (1238us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996431.303744:0:14435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 99 00000100:00100000:1.0:1789996431.315847:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996431.318734:0:14436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927594880 00000100:00100000:2.0:1789996431.318752:0:14436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927594880 00000100:00100000:2.0:1789996431.318838:0:14436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 100 00000100:00100000:2.0:1789996431.318849:0:14436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0877ad7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50790d52-45a2-4d53-a399-c22b3a6afc1a+13:13875:x1876946927594880:12345-192.168.204.37@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789996431.319116:0:14436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0877ad7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50790d52-45a2-4d53-a399-c22b3a6afc1a+13:13875:x1876946927594880:12345-192.168.204.37@tcp:502:llog_process_th.0 Request processed in 268us (3279us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996431.319126:0:14436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 100 00000100:00100000:1.0:1789996431.330648:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996431.330903:0:14443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927595008 00000100:00100000:2.0:1789996431.330914:0:14443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927595008 00000100:00100000:2.0:1789996431.330963:0:14443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 10 00000100:00100000:2.0:1789996431.330972:0:14443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fc98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2361:x1876946927595008:12345-192.168.204.37@tcp:38:mount.lustre.0 00010000:00080000:2.0:1789996431.331005:0:14443:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from c25af0be-8577-4dc5-9864-cd7d07ede0af@192.168.204.37@tcp t0 exp 0000000000000000 cur 473 last 0 00000020:00000080:2.0:1789996431.331055:0:14443:0:(genops.c:1384:class_connect()) connect: client c25af0be-8577-4dc5-9864-cd7d07ede0af, cookie 0x4173739f0fc81ae9 00000004:00100000:2.0:1789996431.331103:0:14443:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1789996431.331231:0:14443:0:(import.c:65:import_set_state_nolock()) ffff8e087f8e9800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789996431.332042:0:14443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fc98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c25af0be-8577-4dc5-9864-cd7d07ede0af+6:2361:x1876946927595008:12345-192.168.204.37@tcp:38:mount.lustre.0 Request processed in 1064us (1399us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996431.332053:0:14443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 10 00000100:00100000:1.0:1789996431.337653:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1789996431.337847:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996431.341398:0:14442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927595264 00000100:00100000:0.0:1789996431.341415:0:14442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927595264 00000100:00100000:2.0:1789996431.341422:0:14443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927595136 00000100:00100000:2.0:1789996431.341429:0:14443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927595136 00000100:00100000:2.0:1789996431.341491:0:14443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 11 00000100:00100000:2.0:1789996431.341504:0:14443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fc9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c25af0be-8577-4dc5-9864-cd7d07ede0af+7:0:x1876946927595136:12345-192.168.204.37@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789996431.341570:0:14443:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1789996431.341660:0:14443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fc9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c25af0be-8577-4dc5-9864-cd7d07ede0af+7:0:x1876946927595136:12345-192.168.204.37@tcp:41:mount.lustre.0 Request processed in 159us (3813us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996431.341677:0:14443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 11 00000100:00100000:2.0:1789996431.341697:0:14443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 12 00000100:00100000:2.0:1789996431.341705:0:14443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fc99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c25af0be-8577-4dc5-9864-cd7d07ede0af+6:13865:x1876946927595264:12345-192.168.204.37@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789996431.341719:0:14443:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1789996431.341741:0:14443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fc99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c25af0be-8577-4dc5-9864-cd7d07ede0af+6:13865:x1876946927595264:12345-192.168.204.37@tcp:41:mount.lustre.0 Request processed in 38us (4201us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996431.341748:0:14443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 12 00000100:00080000:3.0:1789996431.342227:0:14437:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789996431.352778:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996431.353300:0:14442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927595392 00000100:00100000:0.0:1789996431.353311:0:14442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927595392 00000100:00100000:0.0:1789996431.353391:0:14442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 13 00000100:00100000:0.0:1789996431.353418:0:14442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086f888e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c25af0be-8577-4dc5-9864-cd7d07ede0af+6:13865:x1876946927595392:12345-192.168.204.37@tcp:40:mount.lustre.0 00000100:00100000:0.0:1789996431.354539:0:14442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086f888e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c25af0be-8577-4dc5-9864-cd7d07ede0af+6:13865:x1876946927595392:12345-192.168.204.37@tcp:40:mount.lustre.0 Request processed in 105us (1038us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996431.354563:0:14442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 13 00000100:00100000:0.0:1789996431.362508:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996431.362647:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996431.362704:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1789996431.362803:0:15856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927595520 00000100:00100000:1.0:1789996431.362815:0:15856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927595520 00000100:00100000:1.0:1789996431.362864:0:15856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927595648 00000100:00100000:1.0:1789996431.362867:0:15856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927595648 00000100:00100000:1.0:1789996431.362888:0:15856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 10 00000100:00100000:1.0:1789996431.362909:0:15856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0741a28380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2361:x1876946927595520:12345-192.168.204.37@tcp:8:mount.lustre.0 00010000:00080000:1.0:1789996431.362956:0:15856:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from c25af0be-8577-4dc5-9864-cd7d07ede0af@192.168.204.37@tcp t0 exp 0000000000000000 cur 473 last 0 00000020:00000080:1.0:1789996431.362989:0:15856:0:(genops.c:1384:class_connect()) connect: client c25af0be-8577-4dc5-9864-cd7d07ede0af, cookie 0x4173739f0fc81af0 00002000:00100000:1.0:1789996431.363000:0:15856:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli c25af0be-8577-4dc5-9864-cd7d07ede0af/ffff8e07437e9000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a3f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789996431.363012:0:15856:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:2.0:1789996431.363070:0:15125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 11 00000100:00100000:2.0:1789996431.363078:0:15125:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0741a29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2361:x1876946927595648:12345-192.168.204.37@tcp:8:mount.lustre.0 00010000:00080000:2.0:1789996431.363098:0:15125:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from c25af0be-8577-4dc5-9864-cd7d07ede0af@192.168.204.37@tcp t0 exp 0000000000000000 cur 473 last 0 00000020:00000080:2.0:1789996431.363121:0:15125:0:(genops.c:1384:class_connect()) connect: client c25af0be-8577-4dc5-9864-cd7d07ede0af, cookie 0x4173739f0fc81af7 00002000:00100000:2.0:1789996431.363128:0:15125:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli c25af0be-8577-4dc5-9864-cd7d07ede0af/ffff8e087f8eb800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a3f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789996431.363142:0:15125:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789996431.363150:0:15856:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00002000:00080000:2.0:1789996431.363204:0:15125:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789996431.363227:0:15125:0:(import.c:65:import_set_state_nolock()) ffff8e087f8e8800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789996431.363288:0:15125:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0741a29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c25af0be-8577-4dc5-9864-cd7d07ede0af+6:2361:x1876946927595648:12345-192.168.204.37@tcp:8:mount.lustre.0 Request processed in 209us (584us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996431.363296:0:15125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 11 00000100:00080000:1.0:1789996431.363411:0:15856:0:(import.c:65:import_set_state_nolock()) ffff8e07437ed000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789996431.363440:0:15856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0741a28380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c25af0be-8577-4dc5-9864-cd7d07ede0af+6:2361:x1876946927595520:12345-192.168.204.37@tcp:8:mount.lustre.0 Request processed in 532us (794us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996431.363448:0:15856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 10 00000100:00100000:2.0:1789996431.364866:0:14445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927595776 00000100:00100000:2.0:1789996431.364877:0:14445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927595776 00000100:00100000:2.0:1789996431.364982:0:14445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 1 00000100:00100000:2.0:1789996431.364991:0:14445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0741a2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c25af0be-8577-4dc5-9864-cd7d07ede0af+6:13865:x1876946927595776:12345-192.168.204.37@tcp:33:mount.lustre.0 00000004:00200000:2.0:1789996431.365082:0:14445:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1789996431.365202:0:14445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0741a2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c25af0be-8577-4dc5-9864-cd7d07ede0af+6:13865:x1876946927595776:12345-192.168.204.37@tcp:33:mount.lustre.0 Request processed in 211us (2703us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996431.365210:0:14445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 1 00010000:00010000:2.0:1789996431.400860:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789996431.530080:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1789996431.530863:0:14441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927595904 00000100:00100000:3.0:1789996431.530874:0:14441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927595904 00000100:00100000:3.0:1789996431.530941:0:14441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 14 00000100:00100000:3.0:1789996431.530964:0:14441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0741a2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c25af0be-8577-4dc5-9864-cd7d07ede0af+6:13896:x1876946927595904:12345-192.168.204.37@tcp:101:mkdir.0 00010000:00010000:3.0:1789996431.530984:0:14441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789996431.531007:0:14441:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856200/0x4173739f0fc81afe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b97003095e35961 expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996431.531072:0:14441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857800/0x4173739f0fc81b05 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996431.531088:0:14441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857800/0x4173739f0fc81b05 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996431.531102:0:14441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857800/0x4173739f0fc81b05 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789996431.531154:0:14441:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789996431.531158:0:14441:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789996431.531183:0:14441:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857800/0x4173739f0fc81b05 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996431.531211:0:14441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f856200/0x4173739f0fc81afe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35961 expref: 8 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996431.531229:0:14441:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857800/0x4173739f0fc81b05 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35961 expref: 7 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996431.531238:0:14441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e0850c28000) 00010000:00010000:3.0:1789996431.531241:0:14441:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789996431.531245:0:14441:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e087f857800, rc 0) 00000100:00100000:3.0:1789996431.531310:0:14441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0741a2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c25af0be-8577-4dc5-9864-cd7d07ede0af+7:13896:x1876946927595904:12345-192.168.204.37@tcp:101:mkdir.0 Request processed in 350us (1240us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996431.531318:0:14441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 14 00000100:00100000:1.0:1789996431.849200:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086faed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876946942262656:0@lo:400:kworker.0 00000100:00100000:0.0:1789996431.849265:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086faed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876946942262784:0@lo:400:kworker.0 00000100:00100000:1.0:1789996431.849281:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996431.849317:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996431.849339:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086faeca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1876946942263168:0@lo:400:kworker.0 00000100:00100000:1.0:1789996431.849363:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996431.849401:0:14443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942263168 00000100:00100000:1.0:1789996431.849402:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789996431.849408:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086d7f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876946942263296:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789996431.849409:0:14443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942263168 00000100:00100000:1.0:1789996431.849432:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996431.849461:0:15125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942262656 00000100:00100000:1.0:1789996431.849465:0:15125:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942262656 00000100:00100000:2.0:1789996431.849479:0:14443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789996431.849488:0:14443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086f88aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876946942263168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789996431.849496:0:15125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942262784 00000100:00100000:1.0:1789996431.849498:0:15125:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942262784 00000100:00100000:1.0:1789996431.849518:0:15125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789996431.849523:0:15125:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086f88a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1876946942262656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789996431.849566:0:14443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086f88aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876946942263168:12345-0@lo:400:kworker.0 Request processed in 79us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996431.849570:0:15125:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086f88a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1876946942262656:12345-0@lo:400:kworker.0 Request processed in 47us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996431.849574:0:14443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789996431.849591:0:15125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789996431.849602:0:15125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789996431.849607:0:15125:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0741a2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3316:x1876946942262784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789996431.849626:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086faed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876946942262656:0@lo:400:kworker.0 00000100:00100000:2.0:1789996431.849643:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086faeca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1876946942263168:0@lo:400:kworker.0 00000100:00100000:1.0:1789996431.849648:0:15125:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0741a2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3316:x1876946942262784:12345-0@lo:400:kworker.0 Request processed in 41us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996431.849653:0:15125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789996431.849681:0:15127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942263296 00000100:00100000:1.0:1789996431.849685:0:15127:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942263296 00000100:00100000:1.0:1789996431.849707:0:15127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789996431.849713:0:15127:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086f888380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3315:x1876946942263296:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789996431.849727:0:15127:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789996431.849765:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086faef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d64f88b3-32d6-473c-b613-b936200ef7a3:3314:1876946942262528:0@lo:400:kworker.0 00000100:00100000:1.0:1789996431.849775:0:15127:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086f888380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3315:x1876946942263296:12345-0@lo:13:osp-pre-1-0.0 Request processed in 63us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996431.849781:0:15127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789996431.849817:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789996431.849845:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086faee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3314:1876946942263040:0@lo:400:kworker.0 00000100:00100000:3.0:1789996431.849866:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789996431.849884:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789996431.849891:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086faeed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876946942262912:0@lo:400:kworker.0 00000100:00100000:3.0:1789996431.849910:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789996431.849953:0:14437:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789996431.849958:0:14437:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789996431.849960:0:14437:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789996431.849983:0:14435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942262528 00000100:00100000:1.0:1789996431.849987:0:14435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942262528 00000100:00100000:2.0:1789996431.851247:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086d7f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876946942263296:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789996431.851288:0:14436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1789996431.851298:0:14436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0877ad5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d64f88b3-32d6-473c-b613-b936200ef7a3+19:3314:x1876946942262528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789996431.852094:0:14436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0877ad5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d64f88b3-32d6-473c-b613-b936200ef7a3+19:3314:x1876946942262528:12345-0@lo:400:kworker.0 Request processed in 794us (2272us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996431.852104:0:14436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1789996431.852885:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086faef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d64f88b3-32d6-473c-b613-b936200ef7a3:3314:1876946942262528:0@lo:400:kworker.0 00000100:00100000:3.0:1789996431.852949:0:14441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942263040 00000100:00100000:3.0:1789996431.852957:0:14441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942263040 00000100:00100000:3.0:1789996431.853012:0:14441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942262912 00000100:00100000:3.0:1789996431.853016:0:14441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942262912 00000100:00100000:3.0:1789996431.853032:0:14441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789996431.853039:0:14441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fa90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876946942263040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789996431.853103:0:14441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fa90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876946942263040:12345-0@lo:400:kworker.0 Request processed in 65us (3236us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996431.853109:0:14441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789996431.853122:0:14441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789996431.853128:0:14441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fa93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876946942262912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789996431.853155:0:14441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fa93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876946942262912:12345-0@lo:400:kworker.0 Request processed in 27us (3243us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996431.853160:0:14441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789996431.853189:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086faeed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876946942262912:0@lo:400:kworker.0 00000100:00100000:3.0:1789996431.853201:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086faee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3314:1876946942263040:0@lo:400:kworker.0 00000100:00100000:0.0:1789996431.856922:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086faed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876946942262784:0@lo:400:kworker.0 00000100:00080000:0.0:1789996431.857001:0:14437:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00100000:2.0:1789996431.938277:0:7659:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 504eef0e-44e7-471d-93df-2fb9c0c14b08 00000001:00100000:2.0:1789996431.938361:0:7659:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of c25af0be-8577-4dc5-9864-cd7d07ede0af 00000001:00080000:2.0:1789996431.938371:0:7659:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:2.0:1789996431.938419:0:7659:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:2.0:1789996432.426588:0:14430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789996433.453280:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789996433.464973:0:6715:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of c25af0be-8577-4dc5-9864-cd7d07ede0af 00000001:00100000:1.0:1789996433.464990:0:6715:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 504eef0e-44e7-471d-93df-2fb9c0c14b08 00000001:00100000:3.0:1789996433.971861:0:5868:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of c25af0be-8577-4dc5-9864-cd7d07ede0af 00000001:00100000:3.0:1789996433.971879:0:5868:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 504eef0e-44e7-471d-93df-2fb9c0c14b08 00000001:02000400:2.0:1789996434.239299:0:16409:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:2.0:1789996434.410806:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789996434.410833:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fa92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876946942263424:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789996434.410915:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996434.410991:0:15129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942263424 00000100:00100000:2.0:1789996434.410999:0:15129:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942263424 00000100:00100000:2.0:1789996434.411058:0:15129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789996434.411068:0:15129:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086d7f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876946942263424:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789996434.411104:0:15129:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789996434.411147:0:15129:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086d7f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1876946942263424:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996434.411154:0:15129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789996434.411206:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fa92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3314:1876946942263424:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789996434.411607:0:14437:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789996434.474292:0:14430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789996435.497780:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789996435.886924:0:14475:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789996436.520667:0:14430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789996436.783345:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1789996436.783396:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996436.783431:0:14433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927596032 00000100:00100000:0.0:1789996436.783443:0:14433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927596032 00000100:00100000:3.0:1789996436.783448:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1789996436.783503:0:15125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927596288 00000100:00100000:1.0:1789996436.783509:0:15125:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927596288 00000100:00100000:2.0:1789996436.783616:0:14441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927596544 00000100:00100000:2.0:1789996436.783621:0:14441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927596544 00000100:00100000:0.0:1789996436.783695:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 102 00000100:00100000:0.0:1789996436.783708:0:14433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0877ad7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50790d52-45a2-4d53-a399-c22b3a6afc1a+13:2365:x1876946927596032:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:1.0:1789996436.783713:0:15125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 4 00000100:00100000:1.0:1789996436.783724:0:15125:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fa92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:504eef0e-44e7-471d-93df-2fb9c0c14b08+5:2365:x1876946927596288:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:0.0:1789996436.783797:0:14433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0877ad7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50790d52-45a2-4d53-a399-c22b3a6afc1a+13:2365:x1876946927596032:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 92us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996436.783806:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 102 00000100:00100000:1.0:1789996436.783845:0:15125:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fa92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:504eef0e-44e7-471d-93df-2fb9c0c14b08+5:2365:x1876946927596288:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 123us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996436.783852:0:15125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 4 00000100:00080000:1.0:1789996436.783874:0:14437:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789996436.783879:0:14437:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789996436.788206:0:14443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 16 00000100:00100000:3.0:1789996436.788228:0:14443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0849c75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c25af0be-8577-4dc5-9864-cd7d07ede0af+6:2365:x1876946927596544:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:3.0:1789996436.788497:0:14443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0849c75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c25af0be-8577-4dc5-9864-cd7d07ede0af+6:2365:x1876946927596544:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 276us (5049us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996436.788532:0:14443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 16 00000100:00100000:2.0:1789996436.788685:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996436.788815:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996436.788839:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996436.788863:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996436.788883:0:14442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927596160 00000100:00100000:0.0:1789996436.788892:0:14442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927596160 00000100:00100000:0.0:1789996436.788941:0:14442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 17 00000100:00100000:0.0:1789996436.788948:0:14442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0741a29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:504eef0e-44e7-471d-93df-2fb9c0c14b08+6:2365:x1876946927596160:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:0.0:1789996436.788993:0:14442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0741a29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:504eef0e-44e7-471d-93df-2fb9c0c14b08+6:2365:x1876946927596160:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 44us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996436.789000:0:14442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 17 00000100:00100000:0.0:1789996436.789019:0:15124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927596800 00000100:00100000:0.0:1789996436.789024:0:15124:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927596800 00000100:00100000:0.0:1789996436.789050:0:15124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927596416 00000100:00100000:0.0:1789996436.789053:0:15124:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927596416 00000100:00100000:0.0:1789996436.789065:0:15124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927596672 00000100:00100000:0.0:1789996436.789067:0:15124:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927596672 00000100:00100000:0.0:1789996436.789085:0:15124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 5 00000100:00100000:0.0:1789996436.789090:0:15124:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086d7f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c25af0be-8577-4dc5-9864-cd7d07ede0af+5:2365:x1876946927596800:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:0.0:1789996436.789116:0:15124:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086d7f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c25af0be-8577-4dc5-9864-cd7d07ede0af+5:2365:x1876946927596800:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 25us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996436.789122:0:15124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 5 00000100:00100000:0.0:1789996436.789132:0:15124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 6 00000100:00100000:0.0:1789996436.789139:0:15124:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0741a2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:504eef0e-44e7-471d-93df-2fb9c0c14b08+5:2365:x1876946927596416:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:0.0:1789996436.789529:0:15124:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0741a2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:504eef0e-44e7-471d-93df-2fb9c0c14b08+5:2365:x1876946927596416:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 20us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996436.789537:0:15124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 6 00000100:00100000:0.0:1789996436.789593:0:15124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 7 00000100:00100000:0.0:1789996436.789601:0:15124:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0741a2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c25af0be-8577-4dc5-9864-cd7d07ede0af+5:2365:x1876946927596672:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:0.0:1789996436.789630:0:15124:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0741a2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c25af0be-8577-4dc5-9864-cd7d07ede0af+5:2365:x1876946927596672:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 30us (766us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996436.789636:0:15124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 7 00000100:00080000:0.0:1789996436.789660:0:14437:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789996436.789671:0:14437:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789996436.789674:0:14437:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789996436.970198:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086d7f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d64f88b3-32d6-473c-b613-b936200ef7a3:3314:1876946942263552:0@lo:400:kworker.0 00000100:00100000:2.0:1789996436.970288:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996436.970335:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086d7f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3314:1876946942264064:0@lo:400:kworker.0 00000100:00100000:2.0:1789996436.970362:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996436.970389:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789996436.970395:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086d7f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876946942263936:0@lo:400:kworker.0 00000100:00100000:2.0:1789996436.970415:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996436.970443:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086d7f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876946942263680:0@lo:400:kworker.0 00000100:00100000:2.0:1789996436.970468:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996436.970486:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086d7f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1876946942264192:0@lo:400:kworker.0 00000100:00100000:2.0:1789996436.970505:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996436.970561:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789996436.970568:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086d7f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876946942263808:0@lo:400:kworker.0 00000100:00100000:2.0:1789996436.970591:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996436.970625:0:14442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942264064 00000100:00100000:2.0:1789996436.970632:0:14442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942264064 00000100:00100000:2.0:1789996436.970793:0:14442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942263936 00000100:00100000:2.0:1789996436.970798:0:14442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942263936 00000100:00100000:2.0:1789996436.970809:0:14442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942264192 00000100:00100000:2.0:1789996436.970811:0:14442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942264192 00000100:00100000:2.0:1789996436.970825:0:14442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789996436.970833:0:14442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086d7f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876946942264064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789996436.970883:0:14442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086d7f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876946942264064:12345-0@lo:400:kworker.0 Request processed in 50us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996436.970902:0:14442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789996436.970920:0:14442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789996436.970926:0:14442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086d7f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876946942263936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789996436.970955:0:14442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086d7f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1876946942263936:12345-0@lo:400:kworker.0 Request processed in 29us (539us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996436.970961:0:14442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789996436.970973:0:14442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789996436.970979:0:14442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086d7f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876946942264192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789996436.971009:0:14442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086d7f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1876946942264192:12345-0@lo:400:kworker.0 Request processed in 30us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996436.971014:0:14442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789996436.971036:0:15124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942263680 00000100:00100000:2.0:1789996436.971039:0:15124:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942263680 00000100:00100000:2.0:1789996436.971064:0:15124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942263808 00000100:00100000:2.0:1789996436.971067:0:15124:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942263808 00000100:00100000:2.0:1789996436.971087:0:15124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789996436.971093:0:15124:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086d7f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1876946942263680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789996436.971122:0:15124:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086d7f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1876946942263680:12345-0@lo:400:kworker.0 Request processed in 30us (653us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996436.971129:0:15124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789996436.971140:0:15124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789996436.971146:0:15124:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086d7f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1876946942263808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789996436.971174:0:15124:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086d7f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1876946942263808:12345-0@lo:400:kworker.0 Request processed in 29us (583us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996436.971179:0:15124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:2.0:1789996436.971208:0:14437:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789996436.971212:0:14437:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789996436.971214:0:14437:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789996436.971245:0:3315:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1789996436.971262:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086d7f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876946942263808:0@lo:400:kworker.0 00000100:00100000:2.0:1789996436.971273:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086d7f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876946942263680:0@lo:400:kworker.0 00000100:00100000:2.0:1789996436.971282:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086d7f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3315:1876946942264192:0@lo:400:kworker.0 00000100:00100000:2.0:1789996436.971308:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086d7f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3314:1876946942263936:0@lo:400:kworker.0 00000100:00100000:2.0:1789996436.971317:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086d7f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3314:1876946942264064:0@lo:400:kworker.0 00000100:00100000:0.0:1789996436.974837:0:14435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942263552 00000100:00100000:0.0:1789996436.974849:0:14435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942263552 00000100:00100000:0.0:1789996436.975784:0:14435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1789996436.975796:0:14435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0877ad5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d64f88b3-32d6-473c-b613-b936200ef7a3+19:3314:x1876946942263552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789996436.976274:0:14435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0877ad5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d64f88b3-32d6-473c-b613-b936200ef7a3+19:3314:x1876946942263552:12345-0@lo:400:kworker.0 Request processed in 478us (5984us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996436.976283:0:14435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1789996436.977052:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086d7f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d64f88b3-32d6-473c-b613-b936200ef7a3:3314:1876946942263552:0@lo:400:kworker.0 00000100:00100000:2.0:1789996436.978430:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0849c77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876946942264320:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789996436.978506:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996436.978583:0:15129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942264320 00000100:00100000:2.0:1789996436.978591:0:15129:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942264320 00000100:00100000:2.0:1789996436.978650:0:15129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789996436.978661:0:15129:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086d7f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1876946942264320:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789996436.978697:0:15129:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789996436.978738:0:15129:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086d7f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3316:x1876946942264320:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996436.978745:0:15129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789996436.978787:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0849c77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876946942264320:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789996437.545984:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789996437.564678:0:16557:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd20abd660 20000000:00000080:1.0:1789996437.564704:0:16557:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8e07437d8400 uarg=0000000000000000 20000000:01000000:1.0:1789996437.564751:0:16557:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1789996437.564757:0:16557:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1789996437.564761:0:16557:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1789996437.567889:0:16558:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:1.0:1789996437.568184:0:16557:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1789996437.575902:0:16557:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1789996437.575935:0:16557:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e0876a22a00/0x4173739f0fc81b0c lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996437.575955:0:16557:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e08429c7600/0x4173739f0fc81803 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4173739f0fc817fc expref: 18 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996437.575964:0:16557:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e08429c7200/0x4173739f0fc81850 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4173739f0fc81849 expref: 18 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996437.575971:0:16557:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e087f857200/0x4173739f0fc8198b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4173739f0fc81984 expref: 18 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996437.575981:0:16557:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e086fcb7e00/0x4173739f0fc81aaa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e358d5 expref: 12 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996437.575990:0:16557:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e0741a5a400/0x4173739f0fc81ae2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35937 expref: 12 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996437.576013:0:16557:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8e0876a22a00/0x4173739f0fc81b0c lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996437.576058:0:16557:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e0741a5a400/0x4173739f0fc81ae2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35937 expref: 12 pid: 14435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996437.576076:0:16557:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e0741a5a400/0x4173739f0fc81ae2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35937 expref: 12 pid: 14435 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789996437.576092:0:16557:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086f889500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16557:1876946942264448:192.168.204.37@tcp:104: 00010000:00010000:1.0:1789996437.576193:0:16557:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e086fcb7e00/0x4173739f0fc81aaa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e358d5 expref: 12 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996437.576203:0:16557:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e086fcb7e00/0x4173739f0fc81aaa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e358d5 expref: 12 pid: 14433 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789996437.576211:0:16557:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086f889f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16557:1876946942264576:192.168.204.37@tcp:104: 00010000:00010000:1.0:1789996437.576241:0:16557:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e087f857200/0x4173739f0fc8198b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4173739f0fc81984 expref: 18 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996437.576249:0:16557:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e087f857200/0x4173739f0fc8198b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4173739f0fc81984 expref: 18 pid: 14436 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789996437.576258:0:16557:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086f88b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16557:1876946942264704:0@lo:104: 00000100:00100000:1.0:1789996437.576297:0:16557:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789996437.576343:0:16557:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e08429c7200/0x4173739f0fc81850 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4173739f0fc81849 expref: 18 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996437.576362:0:16557:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e08429c7200/0x4173739f0fc81850 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4173739f0fc81849 expref: 18 pid: 14433 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789996437.576370:0:16557:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086f889c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16557:1876946942264832:0@lo:104: 00000100:00100000:1.0:1789996437.576396:0:16557:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789996437.576419:0:16557:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e08429c7600/0x4173739f0fc81803 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4173739f0fc817fc expref: 18 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996437.576427:0:16557:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e08429c7600/0x4173739f0fc81803 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4173739f0fc817fc expref: 18 pid: 14433 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789996437.576435:0:16557:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086f888700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16557:1876946942264960:0@lo:104: 00000100:00100000:1.0:1789996437.576461:0:16557:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996437.576471:0:16557:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0848997300 going to sleep for 11 seconds 00000100:00100000:3.0:1789996437.576590:0:14425:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1789996437.576606:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942264704 00000100:00100000:3.0:1789996437.576615:0:14425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942264704 00000100:00100000:3.0:1789996437.576666:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942264832 00000100:00100000:3.0:1789996437.576670:0:14425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942264832 00000100:00100000:3.0:1789996437.576683:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942264960 00000100:00100000:3.0:1789996437.576685:0:14425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942264960 00000100:00100000:3.0:1789996437.576700:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789996437.576712:0:14425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086f888a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d64f88b3-32d6-473c-b613-b936200ef7a3+5:16557:x1876946942264704:12345-0@lo:104: 00010000:00010000:3.0:1789996437.576726:0:14425:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.137@tcp lock: ffff8e086fcb6000/0x4173739f0fc81984 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4173739f0fc8198b expref: -99 pid: 15843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996437.576792:0:14425:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789996437.576798:0:14425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086f888a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d64f88b3-32d6-473c-b613-b936200ef7a3+5:16557:x1876946942264704:12345-0@lo:104: Request processed in 90us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996437.576805:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789996437.576821:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789996437.576826:0:14425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086f88bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d64f88b3-32d6-473c-b613-b936200ef7a3+4:16557:x1876946942264832:12345-0@lo:104: 00010000:00010000:3.0:1789996437.576834:0:14425:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.137@tcp lock: ffff8e086fcb7000/0x4173739f0fc81849 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4173739f0fc81850 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996437.576867:0:14425:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789996437.576872:0:14425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086f88bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d64f88b3-32d6-473c-b613-b936200ef7a3+4:16557:x1876946942264832:12345-0@lo:104: Request processed in 46us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996437.576877:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789996437.576891:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789996437.576904:0:14425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e087f998050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d64f88b3-32d6-473c-b613-b936200ef7a3+3:16557:x1876946942264960:12345-0@lo:104: 00010000:00010000:3.0:1789996437.576911:0:14425:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.137@tcp lock: ffff8e0876a22600/0x4173739f0fc817fc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4173739f0fc81803 expref: -99 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996437.576936:0:14425:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1789996437.576940:0:14425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e087f998050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d64f88b3-32d6-473c-b613-b936200ef7a3+3:16557:x1876946942264960:12345-0@lo:104: Request processed in 38us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996437.576945:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:3.0:1789996437.576983:0:14430:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789996437.576989:0:14430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.137@tcp lock: ffff8e086fcb6000/0x4173739f0fc81984 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4173739f0fc8198b expref: -99 pid: 15843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996437.576996:0:14430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e086fcb6000 already unused, calling callback (ffffffffc1be0c20) 10000000:00010000:3.0:1789996437.577000:0:14430:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.137@tcp lock: ffff8e086fcb6000/0x4173739f0fc81984 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x4173739f0fc8198b expref: -99 pid: 15843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996437.577009:0:14430:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.137@tcp lock: ffff8e086fcb6000/0x4173739f0fc81984 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x4173739f0fc8198b expref: -99 pid: 15843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789996437.577016:0:14430:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.137@tcp lock: ffff8e086fcb6000/0x4173739f0fc81984 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x4173739f0fc8198b expref: -99 pid: 15843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789996437.577021:0:14430:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789996437.577050:0:14430:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.137@tcp lock: ffff8e086fcb6000/0x4173739f0fc81984 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4173739f0fc8198b expref: -99 pid: 15843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996437.577056:0:14430:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789996437.577076:0:14430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.137@tcp lock: ffff8e086fcb6000/0x4173739f0fc81984 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4173739f0fc8198b expref: -99 pid: 15843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996437.577093:0:14430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.137@tcp lock: ffff8e086fcb6000/0x4173739f0fc81984 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4173739f0fc8198b expref: -99 pid: 15843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996437.577105:0:14430:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789996437.577107:0:14430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.137@tcp lock: ffff8e086fcb7000/0x4173739f0fc81849 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4173739f0fc81850 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996437.577129:0:14430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e086fcb7000 already unused, calling callback (ffffffffc1be0c20) 10000000:00010000:3.0:1789996437.577132:0:14430:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.137@tcp lock: ffff8e086fcb7000/0x4173739f0fc81849 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x4173739f0fc81850 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996437.577139:0:14430:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.137@tcp lock: ffff8e086fcb7000/0x4173739f0fc81849 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x4173739f0fc81850 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789996437.577144:0:14430:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.137@tcp lock: ffff8e086fcb7000/0x4173739f0fc81849 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x4173739f0fc81850 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789996437.577148:0:14430:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789996437.577162:0:14430:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.137@tcp lock: ffff8e086fcb7000/0x4173739f0fc81849 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4173739f0fc81850 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996437.577168:0:14430:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789996437.577176:0:14430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.137@tcp lock: ffff8e086fcb7000/0x4173739f0fc81849 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4173739f0fc81850 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996437.577183:0:14430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.137@tcp lock: ffff8e086fcb7000/0x4173739f0fc81849 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4173739f0fc81850 expref: -99 pid: 15123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996437.577193:0:14430:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789996437.577202:0:14430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.137@tcp lock: ffff8e0876a22600/0x4173739f0fc817fc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4173739f0fc81803 expref: -99 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996437.577208:0:14430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0876a22600 already unused, calling callback (ffffffffc1be0c20) 10000000:00010000:3.0:1789996437.577211:0:14430:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.137@tcp lock: ffff8e0876a22600/0x4173739f0fc817fc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4173739f0fc81803 expref: -99 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996437.577219:0:14430:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.137@tcp lock: ffff8e0876a22600/0x4173739f0fc817fc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4173739f0fc81803 expref: -99 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789996437.577225:0:14430:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.137@tcp lock: ffff8e0876a22600/0x4173739f0fc817fc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4173739f0fc81803 expref: -99 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789996437.577232:0:14430:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789996437.577244:0:14430:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.137@tcp lock: ffff8e0876a22600/0x4173739f0fc817fc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4173739f0fc81803 expref: -99 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996437.577250:0:14430:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789996437.577262:0:14430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.137@tcp lock: ffff8e0876a22600/0x4173739f0fc817fc lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4173739f0fc81803 expref: -99 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996437.577270:0:14430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.137@tcp lock: ffff8e0876a22600/0x4173739f0fc817fc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4173739f0fc81803 expref: -99 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996437.577283:0:14430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789996437.577285:0:14430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789996437.577286:0:14430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789996437.577307:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0849c75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d64f88b3-32d6-473c-b613-b936200ef7a3:3314:1876946942265216:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789996437.577338:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789996437.577358:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789996437.577364:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0849c77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d64f88b3-32d6-473c-b613-b936200ef7a3:3314:1876946942265088:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789996437.577393:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789996437.577418:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942265216 00000100:00100000:3.0:1789996437.577423:0:14426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942265216 00010000:00010000:3.0:1789996437.577442:0:14426:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e08429c7200/0x4173739f0fc81850 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4173739f0fc81849 expref: 19 pid: 14433 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789996437.577657:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942265088 00000100:00100000:3.0:1789996437.577662:0:14426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942265088 00010000:00010000:3.0:1789996437.577680:0:14426:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e087f857200/0x4173739f0fc8198b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4173739f0fc81984 expref: 20 pid: 14436 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789996437.577693:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789996437.577699:0:14426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0849c75880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d64f88b3-32d6-473c-b613-b936200ef7a3+20:3314:x1876946942265216:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789996437.577709:0:14426:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789996437.577714:0:14426:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e08429c7200/0x4173739f0fc81850 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4173739f0fc81849 expref: 20 pid: 14433 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996437.577723:0:14426:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e08429c7200/0x4173739f0fc81850 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4173739f0fc81849 expref: 20 pid: 14433 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996437.577741:0:14426:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789996437.577769:0:14426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0849c75880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d64f88b3-32d6-473c-b613-b936200ef7a3+20:3314:x1876946942265216:12345-0@lo:103:ldlm_bl.0 Request processed in 70us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996437.577775:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789996437.577788:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789996437.577794:0:14426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0849c74e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d64f88b3-32d6-473c-b613-b936200ef7a3+19:3314:x1876946942265088:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789996437.577801:0:14426:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789996437.577804:0:14426:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e087f857200/0x4173739f0fc8198b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4173739f0fc81984 expref: 19 pid: 14436 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996437.577823:0:14426:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e087f857200/0x4173739f0fc8198b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4173739f0fc81984 expref: 19 pid: 14436 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996437.577832:0:14426:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789996437.577853:0:14426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0849c74e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d64f88b3-32d6-473c-b613-b936200ef7a3+19:3314:x1876946942265088:12345-0@lo:103:ldlm_bl.0 Request processed in 60us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996437.577859:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789996437.577896:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0849c77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d64f88b3-32d6-473c-b613-b936200ef7a3:3314:1876946942265088:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789996437.577906:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0849c75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d64f88b3-32d6-473c-b613-b936200ef7a3:3314:1876946942265216:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789996437.577951:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0849c76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d64f88b3-32d6-473c-b613-b936200ef7a3:3315:1876946942265344:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789996437.577988:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996437.578040:0:14428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942265344 00000100:00100000:2.0:1789996437.578050:0:14428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942265344 00010000:00010000:2.0:1789996437.578068:0:14428:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e08429c7600/0x4173739f0fc81803 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4173739f0fc817fc expref: 19 pid: 14433 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789996437.578089:0:14428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789996437.578095:0:14428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e074138f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d64f88b3-32d6-473c-b613-b936200ef7a3+19:3315:x1876946942265344:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789996437.578103:0:14428:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789996437.578107:0:14428:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e08429c7600/0x4173739f0fc81803 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4173739f0fc817fc expref: 19 pid: 14433 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996437.578115:0:14428:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e08429c7600/0x4173739f0fc81803 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4173739f0fc817fc expref: 19 pid: 14433 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996437.578125:0:14428:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789996437.578153:0:14428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e074138f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d64f88b3-32d6-473c-b613-b936200ef7a3+19:3315:x1876946942265344:12345-0@lo:103:ldlm_bl.0 Request processed in 58us (164us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996437.578160:0:14428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:2.0:1789996437.578200:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789996437.578222:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0849c76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d64f88b3-32d6-473c-b613-b936200ef7a3:3315:1876946942265344:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789996437.578835:0:16557:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e087f857200/0x4173739f0fc8198b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4173739f0fc81984 expref: 18 pid: 14436 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789996437.578849:0:16557:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086f88b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16557:1876946942264704:0@lo:104: 00010000:00010000:1.0:1789996437.578860:0:16557:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e08429c7200/0x4173739f0fc81850 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4173739f0fc81849 expref: 17 pid: 14433 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789996437.578868:0:16557:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086f889c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16557:1876946942264832:0@lo:104: 00010000:00010000:1.0:1789996437.578878:0:16557:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e08429c7600/0x4173739f0fc81803 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4173739f0fc817fc expref: 16 pid: 14433 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789996437.578884:0:16557:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086f888700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16557:1876946942264960:0@lo:104: 00000100:00100000:0.0:1789996437.581316:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996437.581598:0:14428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927596928 00000100:00100000:2.0:1789996437.581607:0:14428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927596928 00010000:00010000:2.0:1789996437.581649:0:14428:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e0741a5a400/0x4173739f0fc81ae2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35937 expref: 13 pid: 14435 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789996437.581692:0:14428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 7 00000100:00100000:2.0:1789996437.581703:0:14428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0741a28700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:50790d52-45a2-4d53-a399-c22b3a6afc1a+13:2363:x1876946927596928:12345-192.168.204.37@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789996437.581717:0:14428:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789996437.581724:0:14428:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e0741a5a400/0x4173739f0fc81ae2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35937 expref: 13 pid: 14435 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996437.581753:0:14428:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e0741a5a400/0x4173739f0fc81ae2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35937 expref: 13 pid: 14435 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996437.581775:0:14428:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789996437.581840:0:14428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0741a28700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:50790d52-45a2-4d53-a399-c22b3a6afc1a+13:2363:x1876946927596928:12345-192.168.204.37@tcp:103:ldlm_bl.0 Request processed in 138us (533us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996437.581848:0:14428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 7 00010000:00010000:1.0:1789996437.582119:0:16557:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e0741a5a400/0x4173739f0fc81ae2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35937 expref: 12 pid: 14435 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789996437.582143:0:16557:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086f889500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16557:1876946942264448:192.168.204.37@tcp:104: 00000100:00100000:1.0:1789996437.582161:0:16557:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086f889f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16557:1876946942264576:192.168.204.37@tcp:104: 00010000:00010000:1.0:1789996437.582203:0:16557:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8e0876a22a00/0x4173739f0fc81b0c lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789996437.583294:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1789996437.583365:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927597056 00000100:00100000:3.0:1789996437.583372:0:14426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927597056 00010000:00010000:3.0:1789996437.583403:0:14426:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e086fcb7e00/0x4173739f0fc81aaa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e358d5 expref: 12 pid: 14433 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789996437.583439:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 8 00000100:00100000:3.0:1789996437.583448:0:14426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0741a2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:50790d52-45a2-4d53-a399-c22b3a6afc1a+12:2362:x1876946927597056:12345-192.168.204.37@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789996437.583569:0:14426:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789996437.583576:0:14426:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e086fcb7e00/0x4173739f0fc81aaa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e358d5 expref: 12 pid: 14433 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996437.583588:0:14426:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e086fcb7e00/0x4173739f0fc81aaa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e358d5 expref: 12 pid: 14433 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996437.583603:0:14426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e086fcb7e00/0x4173739f0fc81aaa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e358d5 expref: 12 pid: 14433 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996437.583618:0:14426:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8e0876a22a00/0x4173739f0fc81b0c lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996437.583636:0:14426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e0876a22a00/0x4173739f0fc81b0c lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996437.583651:0:14426:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e0876a22a00/0x4173739f0fc81b0c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996437.583662:0:14426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e0876a22a00/0x4173739f0fc81b0c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996437.583670:0:14426:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e0876a22a00/0x4173739f0fc81b0c lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996437.583677:0:14426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e0876a22a00/0x4173739f0fc81b0c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996437.583683:0:14426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0876a22a00 already unused, calling callback (ffffffffc1595910) 00010000:00010000:3.0:1789996437.583687:0:14426:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e0876a22a00/0x4173739f0fc81b0c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996437.583696:0:14426:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e0876a22a00/0x4173739f0fc81b0c lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996437.583712:0:14426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e0876a22a00/0x4173739f0fc81b0c lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996437.583722:0:14426:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789996437.583776:0:14426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0741a2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:50790d52-45a2-4d53-a399-c22b3a6afc1a+11:2362:x1876946927597056:12345-192.168.204.37@tcp:103:ldlm_bl.0 Request processed in 328us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996437.583783:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 8 00010000:00010000:1.0:1789996437.585190:0:16557:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8e0876a22a00/0x4173739f0fc81b0c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996437.585207:0:16557:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e0876a22a00/0x4173739f0fc81b0c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996437.585214:0:16557:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e0876a22a00/0x4173739f0fc81b0c lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996438.568672:0:14430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789996439.017151:0:14438:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789996439.017158:0:14438:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e07412a9000 from 10 10000000:01000000:0.0:1789996439.017164:0:14438:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789996439.017213:0:14438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.137@tcp lock: ffff8e086fcb6400/0x4173739f0fc81b13 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996439.017225:0:14438:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.137@tcp lock: ffff8e086fcb6400/0x4173739f0fc81b13 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996439.017236:0:14438:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.137@tcp lock: ffff8e086fcb6400/0x4173739f0fc81b13 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789996439.017264:0:14438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0880f7ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d64f88b3-32d6-473c-b613-b936200ef7a3:14438:1876946942265472:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789996439.017334:0:14438:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996439.017391:0:14438:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0849106e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789996439.017441:0:14436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942265472 00000100:00100000:3.0:1789996439.017450:0:14436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942265472 00000100:00100000:3.0:1789996439.017517:0:14436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1789996439.017526:0:14436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0877ad5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d64f88b3-32d6-473c-b613-b936200ef7a3+16:14438:x1876946942265472:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789996439.017587:0:14436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789996439.017603:0:14436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e087f856200/0x4173739f0fc81b1a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4173739f0fc81b13 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996439.017627:0:14436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e087f856200/0x4173739f0fc81b1a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4173739f0fc81b13 expref: 17 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996439.017638:0:14436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e087f856200/0x4173739f0fc81b1a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4173739f0fc81b13 expref: 17 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996439.017647:0:14436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e087f856200, rc 0) 00000100:00100000:3.0:1789996439.017686:0:14436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0877ad5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d64f88b3-32d6-473c-b613-b936200ef7a3+17:14438:x1876946942265472:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 161us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996439.017692:0:14436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1789996439.026584:0:14438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0880f7ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d64f88b3-32d6-473c-b613-b936200ef7a3:14438:1876946942265472:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789996439.026616:0:14438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.137@tcp lock: ffff8e086fcb6400/0x4173739f0fc81b13 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc81b1a expref: -99 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996439.026646:0:14438:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.137@tcp lock: ffff8e086fcb6400/0x4173739f0fc81b13 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4173739f0fc81b1a expref: -99 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789996439.026731:0:14438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0880f7ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d64f88b3-32d6-473c-b613-b936200ef7a3:14438:1876946942265600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789996439.026792:0:14438:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996439.026826:0:14438:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0849106e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789996439.026845:0:14433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942265600 00000100:00100000:0.0:1789996439.026850:0:14433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942265600 00000100:00100000:0.0:1789996439.026887:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1789996439.026895:0:14433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0877ad5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d64f88b3-32d6-473c-b613-b936200ef7a3+17:14438:x1876946942265600:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789996439.027136:0:14433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0877ad5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d64f88b3-32d6-473c-b613-b936200ef7a3+17:14438:x1876946942265600:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 240us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996439.027143:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1789996439.027181:0:14438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0880f7ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d64f88b3-32d6-473c-b613-b936200ef7a3:14438:1876946942265600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789996439.027207:0:14438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0880f7ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d64f88b3-32d6-473c-b613-b936200ef7a3:14438:1876946942265728:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789996439.027244:0:14438:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996439.027256:0:14438:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e085aa58a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789996439.027269:0:14435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942265728 00000100:00100000:0.0:1789996439.027272:0:14435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942265728 00000100:00100000:0.0:1789996439.027291:0:14435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1789996439.027297:0:14435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0877ad0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d64f88b3-32d6-473c-b613-b936200ef7a3+17:14438:x1876946942265728:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789996439.027425:0:14435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0877ad0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d64f88b3-32d6-473c-b613-b936200ef7a3+17:14438:x1876946942265728:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 127us (180us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996439.027431:0:14435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1789996439.027484:0:14438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0880f7ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d64f88b3-32d6-473c-b613-b936200ef7a3:14438:1876946942265728:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789996439.028177:0:16612:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1789996439.028227:0:14438:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1789996439.028245:0:14438:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.137@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789996439.028253:0:14438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.137@tcp lock: ffff8e086fcb6400/0x4173739f0fc81b13 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc81b1a expref: -99 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996439.028263:0:14438:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.137@tcp lock: ffff8e086fcb6400/0x4173739f0fc81b13 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc81b1a expref: -99 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789996439.028273:0:14438:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789996439.028276:0:14438:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e08704c6000 from 10 10000000:01000000:0.0:1789996439.028279:0:14438:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789996439.028303:0:14438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.137@tcp lock: ffff8e086fcb7800/0x4173739f0fc81b21 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996439.028311:0:14438:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.137@tcp lock: ffff8e086fcb7800/0x4173739f0fc81b21 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996439.028320:0:14438:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.137@tcp lock: ffff8e086fcb7800/0x4173739f0fc81b21 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789996439.028336:0:14438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0880f7ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d64f88b3-32d6-473c-b613-b936200ef7a3:14438:1876946942265856:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789996439.028371:0:14438:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996439.028396:0:14438:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0847518c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789996439.028409:0:14436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942265856 00000100:00100000:0.0:1789996439.028414:0:14436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942265856 00000100:00100000:0.0:1789996439.028440:0:14436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1789996439.028446:0:14436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0877ad3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d64f88b3-32d6-473c-b613-b936200ef7a3+17:14438:x1876946942265856:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789996439.028465:0:14436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789996439.028490:0:14436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e086fcb6200/0x4173739f0fc81b28 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4173739f0fc81b21 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996439.028511:0:14436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e086fcb6200/0x4173739f0fc81b28 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4173739f0fc81b21 expref: 18 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996439.028523:0:14436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e086fcb6200/0x4173739f0fc81b28 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4173739f0fc81b21 expref: 18 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996439.028531:0:14436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e086fcb6200, rc 0) 00000100:00100000:0.0:1789996439.028589:0:14436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0877ad3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d64f88b3-32d6-473c-b613-b936200ef7a3+18:14438:x1876946942265856:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 143us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996439.028596:0:14436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1789996439.028630:0:14438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0880f7ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d64f88b3-32d6-473c-b613-b936200ef7a3:14438:1876946942265856:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789996439.028641:0:14438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.137@tcp lock: ffff8e086fcb7800/0x4173739f0fc81b21 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc81b28 expref: -99 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996439.028650:0:14438:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.137@tcp lock: ffff8e086fcb7800/0x4173739f0fc81b21 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4173739f0fc81b28 expref: -99 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789996439.028687:0:14438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0880f7ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d64f88b3-32d6-473c-b613-b936200ef7a3:14438:1876946942265984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789996439.028709:0:14438:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996439.028726:0:14438:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0847518c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789996439.028735:0:14433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942265984 00000100:00100000:0.0:1789996439.028739:0:14433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942265984 00000100:00100000:0.0:1789996439.028758:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1789996439.028764:0:14433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0877ad2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d64f88b3-32d6-473c-b613-b936200ef7a3+18:14438:x1876946942265984:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789996439.028951:0:14433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0877ad2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d64f88b3-32d6-473c-b613-b936200ef7a3+18:14438:x1876946942265984:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 186us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996439.028959:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1789996439.028987:0:14438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0880f7ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d64f88b3-32d6-473c-b613-b936200ef7a3:14438:1876946942265984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789996439.029012:0:14438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0880f7ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d64f88b3-32d6-473c-b613-b936200ef7a3:14438:1876946942266112:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789996439.029049:0:14438:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996439.029062:0:14438:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0847518c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789996439.029073:0:14435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942266112 00000100:00100000:0.0:1789996439.029077:0:14435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942266112 00000100:00100000:0.0:1789996439.029098:0:14435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1789996439.029103:0:14435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0877ad0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d64f88b3-32d6-473c-b613-b936200ef7a3+18:14438:x1876946942266112:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789996439.035595:0:14435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0877ad0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d64f88b3-32d6-473c-b613-b936200ef7a3+18:14438:x1876946942266112:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 6481us (6535us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996439.035611:0:14435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1789996439.036104:0:14438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0880f7ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d64f88b3-32d6-473c-b613-b936200ef7a3:14438:1876946942266112:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789996439.043848:0:16613:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1789996439.044091:0:14438:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1789996439.044118:0:14438:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.137@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789996439.044130:0:14438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.137@tcp lock: ffff8e086fcb7800/0x4173739f0fc81b21 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc81b28 expref: -99 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996439.044143:0:14438:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.137@tcp lock: ffff8e086fcb7800/0x4173739f0fc81b21 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc81b28 expref: -99 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789996439.044154:0:14438:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789996439.044157:0:14438:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e087fbc4800 from 10 10000000:01000000:3.0:1789996439.044170:0:14438:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789996439.044206:0:14438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.137@tcp lock: ffff8e087f857400/0x4173739f0fc81b2f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996439.044215:0:14438:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.137@tcp lock: ffff8e087f857400/0x4173739f0fc81b2f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996439.044226:0:14438:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.137@tcp lock: ffff8e087f857400/0x4173739f0fc81b2f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789996439.044251:0:14438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0849c75180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d64f88b3-32d6-473c-b613-b936200ef7a3:14438:1876946942266240:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789996439.044312:0:14438:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789996439.044346:0:14438:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e084659ed80 going to sleep for 11 seconds 00000100:00100000:0.0:1789996439.044537:0:14436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942266240 00000100:00100000:0.0:1789996439.044579:0:14436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942266240 00000100:00100000:0.0:1789996439.044623:0:14436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1789996439.044633:0:14436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0877ad3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d64f88b3-32d6-473c-b613-b936200ef7a3+18:14438:x1876946942266240:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789996439.044645:0:14436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789996439.044658:0:14436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e086fcb6e00/0x4173739f0fc81b36 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4173739f0fc81b2f expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996439.044683:0:14436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e086fcb6e00/0x4173739f0fc81b36 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4173739f0fc81b2f expref: 19 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996439.044694:0:14436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e086fcb6e00/0x4173739f0fc81b36 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4173739f0fc81b2f expref: 19 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996439.044709:0:14436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e086fcb6e00, rc 0) 00000100:00100000:0.0:1789996439.044755:0:14436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0877ad3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d64f88b3-32d6-473c-b613-b936200ef7a3+19:14438:x1876946942266240:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996439.044761:0:14436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1789996439.044954:0:14438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0849c75180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d64f88b3-32d6-473c-b613-b936200ef7a3:14438:1876946942266240:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789996439.044972:0:14438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.137@tcp lock: ffff8e087f857400/0x4173739f0fc81b2f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc81b36 expref: -99 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996439.044982:0:14438:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.137@tcp lock: ffff8e087f857400/0x4173739f0fc81b2f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4173739f0fc81b36 expref: -99 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789996439.045032:0:14438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0849c75180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d64f88b3-32d6-473c-b613-b936200ef7a3:14438:1876946942266368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789996439.045059:0:14438:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789996439.045077:0:14438:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e084659ed80 going to sleep for 11 seconds 00000100:00100000:2.0:1789996439.045139:0:14433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942266368 00000100:00100000:2.0:1789996439.045143:0:14433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942266368 00000100:00100000:2.0:1789996439.045179:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1789996439.045187:0:14433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0877ad1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d64f88b3-32d6-473c-b613-b936200ef7a3+19:14438:x1876946942266368:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789996439.045430:0:14433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0877ad1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d64f88b3-32d6-473c-b613-b936200ef7a3+19:14438:x1876946942266368:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 244us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996439.045438:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1789996439.045509:0:14438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0849c75180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d64f88b3-32d6-473c-b613-b936200ef7a3:14438:1876946942266368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789996439.045587:0:14438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0849c75180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d64f88b3-32d6-473c-b613-b936200ef7a3:14438:1876946942266496:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789996439.045627:0:14438:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789996439.045648:0:14438:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e084659ed80 going to sleep for 11 seconds 00000100:00100000:2.0:1789996439.046494:0:14433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942266496 00000100:00100000:2.0:1789996439.046501:0:14433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942266496 00000100:00100000:2.0:1789996439.046579:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1789996439.046587:0:14433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0877ad2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d64f88b3-32d6-473c-b613-b936200ef7a3+19:14438:x1876946942266496:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789996439.046757:0:14433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0877ad2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d64f88b3-32d6-473c-b613-b936200ef7a3+19:14438:x1876946942266496:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 170us (1129us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996439.046763:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1789996439.047590:0:14438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0849c75180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d64f88b3-32d6-473c-b613-b936200ef7a3:14438:1876946942266496:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789996439.050821:0:16615:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1789996439.050902:0:14438:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1789996439.050919:0:14438:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.137@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789996439.050931:0:14438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.137@tcp lock: ffff8e087f857400/0x4173739f0fc81b2f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc81b36 expref: -99 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996439.050943:0:14438:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.137@tcp lock: ffff8e087f857400/0x4173739f0fc81b2f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4173739f0fc81b36 expref: -99 pid: 14438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789996439.150949:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1789996439.150990:0:14433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927597184 00000100:00100000:3.0:1789996439.150999:0:14433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927597184 00000100:00100000:3.0:1789996439.151053:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 113 00000100:00100000:3.0:1789996439.151064:0:14433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0877ad3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50790d52-45a2-4d53-a399-c22b3a6afc1a+11:13748:x1876946927597184:12345-192.168.204.37@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789996439.151082:0:14433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789996439.151101:0:14433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e087f857200/0x4173739f0fc81b3d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b97003095e35968 expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996439.151133:0:14433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e087f857200/0x4173739f0fc81b3d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35968 expref: 12 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996439.151145:0:14433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e087f857200/0x4173739f0fc81b3d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35968 expref: 12 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996439.151154:0:14433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e087f857200, rc 0) 00000100:00100000:3.0:1789996439.151208:0:14433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0877ad3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50790d52-45a2-4d53-a399-c22b3a6afc1a+12:13748:x1876946927597184:12345-192.168.204.37@tcp:101:ll_cfg_requeue.0 Request processed in 145us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996439.151233:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 113 00000100:00100000:3.0:1789996439.164960:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1789996439.164994:0:14436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927597312 00000100:00100000:3.0:1789996439.165005:0:14436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927597312 00000100:00100000:3.0:1789996439.165055:0:14436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 114 00000100:00100000:3.0:1789996439.165066:0:14436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0877ad1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50790d52-45a2-4d53-a399-c22b3a6afc1a+12:13748:x1876946927597312:12345-192.168.204.37@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789996439.165350:0:14436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0877ad1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50790d52-45a2-4d53-a399-c22b3a6afc1a+12:13748:x1876946927597312:12345-192.168.204.37@tcp:501:ll_cfg_requeue.0 Request processed in 284us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996439.165358:0:14436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 114 00000100:00100000:3.0:1789996439.183829:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1789996439.183862:0:14435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927597440 00000100:00100000:3.0:1789996439.183871:0:14435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927597440 00000100:00100000:3.0:1789996439.183916:0:14435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 115 00000100:00100000:3.0:1789996439.183927:0:14435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0877ad0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50790d52-45a2-4d53-a399-c22b3a6afc1a+12:13748:x1876946927597440:12345-192.168.204.37@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789996439.184138:0:14435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0877ad0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50790d52-45a2-4d53-a399-c22b3a6afc1a+12:13748:x1876946927597440:12345-192.168.204.37@tcp:503:ll_cfg_requeue.0 Request processed in 212us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996439.184146:0:14435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 115 00000100:00100000:3.0:1789996439.190844:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1789996439.190882:0:14433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927597568 00000100:00100000:3.0:1789996439.190892:0:14433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927597568 00000100:00100000:3.0:1789996439.190940:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 116 00000100:00100000:3.0:1789996439.190950:0:14433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0877ad0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50790d52-45a2-4d53-a399-c22b3a6afc1a+12:13748:x1876946927597568:12345-192.168.204.37@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789996439.191413:0:14433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789996439.191436:0:14433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e0841524800/0x4173739f0fc81b44 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x1b97003095e3596f expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996439.191495:0:14433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e0841524800/0x4173739f0fc81b44 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e3596f expref: 13 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996439.191508:0:14433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e0841524800/0x4173739f0fc81b44 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e3596f expref: 13 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996439.191518:0:14433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e0841524800, rc 0) 00000100:00100000:3.0:1789996439.191597:0:14433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0877ad0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:50790d52-45a2-4d53-a399-c22b3a6afc1a+13:13748:x1876946927597568:12345-192.168.204.37@tcp:101:ll_cfg_requeue.0 Request processed in 648us (763us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996439.191605:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 116 00000100:00100000:0.0:1789996439.200029:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1789996439.200085:0:14436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927597696 00000100:00100000:3.0:1789996439.200096:0:14436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927597696 00000100:00100000:3.0:1789996439.200151:0:14436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 117 00000100:00100000:3.0:1789996439.200163:0:14436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0877ad3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50790d52-45a2-4d53-a399-c22b3a6afc1a+13:13748:x1876946927597696:12345-192.168.204.37@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789996439.200616:0:14436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0877ad3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50790d52-45a2-4d53-a399-c22b3a6afc1a+13:13748:x1876946927597696:12345-192.168.204.37@tcp:501:ll_cfg_requeue.0 Request processed in 453us (593us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996439.200625:0:14436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 117 00000100:00100000:2.0:1789996439.217388:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1789996439.217651:0:14435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927597824 00000100:00100000:3.0:1789996439.217662:0:14435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927597824 00000100:00100000:3.0:1789996439.217720:0:14435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 118 00000100:00100000:3.0:1789996439.217730:0:14435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0877ad2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50790d52-45a2-4d53-a399-c22b3a6afc1a+13:13748:x1876946927597824:12345-192.168.204.37@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789996439.218176:0:14435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0877ad2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:50790d52-45a2-4d53-a399-c22b3a6afc1a+13:13748:x1876946927597824:12345-192.168.204.37@tcp:503:ll_cfg_requeue.0 Request processed in 445us (796us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996439.218185:0:14435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 118 00000100:00100000:3.0:1789996439.538071:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789996439.538110:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0849c75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876946942266624:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789996439.538180:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789996439.538249:0:15129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942266624 00000100:00100000:3.0:1789996439.538258:0:15129:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942266624 00000100:00100000:3.0:1789996439.538309:0:15129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789996439.538318:0:15129:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0849c77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876946942266624:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789996439.538365:0:15129:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789996439.538404:0:15129:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0849c77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876946942266624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996439.538411:0:15129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:3.0:1789996439.538428:0:14437:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789996439.538474:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0849c75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876946942266624:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789996439.592921:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789996440.616788:0:14430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789996440.959179:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996440.959288:0:14442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927597952 00000100:00100000:2.0:1789996440.959299:0:14442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927597952 00000100:00100000:2.0:1789996440.959427:0:14442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 15 00000100:00100000:2.0:1789996440.959449:0:14442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0880f78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:504eef0e-44e7-471d-93df-2fb9c0c14b08+6:14407:x1876946927597952:12345-192.168.204.37@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789996440.959472:0:14442:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789996440.959506:0:14442:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5aa00/0x4173739f0fc81b4b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b97003095e35976 expref: -99 pid: 14442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996440.959597:0:14442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5ac00/0x4173739f0fc81b52 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996440.959612:0:14442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5ac00/0x4173739f0fc81b52 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996440.959624:0:14442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5ac00/0x4173739f0fc81b52 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996440.959638:0:14442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5a000/0x4173739f0fc81b59 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996440.959645:0:14442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5a000/0x4173739f0fc81b59 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996440.959652:0:14442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5a000/0x4173739f0fc81b59 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996440.961237:0:14442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5a800/0x4173739f0fc81b60 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996440.961253:0:14442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5a800/0x4173739f0fc81b60 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996440.961264:0:14442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5a800/0x4173739f0fc81b60 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14442 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789996440.961302:0:14442:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789996440.961306:0:14442:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789996440.961343:0:14442:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5a800/0x4173739f0fc81b60 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996440.961355:0:14442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5ac00/0x4173739f0fc81b52 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996440.961361:0:14442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5ac00/0x4173739f0fc81b52 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996440.961368:0:14442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5ac00/0x4173739f0fc81b52 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996440.961373:0:14442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0741a5ac00 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:2.0:1789996440.961378:0:14442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5ac00/0x4173739f0fc81b52 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996440.961385:0:14442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5ac00/0x4173739f0fc81b52 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996440.961396:0:14442:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e0850c28000) 00010000:00010000:2.0:1789996440.961399:0:14442:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789996440.961404:0:14442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5ac00/0x4173739f0fc81b52 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996440.961411:0:14442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5ac00/0x4173739f0fc81b52 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996440.961422:0:14442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5a000/0x4173739f0fc81b59 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996440.961449:0:14442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5a000/0x4173739f0fc81b59 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996440.961455:0:14442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5a000/0x4173739f0fc81b59 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996440.961460:0:14442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0741a5a000 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:2.0:1789996440.961463:0:14442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5a000/0x4173739f0fc81b59 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996440.961468:0:14442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5a000/0x4173739f0fc81b59 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996440.962006:0:14442:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8e0850c28e00) 00010000:00010000:2.0:1789996440.962011:0:14442:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789996440.962016:0:14442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5a000/0x4173739f0fc81b59 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996440.962023:0:14442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5a000/0x4173739f0fc81b59 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996440.962066:0:14442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5aa00/0x4173739f0fc81b4b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35976 expref: 8 pid: 14442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996440.962080:0:14442:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5a800/0x4173739f0fc81b60 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35976 expref: 7 pid: 14442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996440.962087:0:14442:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8e0850c28600) 00010000:00010000:2.0:1789996440.962090:0:14442:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789996440.962100:0:14442:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e0741a5a800, rc 0) 00000100:00100000:2.0:1789996440.962161:0:14442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0880f78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:504eef0e-44e7-471d-93df-2fb9c0c14b08+7:14407:x1876946927597952:12345-192.168.204.37@tcp:101:lhsmtool_posix.0 Request processed in 2725us (2992us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996440.962169:0:14442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 15 00000100:00080000:3.0:1789996440.964486:0:14437:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789996440.970173:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996440.970367:0:14441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927598208 00000100:00100000:2.0:1789996440.970379:0:14441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927598208 00000100:00100000:2.0:1789996440.970456:0:14441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 16 00000100:00100000:2.0:1789996440.970469:0:14441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0880f79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:504eef0e-44e7-471d-93df-2fb9c0c14b08+7:14407:x1876946927598208:12345-192.168.204.37@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789996440.970504:0:14441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789996440.970526:0:14441:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5ac00/0x4173739f0fc81b67 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b97003095e3597d expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996440.970633:0:14441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5b600/0x4173739f0fc81b6e lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996440.970648:0:14441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5b600/0x4173739f0fc81b6e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996440.970660:0:14441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5b600/0x4173739f0fc81b6e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996440.970726:0:14441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5ae00/0x4173739f0fc81b75 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996440.970735:0:14441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5ae00/0x4173739f0fc81b75 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996440.970743:0:14441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5ae00/0x4173739f0fc81b75 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996440.971615:0:14441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5be00/0x4173739f0fc81b7c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996440.971638:0:14441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5be00/0x4173739f0fc81b7c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996440.971647:0:14441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5be00/0x4173739f0fc81b7c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789996440.971659:0:14441:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:2.0:1789996440.972126:0:14441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5b600/0x4173739f0fc81b6e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996440.972135:0:14441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5b600/0x4173739f0fc81b6e lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996440.972141:0:14441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5b600/0x4173739f0fc81b6e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996440.972147:0:14441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0741a5b600 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:2.0:1789996440.972151:0:14441:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5b600/0x4173739f0fc81b6e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996440.972157:0:14441:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5b600/0x4173739f0fc81b6e lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996440.972169:0:14441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8e0850c28600) 00010000:00010000:2.0:1789996440.972173:0:14441:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789996440.972177:0:14441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5b600/0x4173739f0fc81b6e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996440.972185:0:14441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5b600/0x4173739f0fc81b6e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996440.972197:0:14441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5ae00/0x4173739f0fc81b75 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996440.972209:0:14441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5ae00/0x4173739f0fc81b75 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996440.972215:0:14441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5ae00/0x4173739f0fc81b75 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996440.972220:0:14441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0741a5ae00 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:2.0:1789996440.972223:0:14441:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5ae00/0x4173739f0fc81b75 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996440.972230:0:14441:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5ae00/0x4173739f0fc81b75 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996440.972237:0:14441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8e0850c28400) 00010000:00010000:2.0:1789996440.972239:0:14441:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789996440.972243:0:14441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5ae00/0x4173739f0fc81b75 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996440.972249:0:14441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5ae00/0x4173739f0fc81b75 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996440.973431:0:14441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5ac00/0x4173739f0fc81b67 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e3597d expref: 10 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996440.973464:0:14441:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5be00/0x4173739f0fc81b7c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e3597d expref: 9 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996440.973471:0:14441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e0850c28b00) 00010000:00010000:2.0:1789996440.973473:0:14441:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789996440.973495:0:14441:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e0741a5be00, rc 0) 00000100:00100000:2.0:1789996440.973582:0:14441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0880f79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:504eef0e-44e7-471d-93df-2fb9c0c14b08+9:14407:x1876946927598208:12345-192.168.204.37@tcp:101:lhsmtool_posix.0 Request processed in 3116us (3417us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1789996440.973590:0:14441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 16 00000100:00100000:2.0:1789996440.978426:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996440.978745:0:14443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927598336 00000100:00100000:0.0:1789996440.978757:0:14443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927598336 00000100:00100000:0.0:1789996440.978822:0:14443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 17 00000100:00100000:0.0:1789996440.978831:0:14443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086d7f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:504eef0e-44e7-471d-93df-2fb9c0c14b08+9:14407:x1876946927598336:12345-192.168.204.37@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1789996440.978941:0:14443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086d7f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:504eef0e-44e7-471d-93df-2fb9c0c14b08+9:14407:x1876946927598336:12345-192.168.204.37@tcp:59:lhsmtool_posix.0 Request processed in 110us (526us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996440.978948:0:14443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 17 00000040:00080000:3.0:1789996441.002207:0:14475:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789996441.044419:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996441.044532:0:14441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927598464 00000100:00100000:2.0:1789996441.044570:0:14441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927598464 00000100:00100000:2.0:1789996441.044634:0:14441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 18 00000100:00100000:2.0:1789996441.044645:0:14441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0880f7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:504eef0e-44e7-471d-93df-2fb9c0c14b08+9:14413:x1876946927598464:12345-192.168.204.37@tcp:101:lfs.0 00010000:00010000:2.0:1789996441.044664:0:14441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789996441.044684:0:14441:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5ac00/0x4173739f0fc81b8a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b97003095e35984 expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996441.044750:0:14441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5ae00/0x4173739f0fc81b91 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996441.044761:0:14441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5ae00/0x4173739f0fc81b91 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996441.044770:0:14441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5ae00/0x4173739f0fc81b91 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996441.044779:0:14441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5b600/0x4173739f0fc81b98 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996441.044793:0:14441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5b600/0x4173739f0fc81b98 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996441.044799:0:14441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5b600/0x4173739f0fc81b98 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996441.045012:0:14441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5ae00/0x4173739f0fc81b91 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996441.045021:0:14441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5ae00/0x4173739f0fc81b91 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996441.045028:0:14441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5ae00/0x4173739f0fc81b91 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996441.045034:0:14441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0741a5ae00 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:2.0:1789996441.045039:0:14441:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5ae00/0x4173739f0fc81b91 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996441.045047:0:14441:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5ae00/0x4173739f0fc81b91 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996441.045059:0:14441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e0850c28000) 00010000:00010000:2.0:1789996441.045062:0:14441:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789996441.045067:0:14441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5ae00/0x4173739f0fc81b91 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996441.045073:0:14441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5ae00/0x4173739f0fc81b91 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996441.045086:0:14441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5b600/0x4173739f0fc81b98 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996441.045092:0:14441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5b600/0x4173739f0fc81b98 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996441.045098:0:14441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5b600/0x4173739f0fc81b98 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996441.045110:0:14441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0741a5b600 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:2.0:1789996441.045113:0:14441:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5b600/0x4173739f0fc81b98 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996441.045119:0:14441:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5b600/0x4173739f0fc81b98 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996441.045128:0:14441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8e0850c28400) 00010000:00010000:2.0:1789996441.045130:0:14441:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789996441.045133:0:14441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5b600/0x4173739f0fc81b98 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996441.045139:0:14441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5b600/0x4173739f0fc81b98 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996441.045171:0:14441:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5ac00/0x4173739f0fc81b8a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35984 expref: 10 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996441.045181:0:14441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e0850c28000) 00010000:00010000:2.0:1789996441.045184:0:14441:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789996441.045187:0:14441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5ac00/0x4173739f0fc81b8a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35984 expref: 10 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996441.045197:0:14441:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e0741a5ac00, rc 0) 00000100:00100000:2.0:1789996441.045268:0:14441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0880f7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:504eef0e-44e7-471d-93df-2fb9c0c14b08+9:14413:x1876946927598464:12345-192.168.204.37@tcp:101:lfs.0 Request processed in 626us (859us total) trans 0 rc 301/301 00000100:00100000:2.0:1789996441.045275:0:14441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 18 00000100:00100000:2.0:1789996441.049922:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996441.050021:0:14450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927598592 00000100:00100000:0.0:1789996441.050030:0:14450:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927598592 00000100:00100000:0.0:1789996441.050101:0:14450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 0 00000100:00100000:0.0:1789996441.050109:0:14450:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086d7f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:504eef0e-44e7-471d-93df-2fb9c0c14b08+9:14413:x1876946927598592:12345-192.168.204.37@tcp:700:lfs.0 00000100:00100000:0.0:1789996441.050193:0:14450:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086d7f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:504eef0e-44e7-471d-93df-2fb9c0c14b08+9:14413:x1876946927598592:12345-192.168.204.37@tcp:700:lfs.0 Request processed in 82us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996441.050200:0:14450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 0 00000100:00100000:0.0:1789996441.052201:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1789996441.052279:0:14442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927598848 00000100:00100000:3.0:1789996441.052287:0:14442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927598848 00000100:00100000:3.0:1789996441.052379:0:14442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 19 00000100:00100000:3.0:1789996441.052389:0:14442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0880f7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:504eef0e-44e7-471d-93df-2fb9c0c14b08+9:14413:x1876946927598848:12345-192.168.204.37@tcp:36:lfs.0 00010000:00010000:3.0:1789996441.052449:0:14442:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789996441.052475:0:14442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5b400/0x4173739f0fc81acd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e358ff expref: 9 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996441.052493:0:14442:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e0850c28000) 00010000:00010000:3.0:1789996441.052497:0:14442:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789996441.052725:0:14442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0841525e00/0x4173739f0fc81b9f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996441.052751:0:14442:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857800/0x4173739f0fc81b05 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35961 expref: 5 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996441.052758:0:14442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0841525e00/0x4173739f0fc81b9f lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996441.052807:0:14442:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857800/0x4173739f0fc81b05 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35961 expref: 5 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996441.052821:0:14442:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857800/0x4173739f0fc81b05 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35961 expref: 5 pid: 14441 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789996441.052835:0:14442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0849c75180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14442:1876946942266752:192.168.204.37@tcp:104: 00000100:00100000:3.0:1789996441.052923:0:14442:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0848997240 going to sleep for 11 seconds 00000100:00100000:3.0:1789996441.055128:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996441.055240:0:14442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0849c75180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14442:1876946942266752:192.168.204.37@tcp:104: 00010000:00010000:2.0:1789996441.055263:0:14442:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e0841525e00/0x4173739f0fc81b9f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14442 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789996441.055346:0:14428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927598976 00000100:00100000:0.0:1789996441.055352:0:14428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927598976 00010000:00010000:0.0:1789996441.055421:0:14428:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857800/0x4173739f0fc81b05 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35961 expref: 6 pid: 14441 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789996441.055468:0:14428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 9 00000100:00100000:0.0:1789996441.055477:0:14428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0849c76300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c25af0be-8577-4dc5-9864-cd7d07ede0af+6:2362:x1876946927598976:12345-192.168.204.37@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789996441.055498:0:14428:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789996441.055505:0:14428:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857800/0x4173739f0fc81b05 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35961 expref: 6 pid: 14441 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996441.055516:0:14428:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857800/0x4173739f0fc81b05 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35961 expref: 6 pid: 14441 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996441.055537:0:14428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e087f857800/0x4173739f0fc81b05 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35961 expref: 6 pid: 14441 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996441.055605:0:14428:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e0850c28000) 00010000:00010000:0.0:1789996441.055611:0:14428:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8e0841525e00/0x4173739f0fc81b9f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996441.055619:0:14428:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0841525e00/0x4173739f0fc81b9f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996441.055626:0:14428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0841525e00/0x4173739f0fc81b9f lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996441.055646:0:14428:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789996441.055691:0:14442:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e0841525e00/0x4173739f0fc81b9f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14442 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789996441.055691:0:14428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0849c76300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c25af0be-8577-4dc5-9864-cd7d07ede0af+5:2362:x1876946927598976:12345-192.168.204.37@tcp:103:ldlm_bl.0 Request processed in 215us (572us total) trans 0 rc 0/0 00010000:00010000:1.0:1789996441.055699:0:14442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0841525e00/0x4173739f0fc81b9f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14442 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789996441.055699:0:14428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 9 00010000:00010000:1.0:1789996441.055724:0:14442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22000/0x4173739f0fc81ba6 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996441.055732:0:14442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22000/0x4173739f0fc81ba6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996441.055739:0:14442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22000/0x4173739f0fc81ba6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14442 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1789996441.056802:0:14437:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:1.0:1789996441.057032:0:14442:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1789996441.057052:0:14442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0841525e00/0x4173739f0fc81b9f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996441.057064:0:14442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0841525e00/0x4173739f0fc81b9f lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996441.057070:0:14442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e0841525e00/0x4173739f0fc81b9f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996441.057076:0:14442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0841525e00 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:1.0:1789996441.057080:0:14442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0841525e00/0x4173739f0fc81b9f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996441.057087:0:14442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0841525e00/0x4173739f0fc81b9f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996441.057101:0:14442:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e0850c28000) 00010000:00010000:1.0:1789996441.057104:0:14442:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789996441.057109:0:14442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e0841525e00/0x4173739f0fc81b9f lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996441.057115:0:14442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0841525e00/0x4173739f0fc81b9f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14442 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789996441.057134:0:14442:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000852ee9cf reply state 00000000083ca9da transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22000/0x4173739f0fc81ba6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14442 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789996441.057142:0:14442:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789996441.057224:0:14442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0880f7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:504eef0e-44e7-471d-93df-2fb9c0c14b08+10:14413:x1876946927598848:12345-192.168.204.37@tcp:36:lfs.0 Request processed in 4833us (5029us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1789996441.057232:0:14442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 19 00010000:00010000:1.0:1789996441.060274:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22000/0x4173739f0fc81ba6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996441.060307:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22000/0x4173739f0fc81ba6 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996441.060316:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22000/0x4173739f0fc81ba6 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996441.060322:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0876a22000 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:1.0:1789996441.060326:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22000/0x4173739f0fc81ba6 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996441.060333:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22000/0x4173739f0fc81ba6 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996441.060349:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8e0861fcfa00) 00010000:00010000:1.0:1789996441.060352:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789996441.060357:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22000/0x4173739f0fc81ba6 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996441.060364:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22000/0x4173739f0fc81ba6 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14442 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789996441.142003:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996441.142104:0:14441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927599104 00000100:00100000:2.0:1789996441.142115:0:14441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927599104 00000100:00100000:2.0:1789996441.142184:0:14441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 20 00000100:00100000:2.0:1789996441.142199:0:14441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0880f78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:504eef0e-44e7-471d-93df-2fb9c0c14b08+9:14421:x1876946927599104:12345-192.168.204.37@tcp:101:lctl.0 00010000:00010000:2.0:1789996441.142223:0:14441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789996441.142245:0:14441:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5b600/0x4173739f0fc81bad lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b97003095e3598b expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996441.142310:0:14441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5ae00/0x4173739f0fc81bb4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996441.142325:0:14441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5ae00/0x4173739f0fc81bb4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996441.142338:0:14441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5ae00/0x4173739f0fc81bb4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789996441.142373:0:14441:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789996441.142377:0:14441:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789996441.142425:0:14441:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5ae00/0x4173739f0fc81bb4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996441.142465:0:14441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5b600/0x4173739f0fc81bad lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e3598b expref: 11 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996441.142484:0:14441:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5ae00/0x4173739f0fc81bb4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e3598b expref: 10 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996441.142507:0:14441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e0850c28400) 00010000:00010000:2.0:1789996441.142510:0:14441:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789996441.142513:0:14441:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e0741a5ae00, rc 0) 00000100:00100000:2.0:1789996441.142686:0:14441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0880f78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:504eef0e-44e7-471d-93df-2fb9c0c14b08+10:14421:x1876946927599104:12345-192.168.204.37@tcp:101:lctl.0 Request processed in 488us (704us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996441.142694:0:14441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 20 00000100:00100000:3.0:1789996441.167347:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1789996441.167479:0:14442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927599232 00000100:00100000:1.0:1789996441.167489:0:14442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927599232 00000100:00100000:1.0:1789996441.167586:0:14442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 21 00000100:00100000:1.0:1789996441.167597:0:14442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0849c75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c25af0be-8577-4dc5-9864-cd7d07ede0af+5:14422:x1876946927599232:12345-192.168.204.37@tcp:101:lfs.0 00010000:00010000:1.0:1789996441.167616:0:14442:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789996441.167635:0:14442:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22000/0x4173739f0fc81bbb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b97003095e35992 expref: -99 pid: 14442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996441.167720:0:14442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23e00/0x4173739f0fc81bc2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996441.167735:0:14442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23e00/0x4173739f0fc81bc2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996441.167748:0:14442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23e00/0x4173739f0fc81bc2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14442 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789996441.167782:0:14442:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789996441.167786:0:14442:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789996441.167803:0:14442:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23e00/0x4173739f0fc81bc2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996441.167826:0:14442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22000/0x4173739f0fc81bbb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35992 expref: 7 pid: 14442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996441.167845:0:14442:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23e00/0x4173739f0fc81bc2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35992 expref: 6 pid: 14442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996441.167854:0:14442:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e0850c28400) 00010000:00010000:1.0:1789996441.167857:0:14442:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789996441.167861:0:14442:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e0876a23e00, rc 0) 00000100:00100000:1.0:1789996441.167989:0:14442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0849c75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c25af0be-8577-4dc5-9864-cd7d07ede0af+6:14422:x1876946927599232:12345-192.168.204.37@tcp:101:lfs.0 Request processed in 393us (652us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996441.167997:0:14442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 21 00000100:00100000:3.0:1789996441.173167:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996441.173326:0:14443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927599360 00000100:00100000:0.0:1789996441.173336:0:14443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927599360 00000100:00100000:0.0:1789996441.173452:0:14443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 22 00000100:00100000:0.0:1789996441.173465:0:14443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0849c74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c25af0be-8577-4dc5-9864-cd7d07ede0af+6:14422:x1876946927599360:12345-192.168.204.37@tcp:101:lfs.0 00010000:00010000:0.0:1789996441.173497:0:14443:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789996441.173519:0:14443:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7000/0x4173739f0fc81bc9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b97003095e35999 expref: -99 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996441.173625:0:14443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7200/0x4173739f0fc81bd0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996441.173641:0:14443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7200/0x4173739f0fc81bd0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996441.173653:0:14443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7200/0x4173739f0fc81bd0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996441.173668:0:14443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6000/0x4173739f0fc81bd7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996441.173676:0:14443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6000/0x4173739f0fc81bd7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996441.173683:0:14443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6000/0x4173739f0fc81bd7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996441.173936:0:14443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7e00/0x4173739f0fc81bde lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996441.173945:0:14443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7e00/0x4173739f0fc81bde lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996441.173966:0:14443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7e00/0x4173739f0fc81bde lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14443 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789996441.173996:0:14443:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789996441.174000:0:14443:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789996441.174022:0:14443:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7e00/0x4173739f0fc81bde lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996441.174035:0:14443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7200/0x4173739f0fc81bd0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996441.174043:0:14443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7200/0x4173739f0fc81bd0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996441.174051:0:14443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7200/0x4173739f0fc81bd0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996441.174057:0:14443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e086fcb7200 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:0.0:1789996441.174061:0:14443:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7200/0x4173739f0fc81bd0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996441.174069:0:14443:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7200/0x4173739f0fc81bd0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996441.174080:0:14443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e0850c28400) 00010000:00010000:0.0:1789996441.174085:0:14443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789996441.174090:0:14443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7200/0x4173739f0fc81bd0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996441.174097:0:14443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7200/0x4173739f0fc81bd0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996441.174122:0:14443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6000/0x4173739f0fc81bd7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996441.174129:0:14443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6000/0x4173739f0fc81bd7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996441.174135:0:14443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6000/0x4173739f0fc81bd7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996441.174141:0:14443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e086fcb6000 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:0.0:1789996441.174144:0:14443:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6000/0x4173739f0fc81bd7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996441.174151:0:14443:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6000/0x4173739f0fc81bd7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996441.174159:0:14443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8e084c1e5e00) 00010000:00010000:0.0:1789996441.174162:0:14443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789996441.174165:0:14443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6000/0x4173739f0fc81bd7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996441.174171:0:14443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6000/0x4173739f0fc81bd7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996441.174204:0:14443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7000/0x4173739f0fc81bc9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35999 expref: 8 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996441.174218:0:14443:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7e00/0x4173739f0fc81bde lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35999 expref: 7 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996441.174237:0:14443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8e084c1e5200) 00010000:00010000:0.0:1789996441.174239:0:14443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789996441.174242:0:14443:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e086fcb7e00, rc 0) 00000100:00100000:0.0:1789996441.174395:0:14443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0849c74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c25af0be-8577-4dc5-9864-cd7d07ede0af+7:14422:x1876946927599360:12345-192.168.204.37@tcp:101:lfs.0 Request processed in 932us (1237us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996441.174403:0:14443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 22 00000100:00100000:0.0:1789996441.179471:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996441.179592:0:14441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927599616 00000100:00100000:2.0:1789996441.179603:0:14441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927599616 00000100:00100000:2.0:1789996441.179654:0:14441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 23 00000100:00100000:2.0:1789996441.179664:0:14441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0880f7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c25af0be-8577-4dc5-9864-cd7d07ede0af+7:14422:x1876946927599616:12345-192.168.204.37@tcp:101:lfs.0 00010000:00010000:2.0:1789996441.179690:0:14441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789996441.179712:0:14441:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5b600/0x4173739f0fc81be5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b97003095e359a0 expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789996441.179799:0:14441:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1789996441.179929:0:14441:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5b600/0x4173739f0fc81be5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e359a0 expref: 9 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996441.179950:0:14441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e0850c28400) 00010000:00010000:2.0:1789996441.179954:0:14441:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789996441.179960:0:14441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5b600/0x4173739f0fc81be5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e359a0 expref: 9 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996441.179973:0:14441:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e0741a5b600, rc 0) 00000100:00100000:2.0:1789996441.180039:0:14441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0880f7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c25af0be-8577-4dc5-9864-cd7d07ede0af+8:14422:x1876946927599616:12345-192.168.204.37@tcp:101:lfs.0 Request processed in 376us (578us total) trans 8589934595 rc 301/301 00000100:00100000:2.0:1789996441.180067:0:14441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 23 00000100:00100000:3.0:1789996441.183324:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996441.183502:0:14443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927599872 00000100:00100000:0.0:1789996441.183512:0:14443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927599872 00000100:00100000:0.0:1789996441.183592:0:14443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 24 00000100:00100000:0.0:1789996441.183604:0:14443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0849c74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c25af0be-8577-4dc5-9864-cd7d07ede0af+8:14422:x1876946927599872:12345-192.168.204.37@tcp:36:lfs.0 00010000:00010000:0.0:1789996441.183669:0:14443:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789996441.183705:0:14443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7e00/0x4173739f0fc81bde lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35999 expref: 8 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996441.183724:0:14443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8e084c1e5200) 00010000:00010000:0.0:1789996441.183735:0:14443:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789996441.183758:0:14443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7000/0x4173739f0fc81bf3 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996441.183771:0:14443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7000/0x4173739f0fc81bf3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996441.183781:0:14443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7000/0x4173739f0fc81bf3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14443 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789996441.183981:0:14443:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000afade824 reply state 00000000f84987cc transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7000/0x4173739f0fc81bf3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14443 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789996441.184004:0:14443:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1789996441.184012:0:14443:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1789996441.184113:0:14443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0849c74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c25af0be-8577-4dc5-9864-cd7d07ede0af+9:14422:x1876946927599872:12345-192.168.204.37@tcp:36:lfs.0 Request processed in 511us (798us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1789996441.184121:0:14443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 24 00010000:00010000:0.0:1789996441.185905:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7000/0x4173739f0fc81bf3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996441.185921:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7000/0x4173739f0fc81bf3 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996441.185928:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7000/0x4173739f0fc81bf3 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996441.185935:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e086fcb7000 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:0.0:1789996441.185939:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7000/0x4173739f0fc81bf3 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996441.185947:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7000/0x4173739f0fc81bf3 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996441.185962:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8e084c1e5e00) 00010000:00010000:0.0:1789996441.185965:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1789996441.185970:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7000/0x4173739f0fc81bf3 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996441.185977:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7000/0x4173739f0fc81bf3 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14443 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789996441.187019:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996441.187079:0:14445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927600128 00000100:00100000:2.0:1789996441.187087:0:14445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927600128 00000100:00100000:2.0:1789996441.187192:0:14445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 2 00000100:00100000:2.0:1789996441.187202:0:14445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0849c75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c25af0be-8577-4dc5-9864-cd7d07ede0af+8:14422:x1876946927600128:12345-192.168.204.37@tcp:35:lfs.0 00000100:00100000:2.0:1789996441.187421:0:14445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0849c75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c25af0be-8577-4dc5-9864-cd7d07ede0af+9:14422:x1876946927600128:12345-192.168.204.37@tcp:35:lfs.0 Request processed in 213us (403us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1789996441.187428:0:14445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 2 00000100:00100000:3.0:1789996441.191966:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996441.192095:0:14441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927600384 00000100:00100000:2.0:1789996441.192106:0:14441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927600384 00000100:00100000:2.0:1789996441.192176:0:14441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 25 00000100:00100000:2.0:1789996441.192188:0:14441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0849c74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c25af0be-8577-4dc5-9864-cd7d07ede0af+9:14422:x1876946927600384:12345-192.168.204.37@tcp:101:lfs.0 00010000:00010000:2.0:1789996441.192211:0:14441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789996441.192230:0:14441:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5b600/0x4173739f0fc81bfa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b97003095e359a7 expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996441.192854:0:14441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5bc00/0x4173739f0fc81c01 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996441.192870:0:14441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5bc00/0x4173739f0fc81c01 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996441.192883:0:14441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5bc00/0x4173739f0fc81c01 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996441.192898:0:14441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5a600/0x4173739f0fc81c08 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996441.192927:0:14441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5a600/0x4173739f0fc81c08 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996441.192935:0:14441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5a600/0x4173739f0fc81c08 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789996441.193037:0:14441:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1789996441.193123:0:14441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5bc00/0x4173739f0fc81c01 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996441.193131:0:14441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5bc00/0x4173739f0fc81c01 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996441.193137:0:14441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5bc00/0x4173739f0fc81c01 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996441.193143:0:14441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0741a5bc00 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:2.0:1789996441.193147:0:14441:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5bc00/0x4173739f0fc81c01 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996441.193155:0:14441:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5bc00/0x4173739f0fc81c01 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996441.193167:0:14441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e0850c28400) 00010000:00010000:2.0:1789996441.193170:0:14441:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789996441.193175:0:14441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5bc00/0x4173739f0fc81c01 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996441.193182:0:14441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5bc00/0x4173739f0fc81c01 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996441.193205:0:14441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5a600/0x4173739f0fc81c08 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996441.193212:0:14441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5a600/0x4173739f0fc81c08 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996441.193218:0:14441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5a600/0x4173739f0fc81c08 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996441.193224:0:14441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0741a5a600 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:2.0:1789996441.193227:0:14441:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5a600/0x4173739f0fc81c08 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996441.193233:0:14441:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5a600/0x4173739f0fc81c08 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996441.193291:0:14441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8e0850c28e00) 00010000:00010000:2.0:1789996441.193294:0:14441:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789996441.193298:0:14441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5a600/0x4173739f0fc81c08 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996441.193303:0:14441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5a600/0x4173739f0fc81c08 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996441.193365:0:14441:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5b600/0x4173739f0fc81bfa lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e359a7 expref: 11 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996441.193376:0:14441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e0850c28400) 00010000:00010000:2.0:1789996441.193379:0:14441:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789996441.193390:0:14441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5b600/0x4173739f0fc81bfa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e359a7 expref: 11 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996441.193400:0:14441:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e0741a5b600, rc 0) 00000100:00100000:2.0:1789996441.193474:0:14441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0849c74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c25af0be-8577-4dc5-9864-cd7d07ede0af+10:14422:x1876946927600384:12345-192.168.204.37@tcp:101:lfs.0 Request processed in 1289us (1521us total) trans 8589934598 rc 301/301 00000100:00100000:2.0:1789996441.193482:0:14441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 25 00000100:00100000:0.0:1789996441.198983:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996441.200127:0:14443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927600512 00000100:00100000:2.0:1789996441.200140:0:14443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927600512 00000100:00100000:2.0:1789996441.200290:0:14443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 26 00000100:00100000:2.0:1789996441.200301:0:14443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0880f79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c25af0be-8577-4dc5-9864-cd7d07ede0af+10:14422:x1876946927600512:12345-192.168.204.37@tcp:101:lfs.0 00010000:00010000:2.0:1789996441.200338:0:14443:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789996441.200365:0:14443:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5a200/0x4173739f0fc81c16 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b97003095e359ae expref: -99 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996441.200476:0:14443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5ac00/0x4173739f0fc81c1d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996441.200491:0:14443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5ac00/0x4173739f0fc81c1d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996441.200503:0:14443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5ac00/0x4173739f0fc81c1d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14443 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789996441.200539:0:14443:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789996441.200562:0:14443:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789996441.200592:0:14443:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5ac00/0x4173739f0fc81c1d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996441.200619:0:14443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5a200/0x4173739f0fc81c16 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e359ae expref: 12 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996441.200663:0:14443:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5ac00/0x4173739f0fc81c1d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e359ae expref: 11 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996441.200672:0:14443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8e0850c28300) 00010000:00010000:2.0:1789996441.200675:0:14443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789996441.200679:0:14443:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e0741a5ac00, rc 0) 00000100:00100000:2.0:1789996441.200748:0:14443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0880f79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c25af0be-8577-4dc5-9864-cd7d07ede0af+11:14422:x1876946927600512:12345-192.168.204.37@tcp:101:lfs.0 Request processed in 449us (1776us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996441.200756:0:14443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 26 00000100:00100000:3.0:1789996441.207438:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1789996441.208138:0:14444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927600640 00000100:00100000:1.0:1789996441.208148:0:14444:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927600640 00000100:00100000:1.0:1789996441.208251:0:14444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 3 00000100:00100000:1.0:1789996441.208262:0:14444:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0849c77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c25af0be-8577-4dc5-9864-cd7d07ede0af+11:14422:x1876946927600640:12345-192.168.204.37@tcp:37:lfs.0 00000100:00100000:1.0:1789996441.223282:0:14444:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0849c77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c25af0be-8577-4dc5-9864-cd7d07ede0af+11:14422:x1876946927600640:12345-192.168.204.37@tcp:37:lfs.0 Request processed in 15011us (15921us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996441.223296:0:14444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 3 00000100:00100000:0.0:1789996441.228275:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996441.228481:0:14445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927600896 00000100:00100000:2.0:1789996441.228492:0:14445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927600896 00000100:00100000:2.0:1789996441.228638:0:14445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 4 00000100:00100000:2.0:1789996441.228649:0:14445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0870a6fc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c25af0be-8577-4dc5-9864-cd7d07ede0af+11:14422:x1876946927600896:12345-192.168.204.37@tcp:35:lfs.0 00000100:00100000:2.0:1789996441.228878:0:14445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0870a6fc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c25af0be-8577-4dc5-9864-cd7d07ede0af+12:14422:x1876946927600896:12345-192.168.204.37@tcp:35:lfs.0 Request processed in 231us (612us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1789996441.228886:0:14445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 4 00000100:00100000:3.0:1789996441.289066:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996441.289283:0:14441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927601024 00000100:00100000:2.0:1789996441.289294:0:14441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927601024 00000100:00100000:2.0:1789996441.289371:0:14441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 27 00000100:00100000:2.0:1789996441.289381:0:14441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0849c76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:504eef0e-44e7-471d-93df-2fb9c0c14b08+10:14428:x1876946927601024:12345-192.168.204.37@tcp:101:bash.0 00010000:00010000:2.0:1789996441.289402:0:14441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789996441.289443:0:14441:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5a200/0x4173739f0fc81c24 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b97003095e359b5 expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996441.289827:0:14441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5b600/0x4173739f0fc81c2b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996441.289855:0:14441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5b600/0x4173739f0fc81c2b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996441.289868:0:14441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5b600/0x4173739f0fc81c2b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996441.289882:0:14441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5a600/0x4173739f0fc81c32 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996441.289888:0:14441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5a600/0x4173739f0fc81c32 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996441.289894:0:14441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5a600/0x4173739f0fc81c32 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996441.290102:0:14441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5bc00/0x4173739f0fc81c39 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996441.290110:0:14441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5bc00/0x4173739f0fc81c39 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996441.290117:0:14441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5bc00/0x4173739f0fc81c39 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789996441.290144:0:14441:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789996441.290148:0:14441:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789996441.290186:0:14441:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5bc00/0x4173739f0fc81c39 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996441.290197:0:14441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5b600/0x4173739f0fc81c2b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996441.290213:0:14441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5b600/0x4173739f0fc81c2b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996441.290220:0:14441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5b600/0x4173739f0fc81c2b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996441.290226:0:14441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0741a5b600 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:2.0:1789996441.290229:0:14441:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5b600/0x4173739f0fc81c2b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996441.290304:0:14441:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5b600/0x4173739f0fc81c2b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996441.290319:0:14441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e0850c28400) 00010000:00010000:2.0:1789996441.290322:0:14441:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789996441.290401:0:14441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5b600/0x4173739f0fc81c2b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996441.290408:0:14441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5b600/0x4173739f0fc81c2b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996441.290589:0:14441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5a600/0x4173739f0fc81c32 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996441.290597:0:14441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5a600/0x4173739f0fc81c32 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996441.290603:0:14441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5a600/0x4173739f0fc81c32 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996441.290609:0:14441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0741a5a600 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:2.0:1789996441.290619:0:14441:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5a600/0x4173739f0fc81c32 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996441.290696:0:14441:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5a600/0x4173739f0fc81c32 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996441.290704:0:14441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8e0850c28e00) 00010000:00010000:2.0:1789996441.290707:0:14441:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789996441.290711:0:14441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5a600/0x4173739f0fc81c32 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996441.290717:0:14441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5a600/0x4173739f0fc81c32 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996441.290759:0:14441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5a200/0x4173739f0fc81c24 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e359b5 expref: 12 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996441.290773:0:14441:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5bc00/0x4173739f0fc81c39 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e359b5 expref: 11 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996441.290904:0:14441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8e0850c28300) 00010000:00010000:2.0:1789996441.290907:0:14441:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789996441.290911:0:14441:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e0741a5bc00, rc 0) 00000100:00100000:2.0:1789996441.292280:0:14441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0849c76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:504eef0e-44e7-471d-93df-2fb9c0c14b08+11:14428:x1876946927601024:12345-192.168.204.37@tcp:101:bash.0 Request processed in 2893us (3216us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996441.292289:0:14441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 27 00000100:00100000:3.0:1789996441.296088:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996441.296230:0:14443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927601280 00000100:00100000:2.0:1789996441.296252:0:14443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927601280 00000100:00100000:2.0:1789996441.296322:0:14443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 28 00000100:00100000:2.0:1789996441.296333:0:14443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0849c76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:504eef0e-44e7-471d-93df-2fb9c0c14b08+11:14428:x1876946927601280:12345-192.168.204.37@tcp:101:bash.0 00010000:00010000:2.0:1789996441.296373:0:14443:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789996441.296395:0:14443:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5b400/0x4173739f0fc81c40 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b97003095e359bc expref: -99 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996441.296575:0:14443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5a000/0x4173739f0fc81c47 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996441.296592:0:14443:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5ac00/0x4173739f0fc81c1d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e359ae expref: 11 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996441.296601:0:14443:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5a000/0x4173739f0fc81c47 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996441.296879:0:14443:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5ac00/0x4173739f0fc81c1d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e359ae expref: 11 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996441.296895:0:14443:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5ac00/0x4173739f0fc81c1d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e359ae expref: 11 pid: 14443 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789996441.296909:0:14443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086d7f1880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14443:1876946942266880:192.168.204.37@tcp:104: 00000100:00100000:2.0:1789996441.297019:0:14443:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0870487540 going to sleep for 11 seconds 00000100:00100000:0.0:1789996441.300844:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1789996441.300941:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927601408 00000100:00100000:3.0:1789996441.300950:0:14426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927601408 00010000:00010000:3.0:1789996441.301001:0:14426:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5ac00/0x4173739f0fc81c1d lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e359ae expref: 12 pid: 14443 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789996441.301056:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 10 00000100:00100000:3.0:1789996441.301066:0:14426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0880f78700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c25af0be-8577-4dc5-9864-cd7d07ede0af+12:2363:x1876946927601408:12345-192.168.204.37@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789996441.301082:0:14426:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789996441.301089:0:14426:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5ac00/0x4173739f0fc81c1d lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e359ae expref: 12 pid: 14443 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996441.301102:0:14426:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5ac00/0x4173739f0fc81c1d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e359ae expref: 12 pid: 14443 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996441.301125:0:14426:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8e0850c28300) 00010000:00010000:3.0:1789996441.301130:0:14426:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5a000/0x4173739f0fc81c47 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996441.301140:0:14426:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5a000/0x4173739f0fc81c47 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996441.301148:0:14426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5a000/0x4173739f0fc81c47 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996441.301170:0:14426:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789996441.301216:0:14426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0880f78700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c25af0be-8577-4dc5-9864-cd7d07ede0af+12:2363:x1876946927601408:12345-192.168.204.37@tcp:103:ldlm_bl.0 Request processed in 152us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996441.301223:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 10 00010000:00010000:2.0:1789996441.301855:0:14443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5ac00/0x4173739f0fc81c1d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e359ae expref: 11 pid: 14443 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789996441.301872:0:14443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086d7f1880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14443:1876946942266880:192.168.204.37@tcp:104: 00010000:00010000:2.0:1789996441.301892:0:14443:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5a000/0x4173739f0fc81c47 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996441.301913:0:14443:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5a000/0x4173739f0fc81c47 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996441.301919:0:14443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5a000/0x4173739f0fc81c47 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996441.301942:0:14443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5aa00/0x4173739f0fc81c4e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996441.301951:0:14443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5aa00/0x4173739f0fc81c4e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996441.301959:0:14443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5aa00/0x4173739f0fc81c4e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996441.305426:0:14443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5a200/0x4173739f0fc81c55 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996441.305456:0:14443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5a200/0x4173739f0fc81c55 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996441.305468:0:14443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5a200/0x4173739f0fc81c55 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14443 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789996441.305493:0:14443:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1789996441.305531:0:14443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5a000/0x4173739f0fc81c47 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996441.305538:0:14443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5a000/0x4173739f0fc81c47 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996441.305582:0:14443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5a000/0x4173739f0fc81c47 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996441.305602:0:14443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0741a5a000 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:2.0:1789996441.305607:0:14443:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5a000/0x4173739f0fc81c47 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996441.305615:0:14443:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5a000/0x4173739f0fc81c47 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996441.305638:0:14443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8e0850c28300) 00010000:00010000:2.0:1789996441.305641:0:14443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789996441.305645:0:14443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5a000/0x4173739f0fc81c47 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996441.305651:0:14443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5a000/0x4173739f0fc81c47 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14443 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789996441.305663:0:14443:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c4bf7d0e reply state 0000000029e84a0f transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5aa00/0x4173739f0fc81c4e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14443 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789996441.305671:0:14443:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789996441.305711:0:14443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5b400/0x4173739f0fc81c40 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e359bc expref: 14 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996441.305726:0:14443:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5a200/0x4173739f0fc81c55 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e359bc expref: 13 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996441.305733:0:14443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e0850c28e00) 00010000:00010000:2.0:1789996441.305736:0:14443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1789996441.305738:0:14443:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e0741a5a200, rc 0) 00000100:00100000:2.0:1789996441.305825:0:14443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0849c76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:504eef0e-44e7-471d-93df-2fb9c0c14b08+14:14428:x1876946927601280:12345-192.168.204.37@tcp:101:bash.0 Request processed in 9494us (9746us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1789996441.305840:0:14443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 28 00010000:00010000:1.0:1789996441.312883:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5aa00/0x4173739f0fc81c4e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996441.312904:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5aa00/0x4173739f0fc81c4e lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996441.312913:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5aa00/0x4173739f0fc81c4e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996441.312920:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0741a5aa00 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:1.0:1789996441.312924:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5aa00/0x4173739f0fc81c4e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996441.312933:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5aa00/0x4173739f0fc81c4e lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996441.313130:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8e0850c28d00) 00010000:00010000:1.0:1789996441.313133:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789996441.313139:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5aa00/0x4173739f0fc81c4e lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996441.313146:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5aa00/0x4173739f0fc81c4e lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14443 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789996441.325966:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996441.326083:0:14441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927601536 00000100:00100000:2.0:1789996441.326093:0:14441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927601536 00000100:00100000:2.0:1789996441.326153:0:14441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 29 00000100:00100000:2.0:1789996441.326164:0:14441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0849c77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:504eef0e-44e7-471d-93df-2fb9c0c14b08+13:14428:x1876946927601536:12345-192.168.204.37@tcp:101:bash.0 00010000:00010000:2.0:1789996441.326188:0:14441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789996441.326209:0:14441:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5b400/0x4173739f0fc81c63 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b97003095e359c3 expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996441.326298:0:14441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5a000/0x4173739f0fc81c6a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996441.326313:0:14441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5a000/0x4173739f0fc81c6a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996441.326325:0:14441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5a000/0x4173739f0fc81c6a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789996441.326368:0:14441:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1789996441.326372:0:14441:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789996441.326392:0:14441:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5a000/0x4173739f0fc81c6a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996441.326402:0:14441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5a000/0x4173739f0fc81c6a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996441.327322:0:14441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5b400/0x4173739f0fc81c63 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e359c3 expref: 15 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996441.327346:0:14441:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5a000/0x4173739f0fc81c6a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e359c3 expref: 14 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996441.327372:0:14441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e0850c28e00) 00010000:00010000:2.0:1789996441.327375:0:14441:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789996441.327379:0:14441:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e0741a5a000, rc 0) 00000100:00100000:3.0:1789996441.327726:0:14441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0849c77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:504eef0e-44e7-471d-93df-2fb9c0c14b08+14:14428:x1876946927601536:12345-192.168.204.37@tcp:101:bash.0 Request processed in 1562us (1767us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996441.327735:0:14441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 29 00000100:00100000:0.0:1789996441.332585:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1789996441.332819:0:14444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927601792 00000100:00100000:1.0:1789996441.332841:0:14444:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927601792 00000100:00100000:1.0:1789996441.332904:0:14444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 5 00000100:00100000:1.0:1789996441.332914:0:14444:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0880f78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:504eef0e-44e7-471d-93df-2fb9c0c14b08+14:14428:x1876946927601792:12345-192.168.204.37@tcp:35:bash.0 00000001:00080000:1.0:1789996441.333461:0:14444:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 8589934601 00000100:00100000:1.0:1789996441.333758:0:14444:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0880f78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:504eef0e-44e7-471d-93df-2fb9c0c14b08+16:14428:x1876946927601792:12345-192.168.204.37@tcp:35:bash.0 Request processed in 844us (1220us total) trans 8589934602 rc 0/0 00000100:00100000:1.0:1789996441.333767:0:14444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 5 00000020:00080000:1.0:1789996441.333772:0:14444:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789996441.435671:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996441.437363:0:14443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927602048 00000100:00100000:2.0:1789996441.437377:0:14443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927602048 00000100:00100000:2.0:1789996441.437464:0:14443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 30 00000100:00100000:2.0:1789996441.437485:0:14443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0880f79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:504eef0e-44e7-471d-93df-2fb9c0c14b08+16:14438:x1876946927602048:12345-192.168.204.37@tcp:101:lfs.0 00010000:00010000:2.0:1789996441.437511:0:14443:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789996441.437533:0:14443:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5b400/0x4173739f0fc81c71 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b97003095e359ca expref: -99 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789996441.437664:0:14443:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1789996441.437778:0:14443:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5b400/0x4173739f0fc81c71 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e359ca expref: 18 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996441.437791:0:14443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e0850c28400) 00010000:00010000:2.0:1789996441.437794:0:14443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789996441.437799:0:14443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5b400/0x4173739f0fc81c71 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e359ca expref: 18 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996441.437812:0:14443:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e0741a5b400, rc 0) 00000100:00100000:2.0:1789996441.437883:0:14443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0880f79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:504eef0e-44e7-471d-93df-2fb9c0c14b08+17:14438:x1876946927602048:12345-192.168.204.37@tcp:101:lfs.0 Request processed in 410us (2224us total) trans 8589934603 rc 301/301 00000100:00100000:2.0:1789996441.437890:0:14443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 30 00000100:00100000:3.0:1789996441.443775:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996441.444451:0:14445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927602304 00000100:00100000:2.0:1789996441.444486:0:14445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927602304 00000100:00100000:2.0:1789996441.444629:0:14445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 6 00000100:00100000:2.0:1789996441.444641:0:14445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0849c74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:504eef0e-44e7-471d-93df-2fb9c0c14b08+17:14438:x1876946927602304:12345-192.168.204.37@tcp:35:lfs.0 00000100:00100000:2.0:1789996441.444880:0:14445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0849c74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:504eef0e-44e7-471d-93df-2fb9c0c14b08+18:14438:x1876946927602304:12345-192.168.204.37@tcp:35:lfs.0 Request processed in 241us (1114us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1789996441.444888:0:14445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 6 00000100:00100000:0.0:1789996441.512875:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1789996441.512974:0:14441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927602560 00000100:00100000:3.0:1789996441.512984:0:14441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927602560 00000100:00100000:3.0:1789996441.513075:0:14441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 31 00000100:00100000:3.0:1789996441.513085:0:14441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0880f79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:504eef0e-44e7-471d-93df-2fb9c0c14b08+18:14441:x1876946927602560:12345-192.168.204.37@tcp:101:lfs.0 00010000:00010000:3.0:1789996441.513109:0:14441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789996441.513130:0:14441:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0841524000/0x4173739f0fc81c7f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b97003095e359d1 expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996441.513227:0:14441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0841525600/0x4173739f0fc81c86 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996441.513249:0:14441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0841525600/0x4173739f0fc81c86 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996441.513261:0:14441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0841525600/0x4173739f0fc81c86 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14441 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789996441.513271:0:14441:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1789996441.513411:0:14441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0841524000/0x4173739f0fc81c7f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e359d1 expref: 21 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996441.513442:0:14441:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0841525600/0x4173739f0fc81c86 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e359d1 expref: 20 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996441.513450:0:14441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e0850c28e00) 00010000:00010000:3.0:1789996441.513452:0:14441:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789996441.513456:0:14441:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e0841525600, rc 0) 00000100:00100000:3.0:1789996441.513521:0:14441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0880f79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:504eef0e-44e7-471d-93df-2fb9c0c14b08+20:14441:x1876946927602560:12345-192.168.204.37@tcp:101:lfs.0 Request processed in 437us (658us total) trans 8589934605 rc 0/0 00000100:00100000:3.0:1789996441.513580:0:14441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 31 00000100:00100000:0.0:1789996441.526974:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996441.527023:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1789996441.527705:0:14442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927602688 00000100:00100000:3.0:1789996441.527716:0:14442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927602688 00000100:00100000:3.0:1789996441.527783:0:14442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 32 00000100:00100000:3.0:1789996441.527793:0:14442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0880f7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:504eef0e-44e7-471d-93df-2fb9c0c14b08+20:14441:x1876946927602688:12345-192.168.204.37@tcp:54:lfs.0 00010000:00010000:3.0:1789996441.527862:0:14442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0841524000/0x4173739f0fc81c94 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996441.527879:0:14442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0841524000/0x4173739f0fc81c94 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996441.527889:0:14442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0841524000/0x4173739f0fc81c94 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996441.527914:0:14442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0841524000/0x4173739f0fc81c94 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996441.527921:0:14442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0841524000/0x4173739f0fc81c94 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996441.527927:0:14442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e0841524000/0x4173739f0fc81c94 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996441.527933:0:14442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0841524000 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:3.0:1789996441.527938:0:14442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0841524000/0x4173739f0fc81c94 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996441.527945:0:14442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0841524000/0x4173739f0fc81c94 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996441.527956:0:14442:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e0850c28e00) 00010000:00010000:3.0:1789996441.527970:0:14442:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789996441.527975:0:14442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e0841524000/0x4173739f0fc81c94 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996441.527981:0:14442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0841524000/0x4173739f0fc81c94 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14442 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789996441.528162:0:14442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0880f7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:504eef0e-44e7-471d-93df-2fb9c0c14b08+20:14441:x1876946927602688:12345-192.168.204.37@tcp:54:lfs.0 Request processed in 369us (1197us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996441.528171:0:14442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 32 00000100:00100000:2.0:1789996441.528258:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927602816 00000100:00100000:2.0:1789996441.528264:0:14427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927602816 00000100:00100000:2.0:1789996441.528305:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 0 00000100:00100000:2.0:1789996441.528313:0:14427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0880f7a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:504eef0e-44e7-471d-93df-2fb9c0c14b08+20:2364:x1876946927602816:12345-192.168.204.37@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789996441.528336:0:14427:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789996441.528351:0:14427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0841525600/0x4173739f0fc81c86 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e359d1 expref: 20 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996441.528364:0:14427:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e0850c28e00) 00010000:00010000:2.0:1789996441.528367:0:14427:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789996441.528388:0:14427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0880f7a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:504eef0e-44e7-471d-93df-2fb9c0c14b08+19:2364:x1876946927602816:12345-192.168.204.37@tcp:103:ldlm_bl.0 Request processed in 77us (1365us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996441.528394:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 0 00000100:00100000:1.0:1789996441.539417:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1789996441.539629:0:14444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927603072 00000100:00100000:3.0:1789996441.539640:0:14444:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927603072 00000100:00100000:3.0:1789996441.539697:0:14444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 7 00000100:00100000:3.0:1789996441.539707:0:14444:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086f889f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:504eef0e-44e7-471d-93df-2fb9c0c14b08+19:14441:x1876946927603072:12345-192.168.204.37@tcp:35:lfs.0 00000100:00100000:3.0:1789996441.539937:0:14444:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086f889f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:504eef0e-44e7-471d-93df-2fb9c0c14b08+20:14441:x1876946927603072:12345-192.168.204.37@tcp:35:lfs.0 Request processed in 230us (530us total) trans 8589934606 rc 0/0 00000100:00100000:3.0:1789996441.539945:0:14444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 7 00010000:00010000:2.0:1789996441.640868:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789996441.819345:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996441.819444:0:14443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927603328 00000100:00100000:2.0:1789996441.819454:0:14443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927603328 00000100:00100000:2.0:1789996441.819520:0:14443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 33 00000100:00100000:2.0:1789996441.819531:0:14443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0880f7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:504eef0e-44e7-471d-93df-2fb9c0c14b08+20:14472:x1876946927603328:12345-192.168.204.37@tcp:101:cat.0 00010000:00010000:2.0:1789996441.819576:0:14443:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789996441.819596:0:14443:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5b400/0x4173739f0fc81c9b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b97003095e359d8 expref: -99 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996441.819712:0:14443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5ac00/0x4173739f0fc81ca2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996441.819726:0:14443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5ac00/0x4173739f0fc81ca2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996441.819736:0:14443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5ac00/0x4173739f0fc81ca2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14443 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789996441.819747:0:14443:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1789996441.819878:0:14443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5b400/0x4173739f0fc81c9b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e359d8 expref: 23 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996441.819895:0:14443:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5ac00/0x4173739f0fc81ca2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e359d8 expref: 22 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996441.819904:0:14443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e0850c28e00) 00010000:00010000:2.0:1789996441.819908:0:14443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789996441.819911:0:14443:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e0741a5ac00, rc 0) 00000100:00100000:2.0:1789996441.819969:0:14443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0880f7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:504eef0e-44e7-471d-93df-2fb9c0c14b08+22:14472:x1876946927603328:12345-192.168.204.37@tcp:101:cat.0 Request processed in 440us (635us total) trans 8589934607 rc 0/0 00000100:00100000:2.0:1789996441.819977:0:14443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 33 00000100:00100000:0.0:1789996441.824630:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1789996441.824726:0:14428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927603456 00000100:00100000:1.0:1789996441.824736:0:14428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927603456 00000100:00100000:1.0:1789996441.824801:0:14428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 1 00000100:00100000:1.0:1789996441.824812:0:14428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0880f7b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:504eef0e-44e7-471d-93df-2fb9c0c14b08+22:2363:x1876946927603456:12345-192.168.204.37@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789996441.824829:0:14428:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789996441.824853:0:14428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5ac00/0x4173739f0fc81ca2 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e359d8 expref: 22 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996441.824870:0:14428:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e0850c28e00) 00010000:00010000:1.0:1789996441.824875:0:14428:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789996441.824934:0:14428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0880f7b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:504eef0e-44e7-471d-93df-2fb9c0c14b08+21:2363:x1876946927603456:12345-192.168.204.37@tcp:103:ldlm_bl.0 Request processed in 124us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996441.824941:0:14428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 1 00000100:00100000:3.0:1789996441.828611:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1789996441.828823:0:14444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927603712 00000100:00100000:1.0:1789996441.828833:0:14444:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927603712 00000100:00100000:1.0:1789996441.828894:0:14444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 8 00000100:00100000:1.0:1789996441.828905:0:14444:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0849c75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:504eef0e-44e7-471d-93df-2fb9c0c14b08+21:14472:x1876946927603712:12345-192.168.204.37@tcp:35:cat.0 00000100:00100000:1.0:1789996441.829319:0:14444:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0849c75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:504eef0e-44e7-471d-93df-2fb9c0c14b08+22:14472:x1876946927603712:12345-192.168.204.37@tcp:35:cat.0 Request processed in 415us (717us total) trans 8589934608 rc 0/0 00000100:00100000:1.0:1789996441.829341:0:14444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 8 00000100:00100000:0.0:1789996441.887642:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1789996441.887988:0:14442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927603968 00000100:00100000:1.0:1789996441.888001:0:14442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927603968 00000100:00100000:1.0:1789996441.888070:0:14442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 34 00000100:00100000:1.0:1789996441.888081:0:14442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0880f78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:504eef0e-44e7-471d-93df-2fb9c0c14b08+22:14478:x1876946927603968:12345-192.168.204.37@tcp:101:dd.0 00010000:00010000:1.0:1789996441.888105:0:14442:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789996441.888127:0:14442:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22a00/0x4173739f0fc81cb0 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b97003095e359df expref: -99 pid: 14442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996441.888443:0:14442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22600/0x4173739f0fc81cb7 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996441.888461:0:14442:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5a200/0x4173739f0fc81c55 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e359bc expref: 23 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996441.888779:0:14442:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5a000/0x4173739f0fc81c6a lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e359c3 expref: 23 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996441.888787:0:14442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22600/0x4173739f0fc81cb7 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996441.888826:0:14442:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5a000/0x4173739f0fc81c6a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e359c3 expref: 23 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996441.888840:0:14442:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5a000/0x4173739f0fc81c6a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e359c3 expref: 23 pid: 14441 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789996441.888854:0:14442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086f889500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14442:1876946942267008:192.168.204.37@tcp:104: 00010000:00010000:1.0:1789996441.889041:0:14442:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5a200/0x4173739f0fc81c55 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e359bc expref: 23 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996441.889051:0:14442:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5a200/0x4173739f0fc81c55 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e359bc expref: 23 pid: 14443 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789996441.889061:0:14442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086f888700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14442:1876946942267136:192.168.204.37@tcp:104: 00000100:00100000:1.0:1789996441.889086:0:14442:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e087663b600 going to sleep for 11 seconds 00000100:00100000:0.0:1789996441.894822:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996441.894854:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1789996441.895053:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927604096 00000100:00100000:3.0:1789996441.895064:0:14426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927604096 00010000:00010000:3.0:1789996441.895103:0:14426:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5a000/0x4173739f0fc81c6a lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e359c3 expref: 24 pid: 14441 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789996441.895143:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927604224 00000100:00100000:3.0:1789996441.895146:0:14426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927604224 00010000:00010000:3.0:1789996441.895159:0:14426:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5a200/0x4173739f0fc81c55 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e359bc expref: 25 pid: 14443 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789996441.895173:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 11 00000100:00100000:3.0:1789996441.895197:0:14426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e074138f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:504eef0e-44e7-471d-93df-2fb9c0c14b08+25:2362:x1876946927604096:12345-192.168.204.37@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789996441.895213:0:14426:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789996441.895221:0:14426:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5a000/0x4173739f0fc81c6a lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e359c3 expref: 25 pid: 14441 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996441.895246:0:14426:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5a000/0x4173739f0fc81c6a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e359c3 expref: 25 pid: 14441 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996441.895270:0:14426:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e0850c28e00) 00010000:00010000:3.0:1789996441.895275:0:14426:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22600/0x4173739f0fc81cb7 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996441.895283:0:14426:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22600/0x4173739f0fc81cb7 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996441.895290:0:14426:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789996441.895358:0:14426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e074138f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:504eef0e-44e7-471d-93df-2fb9c0c14b08+25:2362:x1876946927604096:12345-192.168.204.37@tcp:103:ldlm_bl.0 Request processed in 163us (547us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996441.895366:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 11 00000100:00100000:3.0:1789996441.895411:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 12 00000100:00100000:3.0:1789996441.895428:0:14426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0880f79500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:504eef0e-44e7-471d-93df-2fb9c0c14b08+24:2362:x1876946927604224:12345-192.168.204.37@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789996441.895437:0:14426:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789996441.895442:0:14426:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5a200/0x4173739f0fc81c55 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e359bc expref: 24 pid: 14443 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996441.895450:0:14426:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5a200/0x4173739f0fc81c55 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e359bc expref: 24 pid: 14443 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996441.895485:0:14426:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e0850c28e00) 00010000:00010000:3.0:1789996441.895490:0:14426:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22600/0x4173739f0fc81cb7 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996441.895498:0:14426:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22600/0x4173739f0fc81cb7 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996441.895513:0:14426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22600/0x4173739f0fc81cb7 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996441.895530:0:14426:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789996441.895575:0:14426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0880f79500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:504eef0e-44e7-471d-93df-2fb9c0c14b08+24:2362:x1876946927604224:12345-192.168.204.37@tcp:103:ldlm_bl.0 Request processed in 157us (720us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996441.895581:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 12 00000100:00100000:3.0:1789996441.900141:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1789996441.900181:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1789996441.900217:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1789996441.900256:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1789996441.900280:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1789996441.900302:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996441.900320:0:15124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927604480 00000100:00100000:2.0:1789996441.900332:0:15124:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927604480 00000100:00100000:3.0:1789996441.900333:0:14436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927604352 00000100:00100000:3.0:1789996441.900336:0:14436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927604352 00000100:00100000:2.0:1789996441.900369:0:15124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927604992 00000100:00100000:2.0:1789996441.900371:0:15124:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927604992 00000100:00100000:3.0:1789996441.900374:0:14436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 119 00000100:00100000:3.0:1789996441.900384:0:14436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0877ad2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50790d52-45a2-4d53-a399-c22b3a6afc1a+13:2364:x1876946927604352:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:2.0:1789996441.900385:0:15124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927604608 00000100:00100000:2.0:1789996441.900387:0:15124:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927604608 00000100:00100000:2.0:1789996441.900428:0:15124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927604864 00000100:00100000:2.0:1789996441.900432:0:15124:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927604864 00000100:00100000:2.0:1789996441.900447:0:15124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 10 00000100:00100000:2.0:1789996441.900454:0:15124:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0849c76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:504eef0e-44e7-471d-93df-2fb9c0c14b08+5:2364:x1876946927604480:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:3.0:1789996441.900460:0:14436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0877ad2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:50790d52-45a2-4d53-a399-c22b3a6afc1a+13:2364:x1876946927604352:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 77us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996441.900479:0:14436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 119 00000100:00100000:2.0:1789996441.900481:0:15124:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0849c76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:504eef0e-44e7-471d-93df-2fb9c0c14b08+5:2364:x1876946927604480:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 29us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996441.900488:0:15124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 10 00000100:00100000:2.0:1789996441.900506:0:15124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 11 00000100:00100000:2.0:1789996441.900512:0:15124:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0849c75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c25af0be-8577-4dc5-9864-cd7d07ede0af+5:2364:x1876946927604992:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:2.0:1789996441.900539:0:15124:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0849c75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c25af0be-8577-4dc5-9864-cd7d07ede0af+5:2364:x1876946927604992:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 27us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996441.900579:0:15124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 11 00000100:00100000:2.0:1789996441.900591:0:15124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 12 00000100:00100000:2.0:1789996441.900597:0:15124:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0849c76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:504eef0e-44e7-471d-93df-2fb9c0c14b08+5:2364:x1876946927604608:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:2.0:1789996441.900617:0:15124:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0849c76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:504eef0e-44e7-471d-93df-2fb9c0c14b08+5:2364:x1876946927604608:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 21us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996441.900622:0:15124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 12 00000100:00100000:2.0:1789996441.900633:0:15124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 13 00000100:00100000:2.0:1789996441.900639:0:15124:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0849c75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c25af0be-8577-4dc5-9864-cd7d07ede0af+5:2364:x1876946927604864:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:2.0:1789996441.900674:0:15124:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0849c75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c25af0be-8577-4dc5-9864-cd7d07ede0af+5:2364:x1876946927604864:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 35us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996441.900680:0:15124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 13 00000100:00080000:2.0:1789996441.900702:0:14437:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789996441.900706:0:14437:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789996441.901118:0:14441:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1789996441.901127:0:14441:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1789996441.901571:0:14441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927604736 00000100:00100000:2.0:1789996441.901577:0:14441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927604736 00000100:00100000:2.0:1789996441.901612:0:14441:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1789996441.901621:0:14441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 21 00000100:00100000:2.0:1789996441.901628:0:14441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0849c77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c25af0be-8577-4dc5-9864-cd7d07ede0af+11:2364:x1876946927604736:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:2.0:1789996441.901938:0:14441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0849c77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c25af0be-8577-4dc5-9864-cd7d07ede0af+11:2364:x1876946927604736:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 309us (1755us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996441.901945:0:14441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 21 00010000:00010000:1.0:1789996441.903680:0:14442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5a000/0x4173739f0fc81c6a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e359c3 expref: 23 pid: 14441 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789996441.903704:0:14442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086f889500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14442:1876946942267008:192.168.204.37@tcp:104: 00010000:00010000:1.0:1789996441.903720:0:14442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5a200/0x4173739f0fc81c55 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e359bc expref: 22 pid: 14443 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789996441.903730:0:14442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086f888700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14442:1876946942267136:192.168.204.37@tcp:104: 00010000:00010000:1.0:1789996441.903755:0:14442:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22600/0x4173739f0fc81cb7 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996441.903765:0:14442:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22600/0x4173739f0fc81cb7 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996441.903771:0:14442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22600/0x4173739f0fc81cb7 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14442 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789996441.903844:0:14442:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1789996441.904010:0:14442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22a00/0x4173739f0fc81cb0 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e359df expref: 23 pid: 14442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996441.904044:0:14442:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22600/0x4173739f0fc81cb7 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e359df expref: 22 pid: 14442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996441.904054:0:14442:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e0850c28e00) 00010000:00010000:1.0:1789996441.904057:0:14442:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789996441.904060:0:14442:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e0876a22600, rc 0) 00000100:00100000:1.0:1789996441.904103:0:14442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0880f78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:504eef0e-44e7-471d-93df-2fb9c0c14b08+22:14478:x1876946927603968:12345-192.168.204.37@tcp:101:dd.0 Request processed in 16024us (16471us total) trans 8589934609 rc 0/0 00000100:00100000:1.0:1789996441.904111:0:14442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 34 00000100:00100000:3.0:1789996441.919376:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996441.919733:0:16670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927605248 00000100:00100000:0.0:1789996441.919743:0:16670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927605248 00000100:00100000:0.0:1789996441.919807:0:16670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 35 00000100:00100000:0.0:1789996441.919819:0:16670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0849c74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:504eef0e-44e7-471d-93df-2fb9c0c14b08+22:14478:x1876946927605248:12345-192.168.204.37@tcp:36:dd.0 00010000:00010000:0.0:1789996441.920078:0:16670:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7200/0x4173739f0fc81cc5 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996441.920095:0:16670:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7200/0x4173739f0fc81cc5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996441.920107:0:16670:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7200/0x4173739f0fc81cc5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16670 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789996441.920158:0:16670:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 8589934610 00000004:00010000:0.0:1789996441.920182:0:16670:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004bbaef70 reply state 00000000caa47bf7 transno 8589934611 ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7200/0x4173739f0fc81cc5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16670 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789996441.920210:0:16670:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789996441.921562:0:16670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0849c74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:504eef0e-44e7-471d-93df-2fb9c0c14b08+25:14478:x1876946927605248:12345-192.168.204.37@tcp:36:dd.0 Request processed in 1717us (2168us total) trans 8589934611 rc 0/0 00000100:00100000:0.0:1789996441.921574:0:16670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 35 00000020:00080000:0.0:1789996441.921581:0:16670:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789996441.925035:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7200/0x4173739f0fc81cc5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996441.925054:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7200/0x4173739f0fc81cc5 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996441.925062:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7200/0x4173739f0fc81cc5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996441.925069:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e086fcb7200 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:3.0:1789996441.925074:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7200/0x4173739f0fc81cc5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996441.925082:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7200/0x4173739f0fc81cc5 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996441.925098:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e0850c28e00) 00010000:00010000:3.0:1789996441.925102:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789996441.925107:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7200/0x4173739f0fc81cc5 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996441.925114:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7200/0x4173739f0fc81cc5 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16670 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789996441.930438:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996441.930514:0:14441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927605376 00000100:00100000:2.0:1789996441.930524:0:14441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927605376 00000100:00100000:2.0:1789996441.930624:0:14441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 36 00000100:00100000:2.0:1789996441.930636:0:14441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0849c77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:504eef0e-44e7-471d-93df-2fb9c0c14b08+24:14478:x1876946927605376:12345-192.168.204.37@tcp:101:dd.0 00010000:00010000:2.0:1789996441.930674:0:14441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789996441.930696:0:14441:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5a600/0x4173739f0fc81ccc lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b97003095e359e6 expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996441.930760:0:14441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5a600/0x4173739f0fc81ccc lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e359e6 expref: 25 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996441.930775:0:14441:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5a600/0x4173739f0fc81ccc lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e359e6 expref: 25 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996441.930795:0:14441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e0850c28e00) 00010000:00010000:2.0:1789996441.930799:0:14441:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789996441.930802:0:14441:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e0741a5a600, rc 0) 00000100:00100000:2.0:1789996441.930853:0:14441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0849c77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:504eef0e-44e7-471d-93df-2fb9c0c14b08+25:14478:x1876946927605376:12345-192.168.204.37@tcp:101:dd.0 Request processed in 220us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996441.930876:0:14441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 36 00000100:00100000:0.0:1789996441.960320:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1789996441.962429:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927605632 00000100:00100000:3.0:1789996441.962444:0:14426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927605632 00000100:00100000:3.0:1789996441.962529:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 2 00000100:00100000:3.0:1789996441.962573:0:14426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0880f78700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:504eef0e-44e7-471d-93df-2fb9c0c14b08+25:14478:x1876946927605632:12345-192.168.204.37@tcp:103:dd.0 00010000:00010000:3.0:1789996441.962590:0:14426:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789996441.962628:0:14426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5a600/0x4173739f0fc81ccc lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e359e6 expref: 25 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996441.962647:0:14426:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e0850c28e00) 00010000:00010000:3.0:1789996441.962653:0:14426:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789996441.962721:0:14426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0880f78700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:504eef0e-44e7-471d-93df-2fb9c0c14b08+24:14478:x1876946927605632:12345-192.168.204.37@tcp:103:dd.0 Request processed in 184us (2411us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996441.962729:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 2 00000100:00100000:0.0:1789996441.967356:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996441.967459:0:14443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927605760 00000100:00100000:2.0:1789996441.967480:0:14443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927605760 00000100:00100000:2.0:1789996441.967587:0:14443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 37 00000100:00100000:2.0:1789996441.967597:0:14443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0880f7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:504eef0e-44e7-471d-93df-2fb9c0c14b08+24:14478:x1876946927605760:12345-192.168.204.37@tcp:58:dd.0 00010000:00010000:2.0:1789996441.967703:0:14443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5b600/0x4173739f0fc81cd3 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996441.967720:0:14443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5b600/0x4173739f0fc81cd3 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996441.967732:0:14443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5b600/0x4173739f0fc81cd3 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14443 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789996441.968446:0:14443:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789996441.968623:0:14443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:2.0:1789996441.968700:0:14443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:2.0:1789996441.968799:0:14443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0880f7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:504eef0e-44e7-471d-93df-2fb9c0c14b08+24:14478:x1876946927605760:12345-192.168.204.37@tcp:58:dd.0 Request processed in 1201us (1450us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996441.968808:0:14443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 37 00000100:00100000:1.0:1789996441.974810:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996441.974888:0:14441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927605888 00000100:00100000:2.0:1789996441.974898:0:14441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927605888 00000100:00100000:2.0:1789996441.974963:0:14441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 38 00000100:00100000:2.0:1789996441.974974:0:14441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086f888700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:504eef0e-44e7-471d-93df-2fb9c0c14b08+24:14478:x1876946927605888:12345-192.168.204.37@tcp:101:dd.0 00010000:00010000:2.0:1789996441.974993:0:14441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789996441.975012:0:14441:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5b200/0x4173739f0fc81cda lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b97003095e359ed expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996441.975087:0:14441:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5b600/0x4173739f0fc81cd3 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996441.975098:0:14441:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5b200/0x4173739f0fc81cda lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e359ed expref: 25 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996441.975116:0:14441:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5b600/0x4173739f0fc81cd3 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996441.975129:0:14441:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5b200/0x4173739f0fc81cda lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e359ed expref: 25 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996441.975160:0:14441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e0850c28e00) 00010000:00010000:2.0:1789996441.975163:0:14441:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789996441.975167:0:14441:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5b200/0x4173739f0fc81cda lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e359ed expref: 25 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996441.975175:0:14441:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e0741a5b200, rc 0) 00000100:00100000:2.0:1789996441.975232:0:14441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086f888700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:504eef0e-44e7-471d-93df-2fb9c0c14b08+25:14478:x1876946927605888:12345-192.168.204.37@tcp:101:dd.0 Request processed in 251us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996441.975238:0:14441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 38 00000040:00080000:3.0:1789996442.025764:0:14475:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1789996442.025774:0:14475:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789996442.025831:0:14475:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1789996442.025839:0:14475:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1789996442.025965:0:14475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086fa92a00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14475:1876946942267264:192.168.204.37@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789996442.026092:0:14475:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0848997600 going to sleep for 11 seconds 00000100:00100000:3.0:1789996442.032606:0:14475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086fa92a00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14475:1876946942267264:192.168.204.37@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789996442.034297:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1789996442.034502:0:14452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927606016 00000100:00100000:1.0:1789996442.034511:0:14452:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927606016 00000100:00080000:2.0:1789996442.034630:0:14437:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789996442.034734:0:14452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 0 00000100:00100000:1.0:1789996442.034745:0:14452:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0880f7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:504eef0e-44e7-471d-93df-2fb9c0c14b08+25:14479:x1876946927606016:12345-192.168.204.37@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1789996442.034824:0:14452:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0880f7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:504eef0e-44e7-471d-93df-2fb9c0c14b08+25:14479:x1876946927606016:12345-192.168.204.37@tcp:900:lhsmtool_posix.0 Request processed in 81us (534us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996442.034832:0:14452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 0 00000100:00100000:1.0:1789996442.040200:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996442.040353:0:14443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927606144 00000100:00100000:2.0:1789996442.040363:0:14443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927606144 00000100:00100000:2.0:1789996442.040485:0:14443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 39 00000100:00100000:2.0:1789996442.040496:0:14443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086f889500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:504eef0e-44e7-471d-93df-2fb9c0c14b08+25:14479:x1876946927606144:12345-192.168.204.37@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789996442.040529:0:14443:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789996442.040738:0:14443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086f889500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:504eef0e-44e7-471d-93df-2fb9c0c14b08+25:14479:x1876946927606144:12345-192.168.204.37@tcp:53:lhsmtool_posix.0 Request processed in 243us (546us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996442.040746:0:14443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 39 00000100:00100000:3.0:1789996442.051260:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1789996442.051474:0:14442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927606272 00000100:00100000:1.0:1789996442.051485:0:14442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927606272 00000100:00100000:1.0:1789996442.051574:0:14442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 40 00000100:00100000:1.0:1789996442.051587:0:14442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fa92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:504eef0e-44e7-471d-93df-2fb9c0c14b08+25:14479:x1876946927606272:12345-192.168.204.37@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1789996442.051738:0:14442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23600/0x4173739f0fc81ce1 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996442.051773:0:14442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23600/0x4173739f0fc81ce1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996442.051785:0:14442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23600/0x4173739f0fc81ce1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996442.051840:0:14442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22400/0x4173739f0fc81ce8 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996442.051849:0:14442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22400/0x4173739f0fc81ce8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996442.051856:0:14442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22400/0x4173739f0fc81ce8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996442.051878:0:14442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22e00/0x4173739f0fc81cef lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996442.051887:0:14442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22e00/0x4173739f0fc81cef lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996442.051894:0:14442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22e00/0x4173739f0fc81cef lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14442 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789996442.051931:0:14442:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1789996442.051935:0:14442:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789996442.051951:0:14442:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22e00/0x4173739f0fc81cef lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996442.051961:0:14442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23600/0x4173739f0fc81ce1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996442.051977:0:14442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23600/0x4173739f0fc81ce1 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996442.051984:0:14442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23600/0x4173739f0fc81ce1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996442.051991:0:14442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0876a23600 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:1.0:1789996442.051995:0:14442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23600/0x4173739f0fc81ce1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996442.052003:0:14442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23600/0x4173739f0fc81ce1 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996442.052015:0:14442:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e0850c28b00) 00010000:00010000:1.0:1789996442.052018:0:14442:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789996442.052023:0:14442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23600/0x4173739f0fc81ce1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996442.052029:0:14442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23600/0x4173739f0fc81ce1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996442.052042:0:14442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22400/0x4173739f0fc81ce8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996442.052047:0:14442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22400/0x4173739f0fc81ce8 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996442.052052:0:14442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22400/0x4173739f0fc81ce8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996442.052058:0:14442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0876a22400 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:1.0:1789996442.052067:0:14442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22400/0x4173739f0fc81ce8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996442.052073:0:14442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22400/0x4173739f0fc81ce8 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996442.052081:0:14442:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff8e0861fcfa00) 00010000:00010000:1.0:1789996442.052083:0:14442:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789996442.052086:0:14442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22400/0x4173739f0fc81ce8 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996442.052714:0:14442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22400/0x4173739f0fc81ce8 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996442.052735:0:14442:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22e00/0x4173739f0fc81cef lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996442.052740:0:14442:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22e00/0x4173739f0fc81cef lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996442.052746:0:14442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22e00/0x4173739f0fc81cef lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996442.052750:0:14442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0876a22e00 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:1.0:1789996442.052754:0:14442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22e00/0x4173739f0fc81cef lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996442.052759:0:14442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22e00/0x4173739f0fc81cef lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996442.052767:0:14442:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e0850c28e00) 00010000:00010000:1.0:1789996442.052770:0:14442:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789996442.052780:0:14442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22e00/0x4173739f0fc81cef lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996442.052786:0:14442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22e00/0x4173739f0fc81cef lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14442 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789996442.052872:0:14442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fa92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:504eef0e-44e7-471d-93df-2fb9c0c14b08+25:14479:x1876946927606272:12345-192.168.204.37@tcp:34:lhsmtool_posix.0 Request processed in 1286us (1618us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996442.052880:0:14442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 40 00000100:00100000:3.0:1789996442.061882:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996442.062109:0:16670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927606528 00000100:00100000:0.0:1789996442.062119:0:16670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927606528 00000100:00100000:0.0:1789996442.062183:0:16670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 41 00000100:00100000:0.0:1789996442.062194:0:16670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fa92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:504eef0e-44e7-471d-93df-2fb9c0c14b08+25:14479:x1876946927606528:12345-192.168.204.37@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789996442.062214:0:16670:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789996442.062232:0:16670:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7e00/0x4173739f0fc81cf6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b97003095e359f4 expref: -99 pid: 16670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996442.064579:0:16670:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7000/0x4173739f0fc81cfd lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996442.064609:0:16670:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7000/0x4173739f0fc81cfd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996442.064622:0:16670:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7000/0x4173739f0fc81cfd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16670 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789996442.064637:0:16670:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1789996442.064740:0:16670:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7000/0x4173739f0fc81cfd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996442.064767:0:16670:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7000/0x4173739f0fc81cfd lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996442.064772:0:16670:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7000/0x4173739f0fc81cfd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996442.064778:0:16670:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e086fcb7000 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:0.0:1789996442.064782:0:16670:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7000/0x4173739f0fc81cfd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996442.064790:0:16670:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7000/0x4173739f0fc81cfd lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996442.064801:0:16670:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e0850c28e00) 00010000:00010000:0.0:1789996442.064804:0:16670:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789996442.064808:0:16670:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7000/0x4173739f0fc81cfd lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996442.064814:0:16670:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7000/0x4173739f0fc81cfd lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996442.064867:0:16670:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7e00/0x4173739f0fc81cf6 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e359f4 expref: 27 pid: 16670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996442.064878:0:16670:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e0850c28b00) 00010000:00010000:0.0:1789996442.064880:0:16670:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789996442.064884:0:16670:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7e00/0x4173739f0fc81cf6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e359f4 expref: 27 pid: 16670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996442.064893:0:16670:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e086fcb7e00, rc 0) 00000100:00100000:0.0:1789996442.068213:0:16670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fa92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:504eef0e-44e7-471d-93df-2fb9c0c14b08+26:14479:x1876946927606528:12345-192.168.204.37@tcp:101:lhsmtool_posix.0 Request processed in 2780us (3101us total) trans 8589934612 rc 301/301 00000100:00100000:0.0:1789996442.068230:0:16670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 41 00000100:00100000:1.0:1789996442.070382:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996442.070690:0:14441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927606656 00000100:00100000:2.0:1789996442.070700:0:14441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927606656 00000100:00100000:2.0:1789996442.070757:0:14441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 42 00000100:00100000:2.0:1789996442.070767:0:14441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086f889c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:504eef0e-44e7-471d-93df-2fb9c0c14b08+26:14479:x1876946927606656:12345-192.168.204.37@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789996442.070812:0:14441:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789996442.070921:0:14441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086f889c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:504eef0e-44e7-471d-93df-2fb9c0c14b08+26:14479:x1876946927606656:12345-192.168.204.37@tcp:53:lhsmtool_posix.0 Request processed in 155us (547us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996442.070939:0:14441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 42 00000100:00100000:3.0:1789996442.075101:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996442.080098:0:14443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927606912 00000100:00100000:0.0:1789996442.080115:0:14443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927606912 00000100:00100000:0.0:1789996442.080188:0:14443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 43 00000100:00100000:0.0:1789996442.080200:0:14443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fc9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:504eef0e-44e7-471d-93df-2fb9c0c14b08+26:14479:x1876946927606912:12345-192.168.204.37@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789996442.080219:0:14443:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789996442.080239:0:14443:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6000/0x4173739f0fc81d0b lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b97003095e359fb expref: -99 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789996442.081382:0:14443:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000400:0x7:0x0], count =27 00000004:00080000:0.0:1789996442.081390:0:14443:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000400:0x7:0x0]+27 in llog 00000004:00080000:0.0:1789996442.081444:0:14443:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x22:0x0], index 1: 0 00010000:00010000:0.0:1789996442.083787:0:14443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7e00/0x4173739f0fc81d12 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996442.083807:0:14443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7e00/0x4173739f0fc81d12 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996442.083819:0:14443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7e00/0x4173739f0fc81d12 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996442.083876:0:14443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb6000/0x4173739f0fc81d0b lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e359fb expref: 29 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996442.083893:0:14443:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7e00/0x4173739f0fc81d12 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e359fb expref: 28 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996442.083915:0:14443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8e084c1e5e00) 00010000:00010000:0.0:1789996442.083918:0:14443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789996442.083922:0:14443:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e086fcb7e00, rc 0) 00000100:00100000:0.0:1789996442.084809:0:14443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fc9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:504eef0e-44e7-471d-93df-2fb9c0c14b08+28:14479:x1876946927606912:12345-192.168.204.37@tcp:101:lhsmtool_posix.0 Request processed in 4606us (9712us total) trans 8589934613 rc 0/0 00000100:00100000:0.0:1789996442.084819:0:14443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 43 00000100:00100000:2.0:1789996442.089998:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086d7f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876946942267392:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789996442.090083:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996442.090411:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0876a69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876946942267648:0@lo:400:kworker.0 00000100:00100000:0.0:1789996442.090453:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996442.090490:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789996442.090496:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0876a6b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876946942267776:0@lo:400:kworker.0 00000100:00100000:0.0:1789996442.090529:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789996442.090575:0:15124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942267648 00000100:00100000:0.0:1789996442.090583:0:15124:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942267648 00000100:00100000:0.0:1789996442.090637:0:15124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789996442.090646:0:15124:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0876a6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1876946942267648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789996442.090695:0:15124:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0876a6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1876946942267648:12345-0@lo:400:kworker.0 Request processed in 50us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996442.090702:0:15124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:0.0:1789996442.090725:0:14437:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789996442.090753:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0876a69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876946942267648:0@lo:400:kworker.0 00000100:00100000:3.0:1789996442.091898:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0880f7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d64f88b3-32d6-473c-b613-b936200ef7a3:3314:1876946942267520:0@lo:400:kworker.0 00000100:00100000:3.0:1789996442.091947:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996442.092271:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1789996442.092299:0:14442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942267776 00000100:00100000:1.0:1789996442.092305:0:14442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942267776 00000100:00100000:3.0:1789996442.092608:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0876a68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3314:1876946942268032:0@lo:400:kworker.0 00000100:00100000:3.0:1789996442.092636:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789996442.092659:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789996442.092666:0:3314:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0876a69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3314:1876946942267904:0@lo:400:kworker.0 00000100:00100000:3.0:1789996442.092686:0:3314:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789996442.092716:0:15129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942267392 00000100:00100000:3.0:1789996442.092734:0:15129:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942267392 00000100:00100000:1.0:1789996442.093150:0:14442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927607168 00000100:00100000:1.0:1789996442.093154:0:14442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927607168 00000100:00100000:1.0:1789996442.093168:0:14442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942268032 00000100:00100000:1.0:1789996442.093171:0:14442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942268032 00000100:00100000:1.0:1789996442.093182:0:14442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942267904 00000100:00100000:1.0:1789996442.093184:0:14442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942267904 00000100:00100000:1.0:1789996442.093199:0:14442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789996442.093207:0:14442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0876a69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876946942267776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789996442.093263:0:14442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0876a69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1876946942267776:12345-0@lo:400:kworker.0 Request processed in 57us (2733us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996442.093269:0:14442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789996442.093284:0:14442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789996442.093290:0:14442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fc99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876946942268032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789996442.093681:0:14441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789996442.093690:0:14441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086fc98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876946942267904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789996442.093734:0:14441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fc98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1876946942267904:12345-0@lo:400:kworker.0 Request processed in 45us (1046us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996442.093740:0:14441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789996442.093775:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0876a69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3314:1876946942267904:0@lo:400:kworker.0 00000100:00100000:0.0:1789996442.093825:0:14443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 44 00000100:00100000:0.0:1789996442.093835:0:14443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086f88b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:504eef0e-44e7-471d-93df-2fb9c0c14b08+28:14479:x1876946927607168:12345-192.168.204.37@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789996442.093881:0:14443:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789996442.093907:0:14443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7e00/0x4173739f0fc81d12 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e359fb expref: 28 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996442.093934:0:14443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8e084c1e5e00) 00010000:00010000:0.0:1789996442.093946:0:14443:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789996442.093966:0:14443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7000/0x4173739f0fc81d20 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14443 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789996442.094093:0:14442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086fc99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1876946942268032:12345-0@lo:400:kworker.0 Request processed in 802us (1454us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996442.094100:0:14442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789996442.094151:0:15129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789996442.094159:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0876a6b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3315:1876946942267776:0@lo:400:kworker.0 00000100:00100000:3.0:1789996442.094166:0:15129:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086d7f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876946942267392:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789996442.094195:0:15129:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789996442.094250:0:15129:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086d7f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1876946942267392:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (4167us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996442.094257:0:15129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789996442.094279:0:14433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942267520 00000100:00100000:3.0:1789996442.094283:0:14433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942267520 00000100:00100000:3.0:1789996442.094307:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00010000:00010000:0.0:1789996442.094781:0:14443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7000/0x4173739f0fc81d20 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996442.094793:0:14443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7000/0x4173739f0fc81d20 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996442.094850:0:14443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7200/0x4173739f0fc81d27 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x937267d6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996442.094858:0:14443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7200/0x4173739f0fc81d27 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x937267d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996442.094865:0:14443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7200/0x4173739f0fc81d27 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x937267d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996442.094928:0:14443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7000/0x4173739f0fc81d20 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996442.094935:0:14443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7000/0x4173739f0fc81d20 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996442.094943:0:14443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7000/0x4173739f0fc81d20 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996442.094949:0:14443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e086fcb7000 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:0.0:1789996442.094954:0:14443:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7000/0x4173739f0fc81d20 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996442.094970:0:14443:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7000/0x4173739f0fc81d20 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14443 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789996442.094987:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086d7f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3313:1876946942267392:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789996442.095090:0:14433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0876ac4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d64f88b3-32d6-473c-b613-b936200ef7a3+19:3314:x1876946942267520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789996442.095136:0:14433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0876ac4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d64f88b3-32d6-473c-b613-b936200ef7a3+19:3314:x1876946942267520:12345-0@lo:400:kworker.0 Request processed in 49us (3188us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996442.095142:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00080000:3.0:1789996442.095175:0:14437:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789996442.095180:0:14437:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789996442.095323:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0876a68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3314:1876946942268032:0@lo:400:kworker.0 00000100:00100000:2.0:1789996442.095345:0:3314:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0880f7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d64f88b3-32d6-473c-b613-b936200ef7a3:3314:1876946942267520:0@lo:400:kworker.0 00010000:00010000:0.0:1789996442.095910:0:14443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8e0850c28300) 00010000:00010000:0.0:1789996442.095913:0:14443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789996442.095919:0:14443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7000/0x4173739f0fc81d20 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996442.095927:0:14443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7000/0x4173739f0fc81d20 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996442.095939:0:14443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7200/0x4173739f0fc81d27 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x937267d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996442.095946:0:14443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7200/0x4173739f0fc81d27 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x937267d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996442.095952:0:14443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7200/0x4173739f0fc81d27 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x937267d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996442.095958:0:14443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e086fcb7200 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:0.0:1789996442.095961:0:14443:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7200/0x4173739f0fc81d27 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x937267d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996442.095968:0:14443:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7200/0x4173739f0fc81d27 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x937267d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996442.095987:0:14443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x937267d6 (ffff8e084c1e5200) 00010000:00010000:0.0:1789996442.095990:0:14443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789996442.095993:0:14443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7200/0x4173739f0fc81d27 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x937267d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996442.096012:0:14443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e086fcb7200/0x4173739f0fc81d27 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x937267d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14443 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789996442.096105:0:14443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086f88b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:504eef0e-44e7-471d-93df-2fb9c0c14b08+27:14479:x1876946927607168:12345-192.168.204.37@tcp:36:lhsmtool_posix.0 Request processed in 2269us (3833us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789996442.096113:0:14443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 44 00000100:00100000:3.0:1789996442.098601:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996442.098715:0:14442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927607296 00000100:00100000:2.0:1789996442.098725:0:14442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927607296 00000100:00100000:2.0:1789996442.098789:0:14442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 45 00000100:00100000:2.0:1789996442.098800:0:14442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0881220380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:504eef0e-44e7-471d-93df-2fb9c0c14b08+27:14479:x1876946927607296:12345-192.168.204.37@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789996442.098834:0:14442:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789996442.098858:0:14442:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5b000/0x4173739f0fc81d2e lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b97003095e35a02 expref: -99 pid: 14442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996442.098895:0:14442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5a400/0x4173739f0fc81d35 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996442.098908:0:14442:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5a400/0x4173739f0fc81d35 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996442.098920:0:14442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5a400/0x4173739f0fc81d35 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14442 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996442.099197:0:14442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5b000/0x4173739f0fc81d2e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35a02 expref: 29 pid: 14442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996442.099215:0:14442:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5a400/0x4173739f0fc81d35 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35a02 expref: 28 pid: 14442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996442.099223:0:14442:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8e0850c28200) 00010000:00010000:2.0:1789996442.099225:0:14442:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789996442.099228:0:14442:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e0741a5a400, rc 0) 00000100:00100000:2.0:1789996442.099290:0:14442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0881220380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:504eef0e-44e7-471d-93df-2fb9c0c14b08+28:14479:x1876946927607296:12345-192.168.204.37@tcp:101:lhsmtool_posix.0 Request processed in 492us (697us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996442.099297:0:14442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 45 00000100:00100000:3.0:1789996442.104041:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996442.104827:0:16670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927607552 00000100:00100000:2.0:1789996442.104837:0:16670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927607552 00000100:00100000:2.0:1789996442.104937:0:16670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 46 00000100:00100000:2.0:1789996442.104948:0:16670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0881223480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:504eef0e-44e7-471d-93df-2fb9c0c14b08+28:14479:x1876946927607552:12345-192.168.204.37@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789996442.105059:0:16670:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5b800/0x4173739f0fc81d3c lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996442.105077:0:16670:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5b800/0x4173739f0fc81d3c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996442.105089:0:16670:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5b800/0x4173739f0fc81d3c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16670 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789996442.105428:0:16670:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:2.0:1789996442.105439:0:16670:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 483824895981ns, next at 484824893153ns, rc = 0 00000004:00010000:2.0:1789996442.105641:0:16670:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ec64381c reply state 000000002f2cbb64 transno 8589934614 ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5b800/0x4173739f0fc81d3c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16670 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789996442.105652:0:16670:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789996442.105748:0:16670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0881223480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:504eef0e-44e7-471d-93df-2fb9c0c14b08+30:14479:x1876946927607552:12345-192.168.204.37@tcp:36:lhsmtool_posix.0 Request processed in 801us (1714us total) trans 8589934614 rc 0/0 00000100:00100000:2.0:1789996442.105757:0:16670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 46 00010000:00010000:1.0:1789996442.109847:0:3300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5b800/0x4173739f0fc81d3c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996442.109865:0:3300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5b800/0x4173739f0fc81d3c lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996442.109873:0:3300:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5b800/0x4173739f0fc81d3c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996442.109881:0:3300:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0741a5b800 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:1.0:1789996442.109886:0:3300:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5b800/0x4173739f0fc81d3c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996442.109895:0:3300:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5b800/0x4173739f0fc81d3c lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996442.109913:0:3300:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8e0850c28200) 00010000:00010000:1.0:1789996442.109916:0:3300:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789996442.109921:0:3300:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5b800/0x4173739f0fc81d3c lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996442.109927:0:3300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5b800/0x4173739f0fc81d3c lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16670 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789996442.111446:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996442.116340:0:14443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927607680 00000100:00100000:0.0:1789996442.116357:0:14443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927607680 00000100:00100000:3.0:1789996442.116639:0:14441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 47 00000100:00100000:3.0:1789996442.116653:0:14441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0881221f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:504eef0e-44e7-471d-93df-2fb9c0c14b08+29:14479:x1876946927607680:12345-192.168.204.37@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789996442.116677:0:14441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789996442.116697:0:14441:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0841524000/0x4173739f0fc81d43 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b97003095e35a09 expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996442.116756:0:14441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0841524000/0x4173739f0fc81d43 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35a09 expref: 30 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996442.116791:0:14441:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0841524000/0x4173739f0fc81d43 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35a09 expref: 30 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996442.116812:0:14441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8e0850c28200) 00010000:00010000:3.0:1789996442.116816:0:14441:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789996442.116820:0:14441:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e0841524000, rc 0) 00000100:00100000:3.0:1789996442.116879:0:14441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0881221f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:504eef0e-44e7-471d-93df-2fb9c0c14b08+30:14479:x1876946927607680:12345-192.168.204.37@tcp:101:lhsmtool_posix.0 Request processed in 231us (5438us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996442.116887:0:14441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 47 00000100:00100000:3.0:1789996442.120168:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996442.120299:0:15125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927607808 00000100:00100000:0.0:1789996442.120317:0:15125:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927607808 00000100:00100000:0.0:1789996442.120369:0:15125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 12 00000100:00100000:0.0:1789996442.120379:0:15125:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0881223800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:504eef0e-44e7-471d-93df-2fb9c0c14b08+5:2363:x1876946927607808:12345-192.168.204.37@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1789996442.120777:0:15125:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0881223800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:504eef0e-44e7-471d-93df-2fb9c0c14b08+6:2363:x1876946927607808:12345-192.168.204.37@tcp:2:lhsmtool_posix.0 Request processed in 398us (617us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1789996442.120784:0:15125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 12 00000100:00100000:3.0:1789996442.123391:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996442.123515:0:14445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927608064 00000100:00100000:2.0:1789996442.123525:0:14445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927608064 00000100:00100000:2.0:1789996442.123610:0:14445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 9 00000100:00100000:2.0:1789996442.123621:0:14445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0881220e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:504eef0e-44e7-471d-93df-2fb9c0c14b08+30:14479:x1876946927608064:12345-192.168.204.37@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789996442.123830:0:14445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0881220e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:504eef0e-44e7-471d-93df-2fb9c0c14b08+31:14479:x1876946927608064:12345-192.168.204.37@tcp:35:lhsmtool_posix.0 Request processed in 210us (447us total) trans 8589934615 rc 0/0 00000100:00100000:2.0:1789996442.123837:0:14445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 9 00000100:00100000:2.0:1789996442.126689:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1789996442.126773:0:14441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927608320 00000100:00100000:3.0:1789996442.126836:0:14441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927608320 00000100:00100000:3.0:1789996442.126928:0:14441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 48 00000100:00100000:3.0:1789996442.126939:0:14441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086d7f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:504eef0e-44e7-471d-93df-2fb9c0c14b08+31:14479:x1876946927608320:12345-192.168.204.37@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789996442.127052:0:14441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086d7f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:504eef0e-44e7-471d-93df-2fb9c0c14b08+31:14479:x1876946927608320:12345-192.168.204.37@tcp:57:lhsmtool_posix.0 Request processed in 116us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996442.127060:0:14441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 48 00000100:00100000:0.0:1789996442.129686:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996442.129765:0:16670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927608448 00000100:00100000:2.0:1789996442.129774:0:16670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927608448 00000100:00100000:2.0:1789996442.130129:0:16670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 49 00000100:00100000:2.0:1789996442.130140:0:16670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0876a69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:504eef0e-44e7-471d-93df-2fb9c0c14b08+31:14479:x1876946927608448:12345-192.168.204.37@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789996442.130159:0:16670:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789996442.130178:0:16670:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5b800/0x4173739f0fc81d4a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b97003095e35a10 expref: -99 pid: 16670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996442.130240:0:16670:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5b000/0x4173739f0fc81d51 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996442.130255:0:16670:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5b000/0x4173739f0fc81d51 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996442.130266:0:16670:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5b000/0x4173739f0fc81d51 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16670 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789996442.130298:0:16670:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789996442.130641:0:16670:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5b000/0x4173739f0fc81d51 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996442.130669:0:16670:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5b800/0x4173739f0fc81d4a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35a10 expref: 33 pid: 16670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996442.130686:0:16670:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5b000/0x4173739f0fc81d51 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35a10 expref: 32 pid: 16670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996442.130695:0:16670:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8e0850c28200) 00010000:00010000:2.0:1789996442.130697:0:16670:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789996442.130701:0:16670:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e0741a5b000, rc 0) 00000100:00100000:2.0:1789996442.130832:0:16670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0876a69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:504eef0e-44e7-471d-93df-2fb9c0c14b08+32:14479:x1876946927608448:12345-192.168.204.37@tcp:101:lhsmtool_posix.0 Request processed in 694us (1152us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996442.130849:0:16670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 49 00000100:00100000:1.0:1789996442.133505:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996442.133582:0:15124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927608576 00000100:00100000:0.0:1789996442.133591:0:15124:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927608576 00000100:00100000:0.0:1789996442.133649:0:15124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 13 00000100:00100000:0.0:1789996442.133658:0:15124:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086f888000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:504eef0e-44e7-471d-93df-2fb9c0c14b08+6:2362:x1876946927608576:12345-192.168.204.37@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789996442.133674:0:15124:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789996442.133695:0:15124:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001401ea64/0x4173739f0fc81d58 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1b97003095e35a17 expref: -99 pid: 15124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789996442.133721:0:15124:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6ab12d9a, blocks: 0x1 00010000:00010000:0.0:1789996442.133738:0:15124:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=483s v=(0 0) 00010000:00010000:0.0:1789996442.133754:0:15124:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789996442.133763:0:15124:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001401ea64/0x4173739f0fc81d58 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35a17 expref: 7 pid: 15124 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996442.133782:0:15124:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001401ea64/0x4173739f0fc81d58 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35a17 expref: 7 pid: 15124 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996442.133794:0:15124:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e086fcb7000, rc 0) 00000100:00100000:0.0:1789996442.133849:0:15124:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086f888000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:504eef0e-44e7-471d-93df-2fb9c0c14b08+7:2362:x1876946927608576:12345-192.168.204.37@tcp:101:lhsmtool_posix.0 Request processed in 192us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996442.133856:0:15124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 13 00000100:00100000:3.0:1789996442.136245:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996442.136485:0:14443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927608832 00000100:00100000:0.0:1789996442.136494:0:14443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927608832 00000100:00100000:3.0:1789996442.136637:0:14441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 50 00000100:00100000:3.0:1789996442.136647:0:14441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0881222680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:504eef0e-44e7-471d-93df-2fb9c0c14b08+32:14479:x1876946927608832:12345-192.168.204.37@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789996442.136740:0:14441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0881222680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:504eef0e-44e7-471d-93df-2fb9c0c14b08+32:14479:x1876946927608832:12345-192.168.204.37@tcp:57:lhsmtool_posix.0 Request processed in 94us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996442.136746:0:14441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 50 00000100:00100000:3.0:1789996442.139143:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996442.139260:0:14442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927608960 00000100:00100000:2.0:1789996442.139269:0:14442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927608960 00000100:00100000:2.0:1789996442.139329:0:14442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 51 00000100:00100000:2.0:1789996442.139340:0:14442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0881221880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:504eef0e-44e7-471d-93df-2fb9c0c14b08+32:14479:x1876946927608960:12345-192.168.204.37@tcp:44:lhsmtool_posix.0 00000100:00100000:0.0:1789996442.177079:0:14442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0881221880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:504eef0e-44e7-471d-93df-2fb9c0c14b08+32:14479:x1876946927608960:12345-192.168.204.37@tcp:44:lhsmtool_posix.0 Request processed in 37730us (37931us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996442.177094:0:14442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 51 00000001:00080000:0.0:1789996442.177134:0:5868:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934613 is committed 00000001:00080000:0.0:1789996442.177146:0:5868:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934596 is committed 00000001:00080000:0.0:1789996442.177161:0:5868:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934615 is committed 00000004:00080000:0.0:1789996442.177169:0:5868:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:0.0:1789996442.177192:0:5868:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00100000:1.0:1789996442.177848:0:3316:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789996442.177862:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086f889880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876946942268160:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1789996442.177907:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996442.177970:0:15125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942268160 00000100:00100000:1.0:1789996442.177976:0:15125:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942268160 00000100:00100000:1.0:1789996442.178010:0:15125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789996442.178016:0:15125:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086f88b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1876946942268160:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1789996442.178142:0:15125:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1789996442.178145:0:15125:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1789996442.178146:0:15125:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1789996442.178148:0:15125:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1789996442 -> 1789996442 00002000:00010000:1.0:1789996442.178149:0:15125:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1789996442.178181:0:15125:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086f88b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3316:x1876946942268160:12345-0@lo:2:osp-syn-1-0.0 Request processed in 165us (273us total) trans 8589934595 rc 0/0 00000100:00100000:1.0:1789996442.178186:0:15125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000004:00080000:0.0:1789996442.178600:0:3316:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e086f889880/2, rc 0, transno 8589934595 00000100:00100000:0.0:1789996442.178608:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086f889880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3316:1876946942268160:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1789996442.180173:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996442.180308:0:15124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927609088 00000100:00100000:0.0:1789996442.180317:0:15124:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927609088 00000100:00100000:0.0:1789996442.180368:0:15124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 15 00000100:00100000:0.0:1789996442.180378:0:15124:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086f88ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:504eef0e-44e7-471d-93df-2fb9c0c14b08+7:2365:x1876946927609088:12345-192.168.204.37@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1789996442.180509:0:15124:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086f88ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:504eef0e-44e7-471d-93df-2fb9c0c14b08+7:2365:x1876946927609088:12345-192.168.204.37@tcp:16:lhsmtool_posix.0 Request processed in 132us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996442.180516:0:15124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 15 00000100:00100000:0.0:1789996442.182258:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996442.182327:0:16670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927609344 00000100:00100000:2.0:1789996442.182337:0:16670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927609344 00000100:00100000:2.0:1789996442.182394:0:16670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 52 00000100:00100000:2.0:1789996442.182405:0:16670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0876a69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:504eef0e-44e7-471d-93df-2fb9c0c14b08+14:14479:x1876946927609344:12345-192.168.204.37@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789996442.182464:0:16670:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789996442.182491:0:16670:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5b000/0x4173739f0fc81d51 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35a10 expref: 14 pid: 16670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996442.182526:0:16670:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8e0850c28200) 00010000:00010000:2.0:1789996442.182532:0:16670:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789996442.182605:0:16670:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5b800/0x4173739f0fc81d5f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996442.182616:0:16670:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5b800/0x4173739f0fc81d5f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996442.182624:0:16670:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5b800/0x4173739f0fc81d5f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16670 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789996442.182961:0:16670:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001c3be387 reply state 000000001b81c77b transno 8589934616 ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5b800/0x4173739f0fc81d5f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16670 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789996442.182971:0:16670:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789996442.183120:0:16670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0876a69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:504eef0e-44e7-471d-93df-2fb9c0c14b08+15:14479:x1876946927609344:12345-192.168.204.37@tcp:36:lhsmtool_posix.0 Request processed in 716us (868us total) trans 8589934616 rc 0/0 00000100:00100000:2.0:1789996442.183125:0:16670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 52 00010000:00010000:0.0:1789996442.184356:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5b800/0x4173739f0fc81d5f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996442.184368:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5b800/0x4173739f0fc81d5f lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996442.184375:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5b800/0x4173739f0fc81d5f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996442.184382:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0741a5b800 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:0.0:1789996442.184387:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5b800/0x4173739f0fc81d5f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996442.184395:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5b800/0x4173739f0fc81d5f lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996442.184407:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8e0850c28200) 00010000:00010000:0.0:1789996442.184422:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789996442.184427:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5b800/0x4173739f0fc81d5f lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996442.184433:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5b800/0x4173739f0fc81d5f lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16670 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789996442.184912:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1789996442.185001:0:15125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927609472 00000100:00100000:1.0:1789996442.185011:0:15125:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927609472 00000100:00100000:1.0:1789996442.185069:0:15125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 16 00000100:00100000:1.0:1789996442.185080:0:15125:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0876a68700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:504eef0e-44e7-471d-93df-2fb9c0c14b08+7:14479:x1876946927609472:12345-192.168.204.37@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789996442.185095:0:15125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789996442.185111:0:15125:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ad5ad946/0x4173739f0fc81d66 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1b97003095e35a1e expref: -99 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996442.185136:0:15125:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001401ea64/0x4173739f0fc81d58 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35a17 expref: 8 pid: 15124 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996442.185142:0:15125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789996442.185145:0:15125:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789996442.185149:0:15125:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ad5ad946/0x4173739f0fc81d66 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35a1e expref: 8 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996442.185188:0:15125:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001401ea64/0x4173739f0fc81d58 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35a17 expref: 8 pid: 15124 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996442.185202:0:15125:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001401ea64/0x4173739f0fc81d58 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35a17 expref: 8 pid: 15124 timeout: 583 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789996442.185216:0:15125:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086f88b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:15125:1876946942268288:192.168.204.37@tcp:104: 00000100:00100000:1.0:1789996442.185285:0:15125:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e087663be40 going to sleep for 11 seconds 00000100:00100000:1.0:1789996442.186908:0:15125:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086f88b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:15125:1876946942268288:192.168.204.37@tcp:104: 00010000:00010000:1.0:1789996442.186940:0:15125:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ad5ad946/0x4173739f0fc81d66 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35a1e expref: 8 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996442.186960:0:15125:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e0876a22800, rc 0) 00000100:00100000:1.0:1789996442.187011:0:15125:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0876a68700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:504eef0e-44e7-471d-93df-2fb9c0c14b08+8:14479:x1876946927609472:12345-192.168.204.37@tcp:101:lhsmtool_posix.0 Request processed in 1933us (2104us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996442.187019:0:15125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 16 00000100:00100000:3.0:1789996442.187245:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996442.187370:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927609600 00000100:00100000:0.0:1789996442.187384:0:14427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927609600 00010000:00010000:0.0:1789996442.187406:0:14427:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001401ea64/0x4173739f0fc81d58 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35a17 expref: 8 pid: 15124 timeout: 583 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789996442.187451:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 13 00000100:00100000:0.0:1789996442.187470:0:14427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0881220000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:504eef0e-44e7-471d-93df-2fb9c0c14b08+8:2363:x1876946927609600:12345-192.168.204.37@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789996442.187482:0:14427:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789996442.187512:0:14427:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001401ea64/0x4173739f0fc81d58 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35a17 expref: 8 pid: 15124 timeout: 583 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996442.187524:0:14427:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001401ea64/0x4173739f0fc81d58 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35a17 expref: 8 pid: 15124 timeout: 583 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996442.187581:0:14427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001401ea64/0x4173739f0fc81d58 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35a17 expref: 8 pid: 15124 timeout: 583 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996442.187599:0:14427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789996442.187603:0:14427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789996442.187610:0:14427:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ad5ad946/0x4173739f0fc81d66 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35a1e expref: 7 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996442.187620:0:14427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ad5ad946/0x4173739f0fc81d66 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35a1e expref: 7 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996442.187657:0:14427:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000ad5ad946/0x4173739f0fc81d66 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35a1e expref: 7 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789996442.187682:0:14427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0876a6b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:14427:1876946942268416:192.168.204.37@tcp:105: 00000100:00100000:0.0:1789996442.187739:0:14427:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e0842e040c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789996442.190122:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1789996442.190193:0:15124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927609728 00000100:00100000:1.0:1789996442.190202:0:15124:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927609728 00000100:00100000:2.0:1789996442.190239:0:14427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0876a6b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:14427:1876946942268416:192.168.204.37@tcp:105: 00000100:00100000:1.0:1789996442.190258:0:15124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 17 00010000:00010000:2.0:1789996442.190262:0:14427:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789996442.190270:0:15124:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0876a68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:504eef0e-44e7-471d-93df-2fb9c0c14b08+8:2362:x1876946927609728:12345-192.168.204.37@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1789996442.190319:0:14427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0881220000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:504eef0e-44e7-471d-93df-2fb9c0c14b08+8:2363:x1876946927609600:12345-192.168.204.37@tcp:103:ldlm_bl.0 Request processed in 2860us (3074us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996442.190327:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 13 00002000:00010000:1.0:1789996442.190483:0:15124:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1789996442.190487:0:15124:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1789996442 00002000:00010000:1.0:1789996442.190489:0:15124:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 1789996441 00002000:00010000:1.0:1789996442.190516:0:15124:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1789996442 -> 1789996442 00002000:00010000:1.0:1789996442.190519:0:15124:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1789996442.190581:0:15124:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0876a68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:504eef0e-44e7-471d-93df-2fb9c0c14b08+8:2362:x1876946927609728:12345-192.168.204.37@tcp:2:lhsmtool_posix.0 Request processed in 313us (468us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1789996442.190588:0:15124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 17 00000100:00100000:0.0:1789996442.192611:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1789996442.192683:0:15126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927609856 00000100:00100000:3.0:1789996442.192694:0:15126:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927609856 00000100:00100000:3.0:1789996442.192738:0:15126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 18 00000100:00100000:3.0:1789996442.192746:0:15126:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0876a6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:504eef0e-44e7-471d-93df-2fb9c0c14b08+8:2365:x1876946927609856:12345-192.168.204.37@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1789996442.192791:0:15126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000ee7f5cfc/0x4173739f0fc81d6d lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996442.192814:0:15126:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ad5ad946/0x4173739f0fc81d66 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35a1e expref: 8 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996442.192822:0:15126:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789996442.192826:0:15126:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789996442.192830:0:15126:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ee7f5cfc/0x4173739f0fc81d6d lrc: 4/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996442.192917:0:15126:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ad5ad946/0x4173739f0fc81d66 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35a1e expref: 8 pid: 15125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996442.192935:0:15126:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ad5ad946/0x4173739f0fc81d66 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35a1e expref: 8 pid: 15125 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789996442.192950:0:15126:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086f88b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:15126:1876946942268544:192.168.204.37@tcp:104: 00000100:00100000:1.0:1789996442.193026:0:15126:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e087663be40 going to sleep for 11 seconds 00000100:00100000:3.0:1789996442.194710:0:3306:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996442.194791:0:14428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927609984 00000100:00100000:2.0:1789996442.194798:0:14428:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927609984 00010000:00010000:2.0:1789996442.194825:0:14428:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ad5ad946/0x4173739f0fc81d66 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35a1e expref: 9 pid: 15125 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789996442.194857:0:14428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 14 00000100:00100000:2.0:1789996442.194866:0:14428:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0881222300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:504eef0e-44e7-471d-93df-2fb9c0c14b08+9:2362:x1876946927609984:12345-192.168.204.37@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789996442.194879:0:14428:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789996442.194901:0:14428:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ad5ad946/0x4173739f0fc81d66 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35a1e expref: 9 pid: 15125 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996442.194916:0:14428:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ad5ad946/0x4173739f0fc81d66 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35a1e expref: 9 pid: 15125 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996442.194942:0:14428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789996442.194947:0:14428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789996442.194950:0:15126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ad5ad946/0x4173739f0fc81d66 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35a1e expref: 9 pid: 15125 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996442.194959:0:14428:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ee7f5cfc/0x4173739f0fc81d6d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 15126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789996442.194971:0:15126:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086f88b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:15126:1876946942268544:192.168.204.37@tcp:104: 00010000:00010000:2.0:1789996442.194992:0:14428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ee7f5cfc/0x4173739f0fc81d6d lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 15126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996442.195163:0:15126:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ee7f5cfc/0x4173739f0fc81d6d lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996442.195165:0:14428:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789996442.195179:0:15126:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ee7f5cfc/0x4173739f0fc81d6d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996442.195188:0:15126:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ee7f5cfc/0x4173739f0fc81d6d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789996442.195219:0:14428:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0881222300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:504eef0e-44e7-471d-93df-2fb9c0c14b08+8:2362:x1876946927609984:12345-192.168.204.37@tcp:103:ldlm_bl.0 Request processed in 353us (512us total) trans 0 rc 0/0 00010000:00010000:1.0:1789996442.195226:0:15126:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000ee7f5cfc/0x4173739f0fc81d6d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789996442.195228:0:14428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 14 00010000:00010000:1.0:1789996442.195240:0:15126:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ee7f5cfc/0x4173739f0fc81d6d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996442.195250:0:15126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ee7f5cfc/0x4173739f0fc81d6d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996442.195258:0:15126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0841524a00 already unused, calling callback (ffffffffc1595910) 00010000:00010000:1.0:1789996442.195263:0:15126:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ee7f5cfc/0x4173739f0fc81d6d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996442.195273:0:15126:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ee7f5cfc/0x4173739f0fc81d6d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996442.195287:0:15126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ee7f5cfc/0x4173739f0fc81d6d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996442.195296:0:15126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ee7f5cfc/0x4173739f0fc81d6d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789996442.195346:0:15126:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0876a6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:504eef0e-44e7-471d-93df-2fb9c0c14b08+7:2365:x1876946927609856:12345-192.168.204.37@tcp:1:lhsmtool_posix.0 Request processed in 2600us (2742us total) trans 0 rc 0/0 00000100:00100000:1.0:1789996442.195365:0:15126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 18 00000100:00100000:3.0:1789996442.196803:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1789996442.196895:0:14443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927610240 00000100:00100000:1.0:1789996442.196903:0:14443:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927610240 00000100:00100000:1.0:1789996442.196953:0:14443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 53 00000100:00100000:1.0:1789996442.196964:0:14443:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0881222a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:504eef0e-44e7-471d-93df-2fb9c0c14b08+14:14479:x1876946927610240:12345-192.168.204.37@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1789996442.197044:0:14443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22c00/0x4173739f0fc81d74 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996442.197061:0:14443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22c00/0x4173739f0fc81d74 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996442.197072:0:14443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22c00/0x4173739f0fc81d74 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996442.197384:0:14443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23200/0x4173739f0fc81d7b lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996442.197396:0:14443:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0841524000/0x4173739f0fc81d43 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e35a09 expref: 15 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996442.197404:0:14443:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23200/0x4173739f0fc81d7b lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996442.197450:0:14443:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e0841524000/0x4173739f0fc81d43 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35a09 expref: 15 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996442.197464:0:14443:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0841524000/0x4173739f0fc81d43 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35a09 expref: 15 pid: 14441 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789996442.197491:0:14443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086f88b800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14443:1876946942268672:192.168.204.37@tcp:104: 00000100:00100000:1.0:1789996442.197593:0:14443:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e087663be40 going to sleep for 11 seconds 00000100:00100000:0.0:1789996442.201179:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1789996442.201268:0:14443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086f88b800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14443:1876946942268672:192.168.204.37@tcp:104: 00010000:00010000:1.0:1789996442.201296:0:14443:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23200/0x4173739f0fc81d7b lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14443 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789996442.201373:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927610368 00000100:00100000:2.0:1789996442.201380:0:14427:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927610368 00010000:00010000:2.0:1789996442.201431:0:14427:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0841524000/0x4173739f0fc81d43 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35a09 expref: 16 pid: 14441 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789996442.201466:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 15 00000100:00100000:2.0:1789996442.201476:0:14427:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0876a68000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:504eef0e-44e7-471d-93df-2fb9c0c14b08+16:2363:x1876946927610368:12345-192.168.204.37@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789996442.201491:0:14427:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789996442.201509:0:14427:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e0841524000/0x4173739f0fc81d43 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35a09 expref: 16 pid: 14441 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996442.201521:0:14427:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e0841524000/0x4173739f0fc81d43 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35a09 expref: 16 pid: 14441 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996442.201586:0:14427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0841524000/0x4173739f0fc81d43 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.37@tcp remote: 0x1b97003095e35a09 expref: 16 pid: 14441 timeout: 583 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996442.201602:0:14427:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8e0850c28200) 00010000:00010000:2.0:1789996442.201617:0:14427:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23200/0x4173739f0fc81d7b lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996442.201627:0:14427:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23200/0x4173739f0fc81d7b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996442.201635:0:14427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23200/0x4173739f0fc81d7b lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996442.201666:0:14427:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789996442.201725:0:14427:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0876a68000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:504eef0e-44e7-471d-93df-2fb9c0c14b08+15:2363:x1876946927610368:12345-192.168.204.37@tcp:103:ldlm_bl.0 Request processed in 250us (554us total) trans 0 rc 0/0 00000100:00100000:2.0:1789996442.201733:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 15 00010000:00010000:1.0:1789996442.201989:0:14443:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23200/0x4173739f0fc81d7b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996442.201997:0:14443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23200/0x4173739f0fc81d7b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14443 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789996442.202182:0:14443:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:1.0:1789996442.202331:0:14443:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 8589934618 00000001:00080000:1.0:1789996442.202379:0:14443:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:1.0:1789996442.202487:0:14443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086f88b800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14443:1876946942268800:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1789996442.202604:0:14443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789996442.202638:0:14443:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e087663b840 going to sleep for 11 seconds 00000100:00100000:0.0:1789996442.202884:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942268800 00000100:00100000:0.0:1789996442.202890:0:14446:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942268800 00000100:00100000:0.0:1789996442.202932:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789996442.202941:0:14446:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086f88a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14443:x1876946942268800:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1789996442.203027:0:14446:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086f88a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14443:x1876946942268800:12345-0@lo:1000:mdt00_002.0 Request processed in 88us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996442.203035:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789996442.203153:0:14443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086f88b800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14443:1876946942268800:0@lo:1000:mdt00_002.0 00000001:00080000:2.0:1789996442.204038:0:14443:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 8589934620 00000100:00100000:2.0:1789996442.204111:0:14443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086d7f0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14443:1876946942268928:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1789996442.204155:0:14443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789996442.204225:0:14443:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e087fa28600 going to sleep for 11 seconds 00000100:00100000:0.0:1789996442.204258:0:14446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942268928 00000100:00100000:0.0:1789996442.204263:0:14446:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942268928 00000100:00100000:0.0:1789996442.204303:0:14446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789996442.204311:0:14446:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086d7f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14443:x1876946942268928:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1789996442.204514:0:14446:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086d7f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:14443:x1876946942268928:12345-0@lo:1000:mdt00_002.0 Request processed in 202us (358us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1789996442.204521:0:14446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789996442.204725:0:14443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086d7f0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14443:1876946942268928:0@lo:1000:mdt00_002.0 00010000:00010000:2.0:1789996442.204761:0:14443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23200/0x4173739f0fc81d7b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996442.204772:0:14443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23200/0x4173739f0fc81d7b lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996442.204780:0:14443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23200/0x4173739f0fc81d7b lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996442.204786:0:14443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0876a23200 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:2.0:1789996442.204791:0:14443:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23200/0x4173739f0fc81d7b lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996442.204808:0:14443:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23200/0x4173739f0fc81d7b lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996442.204822:0:14443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8e0850c28200) 00010000:00010000:2.0:1789996442.204826:0:14443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789996442.204831:0:14443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23200/0x4173739f0fc81d7b lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996442.204838:0:14443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a23200/0x4173739f0fc81d7b lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996442.204937:0:14443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5b600/0x4173739f0fc81cd3 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996442.204944:0:14443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5b600/0x4173739f0fc81cd3 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996442.204949:0:14443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5b600/0x4173739f0fc81cd3 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996442.204954:0:14443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0741a5b600 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:2.0:1789996442.204957:0:14443:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5b600/0x4173739f0fc81cd3 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996442.204962:0:14443:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5b600/0x4173739f0fc81cd3 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 14443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996442.204970:0:14443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e0850c28e00) 00010000:00010000:2.0:1789996442.204972:0:14443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789996442.204978:0:14443:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5b200/0x4173739f0fc81cda lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e359ed expref: 18 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996442.204999:0:14443:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5b200/0x4173739f0fc81cda lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e359ed expref: 18 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996442.205008:0:14443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5b200/0x4173739f0fc81cda lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e359ed expref: 18 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996442.205035:0:14443:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5b200/0x4173739f0fc81cda lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0x1b97003095e359ed expref: 18 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789996442.205046:0:14443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e086d7f2680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14443:1876946942269056:192.168.204.37@tcp:105: 00000100:00100000:2.0:1789996442.205115:0:14443:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e087fa28600 going to sleep for 11 seconds 00000100:00100000:2.0:1789996442.210170:0:14443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e086d7f2680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14443:1876946942269056:192.168.204.37@tcp:105: 00010000:00010000:2.0:1789996442.210207:0:14443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5b600/0x4173739f0fc81cd3 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996442.210218:0:14443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5b600/0x4173739f0fc81cd3 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14443 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789996442.210249:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00010000:00010000:2.0:1789996442.210250:0:14443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5b000/0x4173739f0fc81d82 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996442.210267:0:14443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5b000/0x4173739f0fc81d82 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996442.210278:0:14443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5b000/0x4173739f0fc81d82 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996442.210288:0:14443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5b000/0x4173739f0fc81d82 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996442.210329:0:14443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5b000/0x4173739f0fc81d82 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996442.210337:0:14443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5b000/0x4173739f0fc81d82 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996442.210343:0:14443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0741a5b000 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:2.0:1789996442.210346:0:14443:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5b000/0x4173739f0fc81d82 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14443 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789996442.210347:0:14445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927610496 00000100:00100000:0.0:1789996442.210355:0:14445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927610496 00010000:00010000:2.0:1789996442.210357:0:14443:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5b000/0x4173739f0fc81d82 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996442.210371:0:14443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e0850c28e00) 00010000:00010000:2.0:1789996442.210374:0:14443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789996442.210379:0:14443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5b000/0x4173739f0fc81d82 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996442.210385:0:14443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0741a5b000/0x4173739f0fc81d82 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996442.210394:0:14443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22c00/0x4173739f0fc81d74 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996442.210400:0:14443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22c00/0x4173739f0fc81d74 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996442.210405:0:14443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22c00/0x4173739f0fc81d74 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14443 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789996442.210421:0:14445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 10 00000100:00100000:0.0:1789996442.210433:0:14445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0870a6e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:504eef0e-44e7-471d-93df-2fb9c0c14b08+19:14478:x1876946927610496:12345-192.168.204.37@tcp:49:dd.0 00000100:00100000:0.0:1789996442.210579:0:14445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0870a6e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:504eef0e-44e7-471d-93df-2fb9c0c14b08+19:14478:x1876946927610496:12345-192.168.204.37@tcp:49:dd.0 Request processed in 147us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1789996442.210596:0:14445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 10 00010000:00010000:2.0:1789996442.210796:0:14443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0876a22c00 already unused, calling callback (ffffffffc20074f0) 00010000:00010000:2.0:1789996442.210805:0:14443:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22c00/0x4173739f0fc81d74 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996442.210811:0:14443:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22c00/0x4173739f0fc81d74 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996442.210819:0:14443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e0850c28e00) 00010000:00010000:2.0:1789996442.210821:0:14443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789996442.210824:0:14443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22c00/0x4173739f0fc81d74 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14443 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996442.210830:0:14443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22c00/0x4173739f0fc81d74 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14443 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789996442.211094:0:14443:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0881222a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:504eef0e-44e7-471d-93df-2fb9c0c14b08+18:14479:x1876946927610240:12345-192.168.204.37@tcp:57:lhsmtool_posix.0 Request processed in 14131us (14298us total) trans 8589934621 rc 0/0 00000100:00100000:2.0:1789996442.211103:0:14443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 53 00000020:00080000:2.0:1789996442.211107:0:14443:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1789996442.211357:0:14475:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1789996442.211362:0:14475:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789996442.211386:0:14475:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1789996442.211392:0:14475:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1789996442.215437:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996442.216693:0:14445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927610752 00000100:00100000:0.0:1789996442.216705:0:14445:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927610752 00000100:00100000:1.0:1789996442.219335:0:14445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 11 00000100:00100000:1.0:1789996442.219350:0:14445:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0881220700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:504eef0e-44e7-471d-93df-2fb9c0c14b08+18:14479:x1876946927610752:12345-192.168.204.37@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1789996442.220087:0:14445:0:(mdd_object.c:4178:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1789996442.220191:0:14445:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 8589934622 00010000:00010000:1.0:1789996442.220235:0:14445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22400/0x4173739f0fc81d89 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996442.220252:0:14445:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22400/0x4173739f0fc81d89 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996442.220268:0:14445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22400/0x4173739f0fc81d89 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996442.220276:0:14445:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22400/0x4173739f0fc81d89 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996442.220282:0:14445:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22400/0x4173739f0fc81d89 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996442.220288:0:14445:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22400/0x4173739f0fc81d89 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996442.220315:0:14445:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789996442.220435:0:14445:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0881220700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:504eef0e-44e7-471d-93df-2fb9c0c14b08+20:14479:x1876946927610752:12345-192.168.204.37@tcp:35:lhsmtool_posix.0 Request processed in 1086us (5005us total) trans 8589934623 rc 0/0 00000100:00100000:1.0:1789996442.220444:0:14445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 11 00000020:00080000:1.0:1789996442.220450:0:14445:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789996442.220970:0:14430:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789996442.220980:0:14430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22400/0x4173739f0fc81d89 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996442.220989:0:14430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0876a22400 already unused, calling callback (ffffffffc1595910) 00010000:00010000:3.0:1789996442.220994:0:14430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22400/0x4173739f0fc81d89 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996442.221014:0:14430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22400/0x4173739f0fc81d89 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996442.221028:0:14430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8e0850c28200) 00010000:00010000:3.0:1789996442.221031:0:14430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789996442.221037:0:14430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22400/0x4173739f0fc81d89 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996442.221043:0:14430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e0876a22400/0x4173739f0fc81d89 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14445 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996442.221056:0:14430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789996442.221057:0:14430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789996442.221059:0:14430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789996442.312454:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1789996442.312495:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1789996442.312777:0:15130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927610880 00000100:00100000:3.0:1789996442.312787:0:15130:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927610880 00000100:00100000:3.0:1789996442.312851:0:15130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927611136 00000100:00100000:3.0:1789996442.312855:0:15130:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927611136 00000100:00100000:3.0:1789996442.312874:0:15130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 0 00000100:00100000:3.0:1789996442.312884:0:15130:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086f889180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:504eef0e-44e7-471d-93df-2fb9c0c14b08+8:2362:x1876946927610880:12345-192.168.204.37@tcp:4:dd.0 00002000:00010000:3.0:1789996442.312943:0:15130:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x6ab12d9a, atime: 0x6ab12d99, ctime: 0x6ab12d9a, blocks: 0x1 00010000:00010000:3.0:1789996442.312953:0:15130:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d6af5220/0x4173739f0fc81d90 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996442.312969:0:15130:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=484s v=(0 0) 00000100:00100000:1.0:1789996442.313117:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996442.313307:0:15131:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1789996442.313316:0:15131:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00010000:00010000:3.0:1789996442.313538:0:15130:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00000100:00100000:0.0:1789996442.313636:0:15132:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:0.0:1789996442.313649:0:15132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927611008 00000100:00100000:0.0:1789996442.313653:0:15132:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927611008 00010000:00010000:3.0:1789996442.313722:0:15130:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d6af5220/0x4173739f0fc81d90 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996442.313766:0:15130:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d6af5220/0x4173739f0fc81d90 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789996442.314652:0:16672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 1 00000100:00100000:2.0:1789996442.314665:0:16672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086f889f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:504eef0e-44e7-471d-93df-2fb9c0c14b08+9:2363:x1876946927611136:12345-192.168.204.37@tcp:4:dd.0 00010000:00010000:2.0:1789996442.314694:0:16672:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000005916618/0x4173739f0fc81d97 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996442.314707:0:16672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789996442.314710:0:16672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789996442.314716:0:16672:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000005916618/0x4173739f0fc81d97 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996442.314737:0:16672:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000005916618/0x4173739f0fc81d97 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789996442.392233:0:7659:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 8589934597 is committed 00000001:00080000:1.0:1789996442.392250:0:7659:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 8589934594 is committed 00000001:00080000:1.0:1789996442.392351:0:7659:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 8589934596 is committed 00000001:00080000:1.0:1789996442.392362:0:7659:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 8589934598 is committed 00000001:00080000:1.0:1789996442.392371:0:7659:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 8589934599 is committed 00002000:00010000:3.0:1789996442.392537:0:16672:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 3145728 00002000:00010000:3.0:1789996442.392562:0:16672:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 4103 00010000:00010000:3.0:1789996442.392576:0:16672:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000005916618/0x4173739f0fc81d97 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996442.392589:0:16672:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000005916618/0x4173739f0fc81d97 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996442.392598:0:16672:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000005916618/0x4173739f0fc81d97 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996442.392606:0:16672:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0741a5b600 already unused, calling callback (ffffffffc1595910) 00010000:00010000:3.0:1789996442.392611:0:16672:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000005916618/0x4173739f0fc81d97 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996442.392620:0:16672:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000005916618/0x4173739f0fc81d97 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996442.392640:0:16672:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000005916618/0x4173739f0fc81d97 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996442.392649:0:16672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000005916618/0x4173739f0fc81d97 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996442.392858:0:15130:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d6af5220/0x4173739f0fc81d90 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996442.392867:0:15130:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d6af5220/0x4173739f0fc81d90 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996442.392880:0:15130:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d6af5220/0x4173739f0fc81d90 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996442.392885:0:15130:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0841525000 already unused, calling callback (ffffffffc1595910) 00010000:00010000:1.0:1789996442.392888:0:15130:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d6af5220/0x4173739f0fc81d90 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996442.392895:0:15130:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d6af5220/0x4173739f0fc81d90 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996442.392906:0:15130:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d6af5220/0x4173739f0fc81d90 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996442.392913:0:15130:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d6af5220/0x4173739f0fc81d90 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789996442.393296:0:16672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086f889f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:504eef0e-44e7-471d-93df-2fb9c0c14b08+7:2363:x1876946927611136:12345-192.168.204.37@tcp:4:dd.0 Request processed in 78629us (80794us total) trans 8589934598 rc 0/0 00000100:00100000:3.0:1789996442.393307:0:16672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 1 00000100:00100000:3.0:1789996442.393337:0:16672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 2 00000100:00100000:3.0:1789996442.393349:0:16672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086f88b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:504eef0e-44e7-471d-93df-2fb9c0c14b08+6:2362:x1876946927611008:12345-192.168.204.37@tcp:4:dd.0 00002000:00010000:3.0:1789996442.393388:0:16672:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 3145728, mtime: 0x6ab12d9a, atime: 0x6ab12d99, ctime: 0x0, blocks: 0x1007 00010000:00010000:3.0:1789996442.393395:0:16672:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ae350b0e/0x4173739f0fc81d9e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996442.393427:0:16672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=484s v=(0 0) 00010000:00010000:3.0:1789996442.393433:0:16672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789996442.393439:0:16672:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ae350b0e/0x4173739f0fc81d9e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996442.393451:0:16672:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ae350b0e/0x4173739f0fc81d9e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789996442.393705:0:15130:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086f889180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:504eef0e-44e7-471d-93df-2fb9c0c14b08+7:2362:x1876946927610880:12345-192.168.204.37@tcp:4:dd.0 Request processed in 80820us (81260us total) trans 8589934599 rc 0/0 00000100:00100000:1.0:1789996442.393718:0:15130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 0 00000100:00100000:0.0:1789996442.408608:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1789996442.408676:0:15132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927611264 00000100:00100000:3.0:1789996442.408686:0:15132:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927611264 00000100:00100000:3.0:1789996442.408757:0:15132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 3 00000100:00100000:3.0:1789996442.408770:0:15132:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0876a6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:504eef0e-44e7-471d-93df-2fb9c0c14b08+7:2362:x1876946927611264:12345-192.168.204.37@tcp:4:dd.0 00010000:00010000:3.0:1789996442.408809:0:15132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000424e3b52/0x4173739f0fc81da5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996442.408846:0:15132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789996442.408850:0:15132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789996442.408857:0:15132:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000424e3b52/0x4173739f0fc81da5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996442.408870:0:15132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000424e3b52/0x4173739f0fc81da5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789996442.412259:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996442.412284:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996442.412316:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1789996442.412333:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1789996442.412794:0:15131:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:0.0:1789996442.412804:0:15131:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_004' 00000100:00100000:0.0:1789996442.413043:0:15131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927611392 00000100:00100000:0.0:1789996442.413052:0:15131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927611392 00000100:00100000:0.0:1789996442.413102:0:15131:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:0.0:1789996442.413108:0:15131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927611520 00000100:00100000:0.0:1789996442.413111:0:15131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927611520 00000100:00100000:0.0:1789996442.413123:0:15131:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:0.0:1789996442.413127:0:15131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927611648 00000100:00100000:0.0:1789996442.413129:0:15131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927611648 00000100:00100000:0.0:1789996442.413139:0:15131:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:0.0:1789996442.413143:0:15131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946927611776 00000100:00100000:0.0:1789996442.413145:0:15131:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946927611776 00000100:00100000:2.0:1789996442.415043:0:16675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 4 00000100:00100000:2.0:1789996442.415061:0:16675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086d7f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:504eef0e-44e7-471d-93df-2fb9c0c14b08+12:2362:x1876946927611392:12345-192.168.204.37@tcp:4:dd.0 00010000:00010000:2.0:1789996442.415100:0:16675:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008b792b14/0x4173739f0fc81dac lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996442.415117:0:16675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789996442.415121:0:16675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789996442.415128:0:16675:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008b792b14/0x4173739f0fc81dac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996442.415142:0:16675:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008b792b14/0x4173739f0fc81dac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789996442.467153:0:16672:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 3145728 -> 5242880 00002000:00010000:1.0:1789996442.467165:0:16672:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 4103 -> 6151 00010000:00010000:1.0:1789996442.467181:0:16672:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ae350b0e/0x4173739f0fc81d9e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996442.467193:0:16672:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ae350b0e/0x4173739f0fc81d9e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996442.467218:0:16672:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ae350b0e/0x4173739f0fc81d9e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996442.467225:0:16672:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0841524c00 already unused, calling callback (ffffffffc1595910) 00010000:00010000:1.0:1789996442.467230:0:16672:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ae350b0e/0x4173739f0fc81d9e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996442.467238:0:16672:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ae350b0e/0x4173739f0fc81d9e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996442.467258:0:16672:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ae350b0e/0x4173739f0fc81d9e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996442.467265:0:16672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ae350b0e/0x4173739f0fc81d9e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789996442.467618:0:7659:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 8589934600 is committed 00000100:00100000:1.0:1789996442.467742:0:16672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086f88b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:504eef0e-44e7-471d-93df-2fb9c0c14b08+16:2362:x1876946927611008:12345-192.168.204.37@tcp:4:dd.0 Request processed in 74391us (154619us total) trans 8589934600 rc 0/0 00000100:00100000:1.0:1789996442.467753:0:16672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 2 00000100:00100000:1.0:1789996442.467785:0:16672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 5 00000100:00100000:1.0:1789996442.467797:0:16672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086d7f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:504eef0e-44e7-471d-93df-2fb9c0c14b08+15:2362:x1876946927611520:12345-192.168.204.37@tcp:4:dd.0 00010000:00010000:1.0:1789996442.467828:0:16672:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb99f5fb/0x4173739f0fc81db3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996442.467842:0:16672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789996442.467855:0:16672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789996442.467862:0:16672:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb99f5fb/0x4173739f0fc81db3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996442.467874:0:16672:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb99f5fb/0x4173739f0fc81db3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789996442.505304:0:7659:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 8589934602 is committed 00002000:00010000:0.0:1789996442.505362:0:16675:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 5242880 -> 6291456 00002000:00010000:0.0:1789996442.505366:0:16675:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 6151 -> 10247 00010000:00010000:0.0:1789996442.505382:0:16675:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008b792b14/0x4173739f0fc81dac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996442.505588:0:16675:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008b792b14/0x4173739f0fc81dac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996442.505599:0:16675:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008b792b14/0x4173739f0fc81dac lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996442.505601:0:15132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000424e3b52/0x4173739f0fc81da5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996442.505621:0:15132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000424e3b52/0x4173739f0fc81da5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996442.505631:0:15132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000424e3b52/0x4173739f0fc81da5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996442.505631:0:16675:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0741a5a200 already unused, calling callback (ffffffffc1595910) 00010000:00010000:0.0:1789996442.505637:0:16675:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008b792b14/0x4173739f0fc81dac lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996442.505647:0:16675:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008b792b14/0x4173739f0fc81dac lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996442.505736:0:16675:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008b792b14/0x4173739f0fc81dac lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996442.505747:0:16675:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008b792b14/0x4173739f0fc81dac lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996442.505774:0:15132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0841525200 already unused, calling callback (ffffffffc1595910) 00010000:00010000:1.0:1789996442.505779:0:15132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000424e3b52/0x4173739f0fc81da5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996442.505788:0:15132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000424e3b52/0x4173739f0fc81da5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996442.505804:0:15132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000424e3b52/0x4173739f0fc81da5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996442.505812:0:15132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000424e3b52/0x4173739f0fc81da5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789996442.505830:0:16675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086d7f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:504eef0e-44e7-471d-93df-2fb9c0c14b08+13:2362:x1876946927611392:12345-192.168.204.37@tcp:4:dd.0 Request processed in 90769us (93575us total) trans 8589934601 rc 0/0 00000100:00100000:1.0:1789996442.505884:0:15132:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0876a6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:504eef0e-44e7-471d-93df-2fb9c0c14b08+12:2362:x1876946927611264:12345-192.168.204.37@tcp:4:dd.0 Request processed in 97116us (97283us total) trans 8589934602 rc 0/0 00000100:00100000:0.0:1789996442.505922:0:16675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 4 00000100:00100000:1.0:1789996442.505931:0:15132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 3 00000100:00100000:0.0:1789996442.505959:0:16675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 6 00000100:00100000:1.0:1789996442.505968:0:15132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 7 00000100:00100000:0.0:1789996442.505973:0:16675:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086d7f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:504eef0e-44e7-471d-93df-2fb9c0c14b08+10:2362:x1876946927611648:12345-192.168.204.37@tcp:4:dd.0 00000100:00100000:1.0:1789996442.505980:0:15132:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e086d7f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:504eef0e-44e7-471d-93df-2fb9c0c14b08+10:2363:x1876946927611776:12345-192.168.204.37@tcp:4:dd.0 00010000:00010000:0.0:1789996442.506004:0:16675:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005c66cbf9/0x4173739f0fc81dba lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996442.506023:0:16675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789996442.506025:0:15132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000020356102/0x4173739f0fc81dc1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996442.506028:0:16675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789996442.506040:0:16675:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005c66cbf9/0x4173739f0fc81dba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996442.506055:0:15132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789996442.506055:0:16675:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005c66cbf9/0x4173739f0fc81dba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996442.506063:0:15132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789996442.506074:0:15132:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000020356102/0x4173739f0fc81dc1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789996442.506085:0:15132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000020356102/0x4173739f0fc81dc1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789996442.541389:0:7659:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 8589934603 is committed 00002000:00010000:2.0:1789996442.542890:0:16672:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 6291456 -> 7654321 00002000:00010000:2.0:1789996442.542898:0:16672:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 10247 -> 14343 00010000:00010000:2.0:1789996442.542914:0:16672:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb99f5fb/0x4173739f0fc81db3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996442.542943:0:16672:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fb99f5fb/0x4173739f0fc81db3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996442.542952:0:16672:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fb99f5fb/0x4173739f0fc81db3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996442.542959:0:16672:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0876a22a00 already unused, calling callback (ffffffffc1595910) 00010000:00010000:2.0:1789996442.542964:0:16672:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb99f5fb/0x4173739f0fc81db3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996442.542974:0:16672:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb99f5fb/0x4173739f0fc81db3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996442.542995:0:16672:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fb99f5fb/0x4173739f0fc81db3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789996442.543003:0:16672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb99f5fb/0x4173739f0fc81db3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789996442.543098:0:16672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086d7f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:504eef0e-44e7-471d-93df-2fb9c0c14b08+13:2362:x1876946927611520:12345-192.168.204.37@tcp:4:dd.0 Request processed in 75298us (130806us total) trans 8589934603 rc 0/0 00000100:00100000:2.0:1789996442.543107:0:16672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 5 00002000:00010000:3.0:1789996442.586462:0:16675:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 14343 -> 16391 00010000:00010000:3.0:1789996442.586484:0:16675:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005c66cbf9/0x4173739f0fc81dba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996442.586497:0:16675:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005c66cbf9/0x4173739f0fc81dba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996442.586506:0:16675:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005c66cbf9/0x4173739f0fc81dba lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996442.586514:0:16675:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e086fcb7e00 already unused, calling callback (ffffffffc1595910) 00010000:00010000:3.0:1789996442.586519:0:16675:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005c66cbf9/0x4173739f0fc81dba lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996442.586528:0:16675:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005c66cbf9/0x4173739f0fc81dba lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996442.586603:0:16675:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005c66cbf9/0x4173739f0fc81dba lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789996442.586610:0:16675:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005c66cbf9/0x4173739f0fc81dba lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789996442.586701:0:16675:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086d7f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:504eef0e-44e7-471d-93df-2fb9c0c14b08+11:2362:x1876946927611648:12345-192.168.204.37@tcp:4:dd.0 Request processed in 80728us (174379us total) trans 8589934604 rc 0/0 00000100:00100000:3.0:1789996442.586711:0:16675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 6 00000001:00080000:3.0:1789996442.586747:0:7659:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 8589934604 is committed 00000001:00080000:3.0:1789996442.586760:0:7659:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 8589934605 is committed 00010000:00010000:0.0:1789996442.588660:0:15132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000020356102/0x4173739f0fc81dc1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996442.588675:0:15132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000020356102/0x4173739f0fc81dc1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996442.588684:0:15132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000020356102/0x4173739f0fc81dc1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996442.588691:0:15132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e0876a22e00 already unused, calling callback (ffffffffc1595910) 00010000:00010000:0.0:1789996442.588696:0:15132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000020356102/0x4173739f0fc81dc1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996442.588704:0:15132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000020356102/0x4173739f0fc81dc1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996442.588722:0:15132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000020356102/0x4173739f0fc81dc1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789996442.588746:0:15132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000020356102/0x4173739f0fc81dc1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789996442.588825:0:15132:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e086d7f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:504eef0e-44e7-471d-93df-2fb9c0c14b08+5:2363:x1876946927611776:12345-192.168.204.37@tcp:4:dd.0 Request processed in 82846us (176487us total) trans 8589934605 rc 0/0 00000100:00100000:0.0:1789996442.588834:0:15132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 7 00010000:00010000:2.0:1789996442.667452:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789996443.689271:0:14430:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789996443.953806:0:16713:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00000100:00100000:2.0:1789996444.648718:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789996444.648741:0:3315:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e0881221180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876946942269184:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789996444.648824:0:3315:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789996444.648965:0:15129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876946942269184 00000100:00100000:3.0:1789996444.648975:0:15129:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876946942269184 00000100:00100000:3.0:1789996444.649086:0:15129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789996444.649097:0:15129:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e0880f78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876946942269184:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789996444.649136:0:15129:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789996444.649205:0:15129:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e0880f78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1876946942269184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 109us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1789996444.649212:0:15129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789996444.649264:0:3315:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e0881221180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3315:1876946942269184:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789996444.649862:0:14437:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789996444.713681:0:14429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789996445.289076:0:14475:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1789996445.289084:0:14475:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789996445.289115:0:14475:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1789996445.289123:0:14475:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 Debug log: 28893 lines, 28893 kept, 0 dropped, 0 bad.